Furnitrue

AIGC Application, Speech to 3D in WebAR and Headset Augmentation

Collabrator: Weiying Wang, Tanay Kashyap, Ryan Haraki
Role: webAR design, UI/UX design 
Toolkits: Point-E, python, A-frame, three.js
Platform: 8th Wall (webAR), Meta Quest Pro (headset AR)
Year: 2023


Github: https://github.com/Reality-Hack-2023/REPO-033
Devpost: https://devpost.com/software/furnitrue
Make it to MIT Reality Hack semi-final
Furnitrue is an AR application that enables users to generate furniture and home decor products according to audio descriptions, which are displayed in AR. The app allows users to visualize their designs in real-world settings and make adjustments as needed before making a purchase. This allows for a more immersive and convenient shopping experience for those looking to decorate their homes.









Audio to text generation


Scale and rotate the generated furniture in physical space


Compare the NeRF generated furniture and Point-E generated ones








Project Demo Video







react with the furniture in VR headset (Meta Quest Pro)

duplicate the furniture in VR headset (Meta Quest Pro)

react with the furniture in webAR platform (8th Wall)

 



Contact: weiwudesignlab@gmail.com
Instagram︎︎︎LinkedIn︎︎︎


©2024 All right reserved Wei Wu