Publication Date

Spring 2023

Degree Type

Master's Project

Degree Name

Master of Science (MS)

Department

Computer Science

First Advisor

Christopher Pollett

Second Advisor

Robert Chun

Third Advisor

William Andreopoulos

Keywords

3D mesh Reconstruction, Augmented Reality

Abstract

The goal of the project is to improve the shopping experience for users by using augmented reality technology. People generally want opinions from others when buying shoes offline. Clicking and sending images of a shoe is not an ideal solution as it does not give the complete feel of the shoe. We developed the 3D AR Reconstruction app to make this process better. A user of our app clicks photos of the shoe. This image data is converted to form a mesh that can be shared. On receiving a model the user can open it in the app and interact with it to get a better look and feel of the shoe. This can be particularly useful in something like Amazon where sellers can click images to build a mesh and customers can render this mesh for a better buying experience.

The project is implemented by having a phone app to click images and view the model in augmented reality. It also has a server that converts 2D images to 3D mesh. There are existing apps that allow you to view meshes in 3D and convert images to 3D models but there is no app that allows you to build 3D models from images and view those models in 3D. We did user testing which gave us great insights in building the project and improving the project in the future.

Share

COinS