Visualizing stuff using Augmented Reality

IKEA Place on AppStore
  1. Ability to place and remove objects in and from the real world
  2. Ability to change the size and position of placed objects
Real vs Augmented: real sofa vs 3D model of sofa through our app
Loose architecture of the App
  1. Sceneform (ARCore): This is just an easier way of using ARCore without getting into nitty-gritty details of OpenGL. It takes care of everything related to AR: identifying a plane, placing and interacting with the object, lifelike rendering and so much more. You can find list of supported devices here: https://developers.google.com/ar/discover/supported-devices
  2. Firebase: You can use any database, there is no specific reason to use Firebase other than ease of integration. This is used for everything related to data: user details, authentication, product metadata, store metadata, product images and even 3D models
  1. User logs in using his/her phone number
  2. A list of stores is populated to choose from
  3. Within each store there is a list of products along with their information
  4. User selects a product and the camera opens
  5. User points at a planar surface and moves the phone side to side for plane detection
  6. When the detection succeeds, user taps on the location where he/she wants to place the required object
  7. Now the object can be manipulated and more objects can be added/deleted
An example of the product screen

--

--

--

Works in the Core ML team of Goldman Sachs

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Spire-Books: A UX Case Study.

Are you prepared for the “NOW”?

UX/UI Design & Branding-FroNation

Redesigning the PasarPolis Employee Health Insurance Website: a UX Case Study

Fabric 77 Pbr Texture

eBay Kleinanzeigen: a mini UX case study

The secret behind designing creative websites

We Wouldn’t Be Here If They Just Told Us the Truth About Great Zimbabwe

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Shashank Yadav

Shashank Yadav

Works in the Core ML team of Goldman Sachs

More from Medium

Introducing Version 1.0 of the Trueface SDK

Faces: AI Blitz XIII with Team GLaDOS

Augmented Reality with OpenCV

Studying Cross Transferability of Vision Transformers using HAM10000 skin cancer dataset