AR Object Placement via 3D Environment Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality systems for online retail stores struggle to accurately place virtual representations of objects within a physical environment, often ignoring the layout and existing objects, leading to nonsensical placements and a poor user experience.
Innovation Solution
The system automatically determines an initial location for the virtual representation of an object based on the physical environment's layout and features, using pre-processing to build a 3D model and apply criteria such as available space, object orientation, and typical placement positions, allowing for more realistic and user-friendly object placement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If automatic placement based on environment analysis is implemented, then placement accuracy and realism are improved, but system complexity and processing time increase
Solution Approach 1:
The system performs pre-processing of the physical environment before object placement, building a 3D model and identifying placement criteria in advance. This preliminary analysis of the environment includes detecting surfaces, objects, and spatial relationships, which are then used to guide accurate automatic placement without requiring complex real-time calculations during the placement operation itself.
2Adaptability or versatility
If manual manipulation of virtual objects is required, then placement flexibility is improved, but ease of operation deteriorates
Solution Approach 1:
The system enables self-service automatic placement by analyzing the environment and autonomously determining optimal positions for virtual objects based on predefined criteria such as available space, object orientation, and typical placement positions. This allows the system to perform placement tasks automatically without requiring manual manipulation, while still maintaining flexibility through configurable placement criteria and user-selectable options.
Data Source
AI summary
Devices, systems, and methods are provided for real-time object placement guidance in augmented reality experience. An example method may include receiving, by a device having a sensor, an indication of an object to be viewed in an physical environment of the device. The example method may also include determining a 3D model of the physical environment using data of the physical environment captured by the sensor. The example method may also include determining that a first surface in the 3D model of the environment is a first floor space, and a second surface in the 3D model of the environment is a first wall space. The example method may also include determining that a portion of the first surface is unoccupied and sized to fit the object. The example method may also include determining a first location in the 3D model of the physical environment for placement of a virtual representation of the object based on a 3D model of the object, wherein the first location corresponds to the portion of the first floor space. The example method may also include generating the virtual representation of the object for display at the first location, the virtual representation of the object having a first orientation, wherein the first orientation is based on a second orientation of the second surface. The example method may also include generating a first real-time view of the physical environment comprising the virtual representation of the object within the portion of the first location and in the first orientation. In some cases, a real-time virtual overlay may also be generated in the physical environment, the real-time virtual overlay indicating a location of a floor space in the physical environment.