Augmented Reality 3D Map Construction for Virtual Object Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems face challenges in seamlessly integrating virtual objects into real environments in real-time, particularly in determining the correct placement and orientation of virtual objects relative to real-world objects and environments.
Innovation Solution
A cross-platform system utilizing a visual sensor and computing device to capture images, construct a 3D map of the environment, identify 2D objects, and place 3D models based on feature points, planes, and object recognition, ensuring accurate collision detection and intelligent placement of virtual objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If virtual objects are integrated into real environments in real-time, then user experience and interactivity are improved, but placement accuracy and orientation correctness deteriorate
Solution Approach 1:
The system performs preliminary actions by constructing a 3D map of the environment and identifying feature points before placing virtual objects. The computing device processes images to create spatial representations and detects planes and objects in advance, enabling accurate placement decisions to be made quickly during real-time interaction without compromising precision for the sake of speed
Solution Approach 2:
The patent replaces traditional mechanical or manual placement methods with computational algorithms. The system uses image processing, 3D mapping, and machine learning models to automatically determine optimal placement positions and orientations of virtual objects, substituting complex computational processes for what would otherwise require precise manual positioning, thereby achieving both speed and accuracy
2Manufacturing precision
If complex 3D mapping and object recognition algorithms are used, then virtual object placement accuracy is improved, but system complexity and processing time worsen
Solution Approach 1:
The system segments the complex task of virtual object placement into distinct modules: image capture, 3D map construction, feature point identification, plane detection, object recognition, and placement decision-making. Each module handles a specific aspect of the process, making the overall system more manageable and efficient despite the complexity of the individual components
Solution Approach 2:
The patent introduces intermediary data structures and processing layers between the raw image input and the final placement decision. The 3D map and feature point representations serve as intermediaries that simplify the relationship between the complex image data and the placement algorithm, enabling accurate results without requiring the full complexity of the image processing pipeline to be directly involved in every placement decision
Data Source
AI summary
A system and method for realizing augmented reality. The system includes a visual sensor configured to capture images of an environment and a computing device in communication with the visual sensor. The computing device has a processor and a storage device storing computer executable code. The computer executable code, when executed at the processor, is configured to: identify two-dimensional (2D) objects in the captured images; construct a three-dimensional (3D) map of the environment using the captured images; define 3D objects in the 3D map by mapping the 2D objects identified in the captured images to the corresponding points in the 3D map; and render a 3D model on the 3D map based on the 3D objects defined in the 3D map.