AR Item Orientation on Vertical Planes Using 3D Room Models
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AR systems require users to manually select and position AR elements, which is time-consuming and often results in unrealistic placements, leading to user frustration and resource waste.
Innovation Solution
The system automatically determines the room or environment in view using depth information, generates a 3D model, and intelligently places AR items on vertical planes, adjusting their orientation to match the environment's geometry.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users manually select and position AR elements, then they have control over placement, but it is time-consuming and results in unrealistic placements
Solution Approach 1:
The system performs preliminary actions by automatically detecting the environment, generating a 3D model, and pre-positioning AR elements before the user needs to view them. The AR elements are automatically placed on vertical planes with correct orientation, eliminating the need for users to manually search and position them, thus saving time while maintaining realistic placements.
Solution Approach 2:
The AR system serves itself by automatically detecting the user's environment, generating appropriate 3D models, and intelligently positioning AR elements without requiring manual user input. The system autonomously determines optimal placement locations and adjusts orientations, freeing the user from manual operation while ensuring realistic and appropriate placements.
2Ease of operation
If users manually position AR elements, then they can control placement location, but it leads to unrealistic placements and user frustration
Solution Approach 1:
The patent replaces the mechanical manual positioning system with an automated computer vision and 3D modeling system. The system uses image processing, depth information, and 3D rendering to automatically place AR elements in realistic positions and orientations within the captured environment, eliminating the unrealistic placements that occur with manual positioning.
Solution Approach 2:
The system changes the parameters of AR element placement by automatically calculating optimal positions, orientations, and scales based on the detected environment's 3D model. Instead of relying on user input that may result in unrealistic placements, the system computes and applies appropriate parameters that ensure realistic and contextually accurate AR element integration.
3Loss of time
If the system automatically places AR items, then manual effort is reduced, but the system complexity increases
Solution Approach 1:
The patent segments the complex automatic placement system into distinct functional modules: environment detection module, 3D model generation module, AR element positioning module, and orientation adjustment module. Each module handles a specific aspect of the automatic placement process, making the overall complex system more manageable and easier to implement through modular architecture.
Solution Approach 2:
The system introduces an intermediary 3D model representation as a mediator between the captured environment and the AR element placement. The 3D model serves as a virtual framework that facilitates automatic positioning and orientation calculations, simplifying the complex task of realistic AR placement by providing a structured intermediate representation of the environment geometry.
4Manufacturing precision
If AR items are placed on vertical planes with correct orientation, then placement accuracy is improved, but the system requires sophisticated environment analysis
Solution Approach 1:
The system creates a virtual copy or 3D representation of the real-world environment captured by the camera. This digital twin of the environment serves as a simplified model that the system can analyze and manipulate to determine accurate AR element placement positions and orientations on vertical planes, reducing the complexity of directly analyzing the real environment.
Solution Approach 2:
The patent transitions from 2D image analysis to 3D spatial reasoning by generating a three-dimensional model of the environment. This dimensional change enables the system to accurately determine vertical plane orientations and calculate appropriate AR element placements in 3D space, improving placement accuracy while managing complexity through computational geometry rather than direct real-world analysis.
Data Source
AI summary
Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.