AR/VR Plane Detection Using Reticle Elements for Virtual Substrates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Placing augmented reality/virtual reality (AR/VR) objects in unmapped or dynamic scenes without suitable virtual substrates leads to poor user experience, as these objects may float, occlude, or collide with real-world objects, resulting in an unconvincing and lifelike interaction.
Innovation Solution
Detecting planes or quadtrees within the scene to provide virtual substrates for anchoring AR/VR objects, using reticle elements to visually indicate detected planes and dynamically adjusting their appearance based on the extent and orientation, allowing for accurate placement and manipulation of AR/VR objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AR/VR objects are placed in unmapped or dynamic scenes without virtual substrates, then placement flexibility is improved, but user experience deteriorates due to objects floating or colliding with real-world objects
Solution Approach 1:
The patent introduces reticle elements as intermediary visual indicators between the AR/VR objects and the real-world scene. These reticles detect and indicate planes in the captured media, providing a mediator that bridges virtual object placement with real-world surface detection, ensuring objects are anchored to appropriate surfaces rather than floating in mid-air
Solution Approach 2:
The system performs preliminary detection of planes and display of reticle elements before AR/VR objects are placed in the scene. By pre-identifying suitable virtual substrates through plane detection and indicating them with reticles, the system prepares the placement environment in advance, ensuring objects will be anchored to appropriate surfaces
2Reliability
If plane detection and reticle display are implemented to provide virtual substrates, then user experience is improved by anchoring AR/VR objects to real surfaces, but device complexity increases
Solution Approach 1:
The reticle element serves multiple functions: it indicates detected planes to users, defines the extent and orientation of virtual substrates, and guides object placement. This multi-functional design consolidates several capabilities into a single UI element, managing complexity while providing comprehensive plane detection feedback
Solution Approach 2:
The reticle element changes its appearance state (visual properties) to communicate different information about detected planes. By using visual state changes rather than adding separate indicators, the system conveys multiple pieces of information about plane characteristics without increasing the number of discrete system components
3Manufacturing precision
If reticle elements dynamically adjust appearance to indicate plane extent and orientation, then placement accuracy is improved, but processing time increases
Solution Approach 1:
The system updates reticle element appearance dynamically as planes are detected and characterized. By using periodic updates triggered by detection events rather than continuous processing, the system maintains accurate visual feedback about plane extent and orientation while minimizing unnecessary processing cycles
Data Source
AI summary
An electronic device: obtains a plurality of sets of images; synthesizes a three-dimensional point cloud for each of the plurality of sets of images; constructs planes using the respective three-dimensional point clouds; and generates a merged set of quadtrees characterizing a merged set of planes across the three-dimensional point clouds.