Target Plane Detection for XR Anchoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented and extended reality experiences face challenges in managing processing loads and power consumption, leading to battery depletion, decreased frame rates, and heat buildup due to the high demands of maintaining a digital understanding of the environment for anchoring digital objects.
Innovation Solution
A system and method for target plane detection and space estimation that involves obtaining scene data, defining a detection area, creating a plane model based on point cloud data, determining the usable size of the plane, and comparing it to the digital object's size to efficiently position digital objects on suitable planes, thereby reducing unnecessary processing and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If comprehensive plane detection and digital object positioning is performed across the entire scene, then the accuracy and reliability of anchoring digital objects is improved, but the processing load and power consumption increase significantly
Solution Approach 1:
The patent divides the scene into multiple detection areas and processes plane detection in segments rather than analyzing the entire scene at once. This segmentation allows the system to maintain detection accuracy in each local area while reducing the overall computational burden and power consumption across the full scene.
Solution Approach 2:
The system applies different processing quality and depth to different regions of the scene based on local requirements. High-precision plane detection is applied only to areas where digital objects need to be anchored, while other areas receive reduced or no processing, thereby optimizing the balance between reliability and energy consumption.
2Reliability
If comprehensive plane detection and digital object positioning is performed across the entire scene, then the accuracy and reliability of anchoring digital objects is improved, but the processing load increases rapidly
Solution Approach 1:
The patent segments the scene into multiple detection areas, allowing plane detection to be performed on smaller, manageable subsets of data rather than the entire scene. This reduces the computational complexity and processing load while maintaining detection accuracy within each segmented region.
Solution Approach 2:
The system performs plane detection partially, focusing computational resources only on specific detection areas where digital objects need to be positioned, rather than exhaustively analyzing the entire scene. This partial action approach reduces processing load while achieving sufficient accuracy for the intended application.
3Speed
If continuous processing is performed to maintain digital understanding of the environment, then the frame rate and responsiveness of the XR experience is improved, but heat buildup from the processor increases
Solution Approach 1:
The patent implements periodic processing where plane detection and scene understanding are updated at specific intervals or triggers rather than continuously. This periodic action maintains adequate frame rates and responsiveness for the XR experience while allowing processing pauses that reduce heat buildup from continuous high-power operation.
Data Source
AI summary
A method includes obtaining scene data, wherein the scene data includes image data of a scene and depth data of the scene, and the depth data includes depth measurement values of points of a point cloud. The method further includes defining a first detection area, wherein the first detection area includes a spatially defined subset of the scene data, defining a plane model based on points of the point cloud within the first detection area, and defining a plane based on the plane model. The method includes determining at least one value of a usable size of the plane based on points of the point cloud, comparing at least one value of a characteristic size of a digital object to the at least one value of the usable size of the plane, and generating a display including the digital object positioned upon the plane based on the plane model.