3D Plane Information for Augmented Reality Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Augmented Reality (AR) display methods result in unrealistic placements of virtual objects in real scenes, leading to poor user experience due to inaccurate determination of planes in multimedia information.
Innovation Solution
A method involving region segmentation and depth estimation to determine three-dimensional (3D) plane information, allowing for more accurate placement of virtual objects in AR displays, enhancing the realism of AR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If virtual objects are directly placed in multimedia information corresponding to a real scene, then AR display can be implemented quickly, but the placement accuracy and realism deteriorate
Solution Approach 1:
The patent applies segmentation by dividing the multimedia information into multiple candidate regions and further segmenting each region into sub-regions based on depth estimation. This hierarchical segmentation allows the system to identify precise plane locations and orientations without requiring complex global analysis, thus maintaining processing efficiency while improving plane determination accuracy.
Solution Approach 2:
The patent transitions from 2D plane determination to 3D plane determination by incorporating depth estimation. This dimensional enhancement allows virtual objects to be placed with accurate depth, orientation, and position information, significantly improving placement accuracy and realism while maintaining reasonable processing throughput through efficient depth estimation algorithms.
2Device complexity
If 2D plane information is used for AR display, then processing complexity is reduced, but the realism and accuracy of virtual object placement deteriorates
Solution Approach 1:
The patent enhances 2D plane information by adding the depth dimension to create 3D plane information. This is achieved through depth estimation on candidate regions, which provides distance, orientation, and position data. The 3D information enables accurate virtual object placement matching real-world geometry while the processing remains manageable through region-based filtering and efficient depth estimation techniques.
3Measurement precision
If region segmentation and depth estimation are performed to determine 3D plane information, then virtual object placement accuracy is improved, but processing time and computational complexity increase
Solution Approach 1:
The patent performs region segmentation to identify candidate regions first, then applies depth estimation only to these candidate regions rather than the entire image. This selective processing significantly reduces computational complexity and processing time compared to full-image analysis, while still achieving high plane determination accuracy for the regions that matter for AR placement.
Solution Approach 2:
The patent implements a multi-stage filtering process where candidate regions are identified, then sub-regions are extracted and analyzed. This partial action approach focuses computational resources on promising areas only, avoiding unnecessary processing of irrelevant regions, thus reducing overall processing time while maintaining high accuracy for the final plane determination.
Data Source
AI summary
The present invention provides a method for determining a plane, a method for displaying Augmented Reality (AR) display information and corresponding devices. The method comprises the steps of: performing region segmentation and depth estimation on multimedia information; determining, according to the result of region segmentation and the result of depth estimation, 3D plane information of the multimedia information; and, displaying AR display information according to the 3D plane information corresponding to the multimedia information. With the method for determining a plane, the method for displaying AR display information and the corresponding devices provided by the present invention, virtual display information can be added into a 3D plane, the reality of the display effect of enhanced display can be improved, and the user experience can be improved.