3D VR Display Occlusion Handling for Clear AR Object Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D AR technologies restrict the accurate recognition of 3D AR objects when they overlap with real objects in the line of sight, often causing the AR objects to be displayed semi-transparently or not displayed at all, leading to difficulty in recognizing the AR objects and experiencing mixed reality effectively.
Innovation Solution
A 3D virtual reality display device equipped with a camera, distance sensor, and processor that compares distances between the observer and real and virtual objects, performing overlapping elimination display processing to ensure the 3D virtual reality object is displayed while the real object image is not, thereby enhancing recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If the 3D AR object is displayed semi-transparently or not displayed near the real object to avoid overlap, then the visual comfort is improved, but the recognition accuracy of the 3D AR object deteriorates
Solution Approach 1:
The patent extracts and removes the real object image from the composite image in the overlapping region, allowing the 3D AR object to be displayed without obstruction. The processor identifies the overlapping area between the real object and 3D AR object, and selectively excludes the real object image only in that specific region, thereby eliminating the harmful overlap effect while maintaining full visibility of the 3D AR object.
Solution Approach 2:
The patent applies different display strategies to different regions of the composite image. In the overlapping region, only the 3D AR object is displayed while the real object is excluded. In non-overlapping regions, both the real object image and 3D AR object are displayed normally. This localized approach ensures that the 3D AR object is clearly visible where it matters most while preserving the完整性 of the real scene elsewhere.
2Measurement precision
If the real object image is completely removed when overlapping occurs, then the recognition accuracy of the 3D AR object is improved, but the loss of information about the real space deteriorates
Solution Approach 1:
The patent applies selective removal of the real object image only in the specific overlapping region where the 3D AR object is displayed. The rest of the real space image, including areas not overlapping with the 3D AR object, is preserved and displayed normally. This ensures that information about the real space is retained wherever possible, while only the minimal necessary portion is removed to ensure clear visibility of the 3D AR object.
Data Source
AI summary
A 3D-VR (virtual reality) display device comprises: a camera that takes an image of a real space and outputs a real object image of a real object included in the real space; a distance sensor that measures a distance from an observer of the real space to the real object; a display; and a processor that displays a 3D-VR object on the display, and the processor is configured to: when the real object is present on a line-of-sight of the observer who is observing the 3D-VR object, compare a distance from the observer to a position at which the 3D-VR object is being displayed with a distance from the observer to the real object; and when the real object is overlapping the 3D-VR object, perform overlapping elimination display processing of displaying the 3D-VR object on the line-of-sight while not displaying the real object image on the line-of-sight.