Transparent Near-Eye Display with Surface Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality and augmented reality near-eye displays face challenges in being lightweight, low-cost, and having a wide virtual image field of view while maintaining transparency and practical use without causing vergence-accommodation mismatch.
Innovation Solution
The development of an apparatus with a partially transparent screen, a surface detector, an object identifier, and a graphic generator that detects and identifies objects in the environment, allowing for the display of virtual content in a spatial relationship with real objects, enabling interaction and the definition of virtual spaces for multiple users.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If optical systems are used to generate color images at various depths for displaying MR scenarios, then the realism and immersion of virtual content is improved, but the device weight and complexity increase
Solution Approach 1:
The patent extracts the optical rendering function from complex head-worn display devices and implements it through a transparent screen combined with computer vision and graphic generation. This separates the display function from the computational functions, reducing device weight while maintaining virtual content realism through software-based object identification and spatial relationship rendering.
2Ease of manufacture
If transparent screens are used for near-eye displays, then the transparency and field of view are improved, but the manufacturing precision and alignment accuracy deteriorate
Solution Approach 1:
The patent employs computer vision to detect surfaces and objects in the environment, using this feedback to dynamically adjust and align virtual content with real-world objects. The graphic generator creates virtual objects that maintain accurate spatial relationships with detected real objects, compensating for manufacturing tolerances through active alignment rather than passive precision.
Solution Approach 2:
The system changes the parameters of virtual object placement based on detected environmental parameters. By identifying surfaces and objects through computer vision and adjusting virtual content parameters accordingly, the system achieves accurate alignment without requiring precision in the physical display device manufacturing.
3Reliability
If virtual objects are displayed with accurate spatial relationships, then the immersion and realism are improved, but the processing time and computational complexity increase
Solution Approach 1:
The patent performs preliminary object identification and surface detection before rendering virtual content. By using computer vision to pre-identify objects and their spatial relationships, the system prepares the environmental model in advance, which then allows for faster rendering of virtual objects with accurate spatial positioning without real-time computational delays.
Data Source
AI summary
An apparatus for providing a virtual or augmented reality experience, includes: a screen, wherein the screen is at least partially transparent for allowing a user of the apparatus to view an object in an environment surrounding the user; a surface detector configured to detect a surface of the object; an object identifier configured to obtain an orientation and/or an elevation of the surface of the object, and to make an identification for the object based on the orientation and/or the elevation of the surface of the object; and a graphic generator configured to generate an identifier indicating the identification for the object for display by the screen, wherein the screen is configured to display the identifier.