AR/VR Display Control Using Embedded Image Data and Depth Planes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual and augmented reality systems struggle to provide a comfortable and natural-feeling presentation of virtual or augmented reality elements amidst real-world imagery due to the complexity of the human visual perception system.
Innovation Solution
A display system that includes a display controller to adjust virtual or augmented reality imagery by shifting and scaling based on embedded control information, utilizing multiple depth planes and head pose information without re-rendering, and incorporating sensors for ambient lighting adjustments and power management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual or augmented reality imagery is presented without adjustments for human visual perception, then the system complexity is reduced, but the comfort and natural feeling of the presentation deteriorates
Solution Approach 1:
The patent applies preliminary action by pre-calculating and embedding control information (shift and scale values) into the rendered imagery data before display. This allows the display controller to make real-time adjustments based on head pose without performing complex re-rendering operations, thus improving comfort while managing system complexity.
Solution Approach 2:
The patent introduces an intermediary mechanism by embedding control information within the imagery data itself. This control information acts as a mediator between the rendered content and the display controller, enabling automatic adjustments for visual perception without requiring complex real-time processing or re-rendering.
2Ease of operation
If control information is embedded in rendered imagery data, then the ease of operation is improved, but the loss of information increases
Solution Approach 1:
The patent extracts specific control parameters (shift and scale values) from the rendering process and embeds them as separate control information in the imagery data. This extraction allows the display controller to apply adjustments without altering the core image data, thus maintaining image quality while improving ease of operation.
3Productivity
If the display controller adjusts imagery without re-rendering, then the productivity is improved, but the manufacturing precision deteriorates
Solution Approach 1:
The patent applies parameter changes by modifying display parameters (position and scale) through embedded control information rather than re-rendering the entire image. This allows rapid adjustment of visual elements to match head pose while maintaining sufficient image accuracy for the application.
Data Source
AI summary
A display system, such as a virtual reality or augmented reality display system, can control a display to present image data including a plurality of color components, on a plurality of depth planes supported by the display. The presentation of the image data through the display can be controlled based on control information that is embedded in the image data, for example to activate or inactivate a color component and/or a depth plane. In some examples, light sources and/or spatial light modulators that relay illumination from the light sources may receive signals from a display controller to adjust a power setting to the light source or spatial light modulator based on control information embedded in an image data frame.