VR/AR Display Control Using Embedded Depth Plane Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual and augmented reality technologies struggle to provide a comfortable and natural-feeling presentation of virtual image elements amidst real-world imagery due to the complexity of the human visual perception system.
Innovation Solution
A display system that includes a display controller to shift and scale virtual or augmented reality objects based on embedded control information, utilizing multiple depth planes and head pose information without re-rendering the imagery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional VR/AR display systems present computer-generated imagery without depth plane control, then the system complexity is reduced, but the comfort and natural-feeling of the visual experience deteriorates
Solution Approach 1:
The display system segments the imagery into multiple depth planes, with each plane representing objects at different distances from the viewer. This segmentation allows independent control of accommodation cues for each depth plane while maintaining a unified visual experience, resolving the contradiction between visual comfort and system complexity.
Solution Approach 2:
The system adds a depth plane dimension to traditional 2D display by embedding depth plane indicator information that specifies which depth plane each pixel belongs to. This dimensional enhancement enables the display to provide accommodation cues matching vergence cues, improving visual comfort without excessive complexity increase.
2Manufacturing precision
If the display system re-renders imagery to adjust virtual object positions, then the precision of depth and position alignment is improved, but the processing time and productivity deteriorate
Solution Approach 1:
The graphics processor embeds depth plane indicator information and control information into the imagery data during the initial rendering process. This preliminary action includes specifying which depth plane each pixel belongs to and what shifts to apply, eliminating the need for time-consuming re-rendering operations while maintaining precise depth alignment.
Solution Approach 2:
The system extracts depth plane indicator information and control information from the rendered imagery data, separating the depth control metadata from the visual content. This extraction allows the display controller to apply depth plane shifts and scaling without re-rendering the actual imagery, preserving both precision and productivity.
3Reliability
If the display system applies multiple depth planes with accommodation cues, then the realism of three-dimensional environment is improved, but the device complexity increases
Solution Approach 1:
The display controller acts as an intermediary between the graphics processor and the display, interpreting depth plane indicator information and control information embedded in the imagery data. This intermediary role enables sophisticated multi-depth-plane rendering with accurate accommodation cues while keeping the overall system complexity manageable through standardized processing.
Data Source
AI summary
A display system, such as a virtual reality or augmented reality display system, can control a display to present image data including a plurality of color components, on a plurality of depth planes supported by the display. The presentation of the image data through the display can be controlled based on control information that is embedded in the image data, for example to indicate an active or inactive color component and/or depth plane. In some examples, light sources and/or spatial light modulators that relay illumination from the light sources may receive signals from a display controller to adjust a power setting to the light source or spatial light modulator based on control information embedded in an image data frame.