Near-Eye Display Optical Superposition for Immersive UI
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality apparatuses lack an integrated and non-distracting user interface, as physical controls are not immersive, and embedding UI within the content can be inconvenient and distracting.
Innovation Solution
A near-eye display apparatus that overlays an augmented reality image with a user interface onto a virtual reality image using a projective optical element and a transparent optical element, allowing the UI to remain static relative to the viewer's head while the VR image is rendered based on head movement, with the UI accessible without navigating within the VR content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical controls are provided on the virtual reality apparatus, then user interface functionality is achieved, but the controls are not integrated with the user's virtual reality experience and reduce immersion
Solution Approach 1:
A beam splitter is introduced as an intermediary optical element that allows the user interface to be displayed in the real world view while the virtual reality image passes through to the display screen. This mediator enables both the UI and VR content to coexist without physical controls breaking immersion, as the UI appears integrated into the user's field of view rather than as separate physical buttons or overlays within the virtual content
2Device complexity
If the user interface is embedded in the virtual reality content, then the UI is integrated with the experience, but the UI distracts the user from the virtual reality content and makes navigation more difficult
Solution Approach 1:
The optical path is segmented into two separate channels: one for the virtual reality image that passes through the beam splitter to the display screen, and another for the user interface that is reflected by the beam splitter to the user's field of view. This segmentation allows the UI to be separated from the VR content spatially, so users can access controls without being distracted from or confused by the immersive virtual environment
3Device complexity
If UI elements are placed at fixed locations within the virtual reality content, then the UI is integrated into the content, but the user must search for UI elements by turning their head, which distracts the viewer
Solution Approach 1:
The beam splitter acts as an intermediary that projects the user interface into the user's real-world field of view at a fixed, easily accessible location. This allows users to access UI elements without turning their head or searching within the virtual reality content, as the interface appears naturally positioned in their peripheral or central vision depending on the optical design
Solution Approach 2:
The user interface is moved from the virtual reality dimension to the real-world optical dimension through the beam splitter. Instead of placing UI elements within the virtual content space where they require head movement to locate, the interface is projected into the user's actual field of view, creating a separate accessible layer that does not require navigation within the VR environment
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Provides an easily accessible user interface that does not distract from the virtual reality experience, allowing users to focus on VR content while interacting with the UI, which is rendered in a different focal plane to minimize visual distraction.
Implementation Method 1
a projective optical element in front of the display screen, configured to project a first image displayed on the display screen into an eye of a viewer
Implementation Method 2
a transparent optical element positioned in an optical pathway from the display screen to the eye of the viewer and configured to superpose a second image on top of the first image
Implementation Method 3
the projective optical element is configured to bring the first image into focus in a first focal plane
Implementation Method 4
the transparent optical element is configured to bring the second image into focus in a second focal plane which is different from the first focal plane
Data Source
Figure 1A~1B
Figure 2
Figure 3~4
AI summary
The present invention provides an apparatus (1, 2, 3, 4, 5) comprising a display screen (10), a projective optical element (20a, 20b) in front of the display screen (10), which is configured to project a first image displayed on the display screen into an eye (40a, 40b) of a viewer, and a transparent optical element (36a, 36b; 60a, 60b; 160a, 160b) positioned in an optical pathway from the display screen (10) to the eye (40a, 40b) of the viewer, which is configured to superpose a second image on top of the first image. The invention also provides a near-eye display (6) comprising such an apparatus and an optical projection engine, as well as a method of displaying virtual and augmented reality images. The apparatus has the advantage that it allows an augmented reality image to be overlaid on top of a virtual reality image. The augmented reality image may provide the viewer with a user interface, for example.