Wearable Simulation Display With Pixel-Masked Real-Virtual View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for displaying environments in simulations, such as those using head-mounted displays, limit user interaction possibilities and can cause visual artifacts due to superimposed images, restricting the field of view and spatial perception.
Innovation Solution
A method and device using a display unit, such as 3D glasses, that combines real and virtual environments by creating an image mask based on interaction environment recordings, determining positional distance information, and superimposing images pixel-by-pixel to ensure a realistic and artifact-free display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If partially transparent display media are used to overlay virtual images on the environment, then virtual objects can be displayed, but visible artifacts appear in the user's field of vision and the field of view is restricted
Solution Approach 1:
The patent extracts the virtual image generation and display function from the transparent display medium, replacing it with a camera-based capture system. The display unit shows captured real environment images without superimposing virtual images through transparent media, thereby eliminating visible artifacts while maintaining virtual object display capability through alternative means.
Solution Approach 2:
The patent uses camera units to capture and display copies of the real environment images on the display unit. This copying approach replaces the need for transparent display media that overlay virtual images, providing a clear view of the environment without artifacts while still enabling virtual object integration through image processing.
2Adaptability or versatility
If head-mounted displays with screens are used to display the environment, then virtual images can be overlaid, but the user's field of view is restricted and spatial perception is disturbed
Solution Approach 1:
Instead of overlaying virtual images on top of the real environment view (the conventional approach), the patent inverts the approach by capturing the real environment with cameras and displaying it on the display unit, then integrating virtual objects into this captured image. This inversion eliminates the need for transparent overlays that restrict the field of view.
3Ease of operation
If virtual control elements are displayed for the user to operate virtually, then interaction with the simulation is enabled, but interaction possibilities remain limited
Solution Approach 1:
The patent introduces camera units as intermediaries between the user and the virtual environment. These cameras capture the user's hand movements and the physical control elements in the real environment, enabling natural interaction with virtual objects through physical gestures. This intermediary system expands interaction possibilities beyond predefined virtual control elements.
Data Source
Figure 1
Figure 2~4
Figure 5
AI summary
The invention relates to a method for representing an environment by means of a display unit (2) arranged on a person (1) and visible for the person (1) as a display image (C) within the scope of a simulation; wherein the simulation is carried out in an interaction environment (U), wherein a number of actuatable interaction elements (3a, ..., 3d) are arranged in the interaction environment (U) and wherein the simulation can be influenced by the interaction elements (3a, ..., 3d); wherein at least one interaction environment image capture (A), depicting at least parts of the interaction environment (U), is created by means of at least one first image capturing unit (5; 5a, 5b) arranged on the person (1) or relative to the person (1); wherein the position of the person (1) is determined in the interaction environment (U) and, based on the position of the person (1), an environment image (B) is provided from a virtual and/or real environment; wherein an image mask is provided; wherein individual positions on the at least one interaction environment image capture (A), the environment image (B), the image mask and the display image (C) are associated with one another; wherein interaction environment distance information is determined between the person (1) and the interaction environment (U), and the interaction environment distance information is assigned to the individual image regions of the at least one interaction environment image capture (A) in terms of position, and/or at least one image parameter value of the individual image regions of the at least one interaction environment image capture (A) is determined in terms of position; wherein, by checking whether the area of interest of the interaction environment (U) depicted in the respective image region of the at least one interaction environment image capture (A) exceeds a predefined interaction environment distance threshold value, and/or whether the respective image region of the at least one interaction environment image capture (A) exceeds at least one image parameter threshold value specified for the interaction environment, the image mask is created in such a way that the depiction of the individual interaction elements (3a, ..., 3d) contained in the at least one interaction environment image capture (A) is represented in the display image (C); wherein the at least one interaction environment image capture (A) and the provided environment image (B) are superimposed pixel-by-pixel using the image mask; and wherein the image that is superimposed in this way is displayed as the display image (C) on the display unit (2).