Wearable Display Image Masking for Artifact-Free Simulation View

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for displaying environments in simulations, such as those using head-mounted displays, restrict the user's field of view and can result in artifacts due to partial transparency, while also limiting interaction options and restricting virtual object placement to predetermined positions.

Innovation Solution

A method utilizing a set of 3D glasses as a display unit, which creates a display image by superimposing interaction environment recordings with environment images using an image mask, allowing for an unrestricted field of view and realistic interaction by associating individual positions on the recordings with the display image, and adjusting image parameters such as sharpness and brightness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If partially transparent display media are used to overlay virtual representation with environment, then virtual objects can be displayed, but visible artifacts occur and field of view is restricted

Engineering Contradiction:
Improvevirtual object display capabilityVSAvoidvisible artifacts
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent uses image recording units to capture real environment images and creates virtual copies of interaction elements (hands, objects) that are superimposed onto the recorded images. This copying approach allows virtual elements to be integrated into the real environment view without using transparent displays, thereby avoiding visible artifacts while maintaining full field of view.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If head-mounted displays with virtual screens are used, then simulation environment can be displayed, but field of view is restricted and artifacts occur

Engineering Contradiction:
Improvesimulation display capabilityVSAvoidfield of view
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent replaces the mechanical transparent display system with an image processing system. Instead of using physical transparent screens that block part of the view, the system captures real environment images with recording units and superimposes virtual elements through image processing, thereby eliminating the field of view restriction while maintaining simulation display capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of manufacture

If predetermined positions are used for virtual objects, then display simplicity is maintained, but interaction realism is limited

Engineering Contradiction:
Improvedisplay implementation simplicityVSAvoidinteraction realism
Core Design Contradiction:
Ease of manufactureVSEase of operation

Solution Approach 1:

The patent implements dynamic positioning of virtual interaction elements based on the detected position of the user and their hands. Instead of fixed predetermined positions, the virtual elements move and adjust their location in response to user actions, thereby enhancing interaction realism while maintaining relatively simple display implementation through image processing.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12229329B2Method for representing an environment by means of a display unit arranged on a person and visible for the person
Publication Date: 2025.02.18 NEKONATA XR TECH GMBH XR TECH FOR VISION ZERO
  • US12229329B2 patent drawing
  • US12229329B2 patent drawing
  • US12229329B2 patent drawing

AI summary

A method represents an environment via a display unit arranged on a person and visible for the person as a display image within the scope of a simulation. The simulation is carried out in an interaction environment, wherein a number of actuatable interaction elements are arranged in the interaction environment. An interaction environment image capture, depicting the interaction environment, is created by use of a first image capturing unit arranged on the person or relative to the person. A position of the person is determined in the interaction environment and based on the position of the person an environment image is provided. An image mask is provided which depicts the individual interaction elements contained in the interaction environment image capture and is represented in the display image. The interaction environment image capture and the environment image are superimposed using the image mask and then displayed on the display unit.