Virtual Auxiliary Object with Spatially Variable Transparency for Depth Perception

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Even trained specialists face difficulty in perceiving the depth of superimposed virtual objects in augmented reality, leading to misleading spatial information during medical interventions, especially when anatomical structures are hidden or poorly identifiable.

Innovation Solution

A method for virtual enhancement of camera images using a spatially variable transparency virtual auxiliary object, which separates parts of the object from the rest, aiding in improved depth perception by simulating anatomical structures like embryonic layers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If virtual objects are superimposed on camera images to provide spatial information about anatomical structures, then information completeness is improved, but depth perception accuracy deteriorates

Engineering Contradiction:
Improvespatial information about hidden anatomical structuresVSAvoiddepth perception accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent applies local quality by varying the transparency of the auxiliary object at different spatial locations. The transparency is not uniform but changes locally to provide depth cues - areas with different transparency values correspond to different depths, allowing the viewer to perceive three-dimensional structure from the two-dimensional display. This resolves the contradiction by maintaining complete spatial information while enabling accurate depth perception through localized transparency variations.

Inventive Principle:
Principle #3Local quality

2Ease of operation

If uniform transparency is used for virtual auxiliary objects, then visual clarity is improved, but depth information is lost

Engineering Contradiction:
Improvevisual clarity of virtual objectsVSAvoiddepth information of anatomical structures
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent implements local quality by making the transparency of the auxiliary object spatially variable rather than uniform. Different regions of the auxiliary object have different transparency values that correspond to their respective depths. This allows the virtual object to maintain visual clarity while simultaneously encoding depth information, as the transparency variations provide visual cues about the three-dimensional structure without compromising the overall visibility of the auxiliary object.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12159355B2Virtual enhancement of a camera image
Publication Date: 2024.12.03 SIEMENS HEALTHINEERS AG
  • US12159355B2 patent drawing
  • US12159355B2 patent drawing
  • US12159355B2 patent drawing

AI summary

According to a method for virtual enhancement of a camera image, a camera image depicting an object is generated. A geometric description of a virtual auxiliary object as a surface in space and a pose of the auxiliary object with respect to the object are specified, wherein the auxiliary object separates part of the object from the rest of the object. An enhanced image is generated based on a superimposition of the camera image with a representation of the auxiliary object depending on the geometric description and the pose of the auxiliary object by a computing unit and displayed on a display device. The enhanced image is generated and displayed in such a way that the auxiliary object has a spatially variable transparency.