Attenuation Graphic Replica for AR Image Artifact Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Direct-view augmented reality systems face challenges in presenting occlusive synthetic graphics without causing distracting image artifacts, such as halos, due to the interaction of light from real-world objects and multiple display layers, which affects the visibility and focus of both the graphics and the environment.

Innovation Solution

The implementation of a dual-layer display system with an emissive display layer and an attenuation display layer, where the attenuation layer is positioned between the emissive layer and the real-world scene, uses intensity maps and mattes to control transparency and block unwanted light, and compensation modules adjust the attenuation graphic to reduce unintended light and dark regions, thereby minimizing image artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple display layers are used to present occlusive synthetic graphics, then the visibility and focus of graphics are improved, but distracting image artifacts such as halos are generated

Engineering Contradiction:
Improvevisibility and focus of synthetic graphicsVSAvoidimage artifacts such as halos
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The display system is divided into multiple independent display layers, each responsible for specific functions. The first display layer presents the synthetic graphic while the second display layer presents the real-world scene. This segmentation allows independent control of each layer to minimize artifacts while maintaining graphic visibility and focus.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the display layers are assigned different transparency and optical properties. The display layers are configured to be transparent in regions where real-world visibility is needed and opaque or focus-enhancing in regions where synthetic graphics are displayed, creating local quality variations that resolve the contradiction between graphic visibility and artifact reduction.

Inventive Principle:
Principle #3Local quality

2Ease of operation

If display layers are made transparent to allow direct viewing of real-world scene, then natural viewing experience is improved, but synthetic graphics become less visible

Engineering Contradiction:
Improvenatural viewing experienceVSAvoidvisibility of synthetic graphics
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The display layers dynamically adjust their transparency and optical properties based on the content being displayed. When synthetic graphics are present, the display layers become less transparent or increase their focusing effect. When no graphics are displayed, the layers return to a transparent state for natural viewing. This dynamic adjustment resolves the contradiction between natural viewing and graphic visibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The optical parameters of the display layers (transparency, focus, opacity) are changed based on operational requirements. The system adjusts these parameters to optimize either natural viewing or synthetic graphic visibility as needed, resolving the contradiction through parameter variation rather than fixed properties.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If attenuation layer blocks unwanted light to reduce image artifacts, then visibility of synthetic graphics is improved, but unintended dark regions are created

Engineering Contradiction:
Improvevisibility of synthetic graphicsVSAvoidunintended dark regions
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The attenuation layer applies selective light blocking only in specific regions where synthetic graphics are displayed, rather than uniformly across the entire display. This local attenuation reduces image artifacts and improves graphic visibility while leaving other regions transparent to prevent unintended dark regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system creates a replica or representation of the synthetic graphic content and uses it to control the attenuation pattern. The attenuation layer is configured to match the spatial distribution of synthetic graphics, blocking light only where needed to reduce artifacts while preserving brightness elsewhere.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the visibility of occlusive synthetic graphics by reducing unwanted light and dark regions, maintaining a clear and focused view of both the graphics and the real-world environment, while reducing the complexity and computational expense of existing multi-layer systems.

Implementation Method 1

an attenuation display layer positioned between the emissive display layer and the real-world scene

Methodology Applied
Scientific EffectLight blocking/attenuation: Absorption (EM radiation)

Implementation Method 2

an emissive display layer to present an emissive graphic

Methodology Applied
Scientific EffectEmissive display: Light Emitting Diode

Data Source

PatentUS11514657B2Replica graphic causing reduced visibility of an image artifact in a direct-view of a real-world scene
Publication Date: 2022.11.29 ADOBE INC
  • US11514657B2 patent drawing
  • US11514657B2 patent drawing
  • US11514657B2 patent drawing

AI summary

Image compensation for an occluding direct-view augmented reality system is described. In one or more embodiments, an augmented reality apparatus includes an emissive display layer for presenting emissive graphics to an eye of a user and an attenuation display layer for presenting attenuation graphics between the emissive display layer and a real-world scene to block light of the real-world scene from the emissive graphics. A light region compensation module dilates an attenuation graphic based on an attribute of an eye of a viewer, such as size of a pupil, to produce an expanded attenuation graphic that blocks additional light to compensate for an unintended light region. A dark region compensation module camouflages an unintended dark region with a replica graphic in the emissive display layer that reproduces an appearance of the real-world scene in the unintended dark region. A camera provides the light data used to generate the replica graphic.