AR Color Compensation for Light-Transmissive Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality (AR) systems face challenges in maintaining the natural color of virtual objects when superimposed on backgrounds with multiple colors, as the virtual image colors mix with the background, deviating from the intended presentation.

Innovation Solution

An AR system with a light-transmissive display and image sensor performs color compensation by capturing the actual scene, determining the background overlapping region, and adjusting the virtual object's color brightness to match the background's pass-through color brightness, ensuring the virtual object is displayed consistently across different backgrounds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a light-transmissive display is used to allow users to view both real environment and virtual images, then the transparency and light transmission are improved, but the virtual image color mixes with the background color causing color deviation

Engineering Contradiction:
Improvelight transmissionVSAvoidcolor accuracy
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The system performs preliminary color compensation by capturing the actual background scene, analyzing the background color in the overlapping region, and pre-adjusting the virtual object color before display. This preliminary action prevents color mixing issues before they occur, allowing the light-transmissive display to maintain both transparency and color accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically changes the color parameters (RGB values) of the virtual object based on the detected background color. By adjusting the brightness and color channels of the virtual object pixels, the system compensates for the background mixing effect, ensuring the virtual object maintains its intended color appearance despite the transparent display特性.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If the virtual object color is adjusted to compensate for background mixing, then the color accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improvecolor accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system applies color compensation only to the background overlapping region where the virtual object will be displayed. By identifying the specific overlapping area and applying localized color adjustment only to that region, the system reduces unnecessary processing while maintaining color accuracy where it matters most.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses feedback from the captured background image to dynamically adjust the virtual object color. The background color information serves as feedback that drives the compensation algorithm, allowing the system to adapt to different background conditions automatically without requiring complex manual configuration.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11087443B2Augmented reality system and color compensation method thereof
Publication Date: 2021.08.10 WISTRON CORP
  • US11087443B2 patent drawing
  • US11087443B2 patent drawing
  • US11087443B2 patent drawing

AI summary

An augmented reality system and a color compensation method thereof are proposed. The method is applicable to an augmented reality system having a display and an image sensor and include the following steps. A preset object position of a virtual object with respect to an actual scene is set. An image of the actual scene is captured by using the image sensor, and the image of the actual scene is mapped to a field of view of the display to generate a background image with respect to the field of view of the display. Color compensation is performed on the virtual object according to a background overlapping region corresponding to the preset object position in the background image to generate an adjusted virtual object, and the adjusted virtual object is displayed on the display according to the preset object position.