Head-Mounted Display Visibility Correction for AR Image Contrast

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing see-through head-mounted display devices struggle to make augmented reality images visible when their colors are similar to the external world, leading to blending issues, and there is a need for improved user convenience, detection accuracy, downsizing, cost reduction, and easier manufacturing.

Innovation Solution

A head-mounted display device with a superimposition image display control section, imaging section, partial image determination section, and visibility correction section that adjusts the visibility of augmented reality images based on the color information of the external world, using techniques such as complementary color changes or altering to white or black for improved visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the augmented reality image uses a color similar to the external world, then the image blends into the background, but the user cannot see the image clearly

Engineering Contradiction:
Improveimage visibilityVSAvoidcolor blending
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent applies color changes by detecting the background color in the captured image and dynamically adjusting the display color of the augmented reality image. The visibility correction section changes the color of the superimposed image to ensure it contrasts sufficiently with the detected background color, preventing blending and improving user visibility.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent implements parameter changes by modifying the color parameters (hue, saturation, brightness) of the augmented reality image based on the detected background color. The system calculates color differences and adjusts display parameters to maintain optimal contrast between the AR image and the external world background.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If the display color of the augmented reality image is changed to improve visibility, then the image becomes more visible, but the original color information is altered

Engineering Contradiction:
Improveimage visibilityVSAvoidoriginal color information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent applies dynamics by making the display color adjustment dynamic rather than static. The system continuously detects the background color and adjusts the AR image color in real-time based on the current viewing conditions. This dynamic adaptation allows the system to preserve original color information when not needed while enhancing visibility when required.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by using the detected background color information to adjust the display color of the AR image. The system creates a feedback loop where the output (AR image display) is continuously optimized based on the input (background color detection), ensuring optimal visibility while minimizing information loss.

Inventive Principle:
Principle #23Feedback

3Reliability

If the system detects and corrects color visibility for all augmented reality images, then visibility is improved, but the processing time and computational resources increase

Engineering Contradiction:
Improveimage visibilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies local quality by focusing color detection and correction only on the specific region where the augmented reality image is to be displayed. Instead of processing the entire image, the system targets the local area of interest, reducing computational overhead while maintaining visibility correction effectiveness.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by applying color visibility correction selectively rather than universally. The system determines whether correction is needed based on the specific background color and AR image characteristics, applying correction only when necessary to improve visibility, thus reducing unnecessary processing time.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9870048B2Head-mounted display device, method of controlling the same, and computer program
Publication Date: 2018.01.16 SEIKO EPSON CORP
  • US9870048B2 patent drawing
  • US9870048B2 patent drawing
  • US9870048B2 patent drawing

AI summary

In a head-mounted display device equipped with a display section, through which an external world can visually be recognized, the head-mounted display device includes a superimposition image display control section adapted to make the display section display a predetermined image so as to be superimposed on the external world to visually be recognized in a see-through manner, an imaging section adapted to capture an image of at least a predetermined range out of the external world visually recognized in a see-through manner, a partial image determination section adapted to determine a partial image of a predetermined range, which corresponds in position to the predetermined image, out of the captured image obtained by the imaging section, and a visibility correction section adapted to correct visibility of the predetermined image displayed by the superimposition image display control section in accordance with color information related to the partial image determined.