Head-Mounted Display Saliency Control for Mental Obstacle Avoidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing cross reality technologies fail to quickly avoid visual recognition of mental obstacles in a real space, such as objects causing negative emotions, without user intervention.

Innovation Solution

A head-mounted display system that includes an image sensor, display, and processing units to capture and process user information, reducing the saliency of real objects in the user's line of sight based on user state, using techniques like virtual object superimposition and diminished reality to minimize mental obstacles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual specification of unnecessary objects is required, then processing precision is improved, but productivity deteriorates

Engineering Contradiction:
Improveobject identification accuracyVSAvoidresponse speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system automatically detects and processes mental obstacles without requiring user specification. The head-mounted display captures images, identifies objects that may cause negative emotions, and applies image processing autonomously, allowing the system to serve itself rather than relying on manual user input.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses user information (emotional state, attention level) as feedback to automatically adjust image processing. By monitoring whether the user is paying attention to an object and their emotional response, the system dynamically decides when and how to reduce saliency, creating a closed-loop control system that responds to user needs in real-time.

Inventive Principle:
Principle #23Feedback

2Object-affected harmful factors

If real objects are replaced with virtual objects, then harmful factors are reduced, but device complexity increases

Engineering Contradiction:
Improvepsychological burdenVSAvoidimage processing complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system applies image processing selectively only to specific regions containing mental obstacles, rather than processing the entire image. By identifying the precise location and boundaries of problematic objects and applying saliency reduction only to those regions, the system minimizes processing complexity while effectively reducing psychological burden.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes image parameters (brightness, contrast, saturation) of specific objects to reduce their saliency rather than completely replacing them with virtual objects. This approach reduces harmful factors by making problematic objects less visually prominent while keeping the processing relatively simple and maintaining scene authenticity.

Inventive Principle:
Principle #35Parameter changes

3Object-affected harmful factors

If image processing is applied to reduce saliency, then psychological burden is reduced, but loss of information increases

Engineering Contradiction:
Improvenegative emotionVSAvoidscene completeness
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The system applies partial image processing that reduces saliency of problematic objects without completely removing or obscuring them. By using subtle adjustments to brightness, contrast, or saturation rather than complete occlusion, the system reduces negative emotions while preserving enough visual information to maintain scene completeness and spatial awareness.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12614360B2Head mounted display, control method of head mounted display, and non-transitory computer readable medium
Publication Date: 2026.04.28 CANON KK
  • US12614360B2 patent drawing
  • US12614360B2 patent drawing
  • US12614360B2 patent drawing

AI summary

A head mounted display according to the present invention includes: an image sensor configured to capture an image of a real space; a display configured to display the image of the real space captured by the image sensor so as to be visually recognized by a user; and at least one memory and at least one processor which function as: an acquiring unit configured to acquire user information on a state of the user; and a control unit configured to control display on the display so as to reduce saliency of a first object, which is a real object to which a line-of-sight of the user is directed, or of a real object other than the first object, on a basis of the user information.