Electronic Device Gaze Correlation for Mixed Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted displays (HMDs) of the optical see-through type often suffer from 'double view' issues, where virtual objects are seen separately by each eye due to misalignment with the user's line of sight, despite calibration efforts, as the parallax of virtual objects does not account for individual eye correlations and personal differences in gaze.

Innovation Solution

An electronic device with a processor and memory that acquires and correlates gaze information from both eyes to adjust the display positions of virtual objects based on the correlation between the right and left eye's lines of sight, accounting for personal differences in eye alignment and distance to the object, thereby preventing double view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If calibration for detecting the line of sight of one eye is performed, then the line of sight detection accuracy for a single eye is improved, but double view still occurs because the correlation between right and left eye gazes is not considered

Engineering Contradiction:
Improveline of sight detection accuracyVSAvoidvirtual object alignment
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent combines line of sight detection from both right and left eyes into a unified correlation model. By merging the gaze data from both eyes and analyzing their correlation, the system achieves more reliable virtual object alignment than single-eye calibration alone, eliminating double view while maintaining detection precision.

Inventive Principle:
Principle #5Merging (Combining)

2Device complexity

If a fixed parallax is used for depicting virtual objects, then the rendering process is simplified, but double view occurs because individual differences in eye correlation are not accounted for

Engineering Contradiction:
Improverendering process complexityVSAvoidvirtual object alignment
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent transitions from a fixed, static parallax value to a dynamic parallax adjustment system. By continuously measuring the correlation between right and left eye gazes, the system dynamically adjusts the parallax for each user, maintaining simple rendering processes while achieving reliable virtual object alignment that adapts to individual eye characteristics.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If the virtual object is displayed with a parallax that does not depend on the user, then the system is easier to operate, but double view occurs due to personal differences in eye alignment

Engineering Contradiction:
Improvesystem operation simplicityVSAvoidvirtual object alignment
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements a self-service calibration system where each user's unique eye correlation characteristics are automatically measured and stored. The system serves itself by adapting to individual users without requiring manual adjustment, maintaining ease of operation while achieving reliable virtual object alignment through personalized parallax settings derived from each user's specific eye gaze correlation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12153733B2Electronic device
Publication Date: 2024.11.26 CANON KK
  • US12153733B2 patent drawing
  • US12153733B2 patent drawing
  • US12153733B2 patent drawing

AI summary

An electronic device according to the present invention includes at least one memory and at least one processor which function as: a gaze acquisition unit configured to acquire right gaze information related to a gaze of a right eye of a user that wears a display apparatus of an optical see-through type on a head and left gaze information related to a gaze of a left eye of the user; and a correlation acquisition unit configured to acquire, as information on personal differences, correlation information related to correlation between the gaze of the right eye and the gaze of the left eye on a basis of the right gaze information and the left gaze information.