HMD Gaze Tracking Rate Control via Infrared Eye Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current head-mounted displays (HMDs) lack effective mechanisms to dynamically adjust virtual images based on the user's gaze direction, leading to suboptimal interaction and information presentation, especially in dynamic environments where precise control over image tracking is necessary.

Innovation Solution

The integration of an infrared light source and camera within the HMD system to determine the gaze axis and reference axis, allowing for real-time adjustment of virtual image positioning and tracking rate, ensuring that images are displayed in a context-sensitive and user-friendly manner.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual images are displayed in a fixed position within the field of view, then the device complexity is reduced, but the adaptability to user gaze direction deteriorates

Engineering Contradiction:
Improveadaptability to user gaze directionVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system uses an infrared camera to detect the user's eye position and gaze direction, providing feedback about where the user is looking. This feedback is then used by the processor to dynamically adjust the position of virtual images within the field of view, ensuring they remain aligned with the user's gaze direction and maintaining high adaptability without requiring complex mechanical adjustment mechanisms

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Instead of using complex mechanical systems to physically move or adjust the display elements based on gaze direction, the patent substitutes this with an optical detection system (infrared camera) and computational processing. The infrared camera detects eye position, and the processor computationally determines the adjusted field of view position, replacing what would otherwise require complex mechanical adjustment mechanisms

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If the tracking rate of virtual images is increased to follow gaze movements, then the ease of operation is improved, but the stability of image positioning deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidstability of image positioning
Core Design Contradiction:
Ease of operationVSStability of the object's composition

Solution Approach 1:

The system implements dynamic tracking rate adjustment where the speed at which virtual images follow gaze movements is not fixed but adapts based on the magnitude of gaze deviation. When the user's gaze moves significantly from the current field of view position, a higher tracking rate is applied to quickly realign the virtual images. When gaze is already near the center, the tracking rate reduces to maintain stability, creating a dynamic balance between responsiveness and stability

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If eye-tracking components are added to determine gaze axis, then the adaptability to user gaze is improved, but the device complexity increases

Engineering Contradiction:
Improveadaptability to user gazeVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces an infrared light source as an intermediary to illuminate the user's eye, enabling the infrared camera to detect eye position and gaze direction. This intermediary lighting component works together with the camera to provide gaze information without requiring direct complex interaction between the camera and the eye, simplifying the overall system architecture while maintaining adaptability

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The infrared camera serves multiple functions: it detects eye position for gaze determination, provides feedback for field of view adjustment, and enables the system to adapt to different user viewing conditions. This multi-functionality reduces the need for separate dedicated components for each function, thereby limiting the increase in device complexity while achieving high adaptability

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables seamless interaction by aligning virtual images with the user's gaze, enhancing readability and usability, particularly in environments where precise control over image movement is crucial, such as during movement or when focusing on specific elements.

Implementation Method 1

The infrared light source is configured to illuminate the viewing location with infrared light such that infrared light is reflected from the viewing location as reflected infrared light

Methodology Applied
Scientific EffectInfrared illumination and reflection: Reflection

Implementation Method 2

the camera is configured to image the viewing location by collecting the reflected infrared light

Methodology Applied
Scientific EffectInfrared light detection: Photoelectric Effect

Data Source

PatentUS8970452B2Imaging method
Publication Date: 2015.03.03 GOOGLE LLC
  • US8970452B2 patent drawing
  • US8970452B2 patent drawing
  • US8970452B2 patent drawing

AI summary

A wearable computing device or a head-mounted display (HMD) may be configured to track the gaze axis of an eye of the wearer. In particular, the device may be configured to observe movement of a wearer's pupil and, based on the movement, determine inputs to a user interface. For example, using eye gaze detection, the HMD may change a tracking rate of a displayed virtual image based on where the user is looking. Gazing at the center of the HMD field of view may, for instance, allow for fine movements of the virtual display. Gazing near an edge of the HMD field of view may provide coarser movements.