Gaze Tracking Confidence Mapping for HMD Pupil Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gaze tracking systems, particularly in head-mountable display units (HMDs), face challenges in accurately and efficiently determining gaze direction due to limitations in camera proximity and processing methods, leading to inefficiencies in resource usage and user interaction.

Innovation Solution

The system employs gaze tracking methods that utilize inwards-facing cameras positioned close to the user's eyes, combined with confidence value determination based on pupil position, to enhance accuracy and precision, allowing for improved foveal rendering and user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If inwards-facing cameras are positioned close to the user's eyes in HMDs, then gaze tracking accuracy and precision are improved, but device complexity and manufacturing difficulty increase

Engineering Contradiction:
Improvegaze tracking accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The camera is integrated within the HMD structure, nesting the gaze tracking component inside the existing head-mounted display framework. This allows the camera to be positioned close to the user's eyes without significantly increasing overall device complexity, as the camera utilizes the existing structural space and mounting mechanisms of the HMD.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The system uses the user's own facial features (eye reflections, pupil position) as the tracking target, eliminating the need for external markers or additional sensors. The inwards-facing camera leverages the natural optical properties of the eye to determine gaze direction, reducing the need for complex auxiliary components.

Inventive Principle:
Principle #25Self-service

2Reliability

If confidence value determination is implemented based on pupil position, then reliability of gaze detection is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvereliability of gaze detectionVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system pre-establishes the relationship between pupil position and confidence value through calibration procedures performed before actual gaze tracking. By pre-computing and storing the mapping between eye position metrics and confidence levels, the system avoids complex real-time calculations during active tracking, thus maintaining high reliability while minimizing processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces complex mechanical or hardware-based confidence verification mechanisms with computational algorithms that analyze pupil position data. Instead of using additional sensors or physical verification systems, the reliability determination is achieved through software-based processing of existing camera data, reducing overall processing time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If foveal rendering is used to improve processing efficiency, then resource usage is optimized, but image quality in peripheral regions deteriorates

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The rendering system applies different quality levels to different regions of the display based on the user's gaze direction. The foveal region (center of gaze) receives high-quality rendering with full detail, while peripheral regions receive lower-quality rendering with reduced detail. This local differentiation maintains perceived image quality where the user is looking while optimizing overall processing efficiency.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of rendering the entire display at full quality, the system applies full-quality rendering only to the necessary portion of the display (the foveal region). This partial action approach renders only what is needed for the user's current visual attention, significantly improving processing efficiency while maintaining acceptable overall image quality.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20250355492A1Gaze tracking system and method
Publication Date: 2025.11.20 SONY INTERACTIVE ENTERTAINMENT LLC
  • US20250355492A1 patent drawing
  • US20250355492A1 patent drawing
  • US20250355492A1 patent drawing

AI summary

A gaze tracking system comprising a pupil detection unit operable to detect the location of a pupil in one or more images captured of one or both a user's eyes, a confidence value determination unit operable to determine a confidence value in dependence upon the identified pupil position, the confidence value indicating an expected reliability of the detection of the pupil location, and a processing unit operable to generate, in dependence upon the determined confidence value, one or more outputs to cause the user to modify their pupil location to a location with a higher determined confidence value.