Gaze Tracking Filtering for HMD Reading Control Mode

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of head-mounted displays (HMDs) face challenges when reading or concentrating on fine details due to the three-dimensional environment, which can cause eye unfocusing and difficulty in manipulating small objects.

Innovation Solution

A gaze tracking system that filters gaze tracking information to detect reading patterns, triggering a 'reading control mode' that initiates commands based on the user's gaze dwell time on specific words or objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If three-dimensional environment is used in HMDs, then immersive experience is improved, but reading and concentration on fine details becomes difficult

Engineering Contradiction:
Improveimmersive experienceVSAvoidreading and concentration
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system dynamically switches between different operational modes (standard 3D mode and reading mode) based on detected gaze patterns. When reading behavior is detected through gaze tracking analysis, the system transitions to a specialized reading mode that optimizes the display for text and fine details, thereby adapting the three-dimensional environment to support both immersion and reading tasks effectively

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If gaze tracking is continuously monitored, then reading pattern detection accuracy is improved, but computational load increases

Engineering Contradiction:
Improvereading pattern detection accuracyVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies partial monitoring by continuously tracking gaze position but only performing full pattern analysis when specific conditions are met (e.g., sustained fixation duration, specific gaze trajectories). This selective analysis approach maintains high detection accuracy for reading patterns while reducing unnecessary computational processing during normal navigation or non-reading activities

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary filtering of gaze data by detecting basic fixation events and saccade patterns before committing to full reading pattern recognition. This preliminary analysis stage processes only essential features of gaze behavior, reducing the computational burden of subsequent pattern classification while maintaining accurate reading detection

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12346497B1Filtering of gaze tracking information to trigger reading control mode
Publication Date: 2025.07.01 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12346497B1 patent drawing
  • US12346497B1 patent drawing
  • US12346497B1 patent drawing

AI summary

A method, and system for controlling a computer program are disclosed. One or more images are presented on a display device in response to execution of the computer program on a computing device. Gaze tracking information corresponding to a location of a user's gaze with respect to the one or more images presented on the display device is collected over time. The gaze tracking information over time is analyzed to detect a pattern of the user's gaze characteristic of reading and upon detecting the pattern of the user's gaze characteristics of reading, a reading control mode is activated. In the reading control mode location and duration of the user's gaze triggers commands affecting execution of the computer program.