Gaze Tracking Information Filtering for HMD Reading Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) face challenges in reading or concentrating on fine details due to three-dimensional environments, making tasks like manipulating small objects or reading text difficult, and split vision can cause eye unfocusing.
Innovation Solution
A gaze tracking system that monitors gaze information to trigger a 'reading control mode' by recognizing patterns of eye movement characteristic of reading, such as dwell time and gaze direction, to initiate commands like magnification, text-to-speech, or document scrolling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If three-dimensional environments are used in HMDs, then immersion and spatial awareness are improved, but reading and concentration on fine details become difficult
Solution Approach 1:
The system dynamically switches between 3D environment mode and 2D reading mode based on detected gaze patterns. When reading behavior is detected through gaze tracking analysis, the system transitions to a 2D optimized display mode that enhances text readability and fine detail visibility, allowing users to maintain immersion benefits while easily accessing reading functionality
Solution Approach 2:
Gaze tracking technology serves as an intermediary between the user's natural reading behavior and the HMD display system. By monitoring eye movements and detecting characteristic reading patterns, the system automatically identifies when the user intends to read and activates appropriate display optimizations without requiring manual mode switching
2Area of stationary object
If split vision is used in HMDs, then field of view is expanded, but eye focusing becomes unfocused during reading
Solution Approach 1:
The display system segments the visual field into different focal zones. When reading mode is activated through gaze pattern detection, the system creates a focused 2D plane for text content while maintaining the broader 3D environment in the periphery, allowing the eyes to focus on text without losing overall spatial context
3Measurement precision
If gaze tracking is continuously monitored, then reading control mode accuracy is improved, but processing time and computational load increase
Solution Approach 1:
The system continuously pre-processes gaze data in the background, maintaining a rolling window of eye movement information ready for analysis. This allows the system to quickly detect reading patterns and switch to reading control mode without requiring extensive real-time computation when a reading event is detected
Solution Approach 2:
Instead of analyzing all gaze data at full resolution continuously, the system uses partial analysis by detecting key reading pattern characteristics (such as fixation duration and saccade patterns) from sampled gaze points, achieving sufficient accuracy with reduced computational overhead
Data Source
AI summary
Techniques that include presenting one or more images on a display device in response to execution of a computer program on a computing device. The techniques further include collecting gaze tracking information corresponding to a location of a user's gaze with respect to the one or more images presented on the display device. The techniques further include analyzing the gaze tracking information to detect a pattern of the user's gaze. The techniques further include upon detecting the pattern of the user's gaze, activating a first mode in which the user's gaze triggers commands affecting execution of the computer program.