Gaze Tracking Calibration via Saliency Map and User Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Gaze tracking systems in electronic devices, such as head-mounted displays, face accuracy degradation due to head movement and environmental changes, leading to difficulties in controlling device operations using gaze information.
Innovation Solution
An electronic device with a gaze tracking system that generates a saliency map to identify visual interest items and combines this with user input to perform real-time calibration, ensuring accurate mapping of eye position information to on-screen gaze location.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gaze tracking systems are used in head-mounted displays, then user input control capability is improved, but gaze detection accuracy degrades due to head movement and environmental changes
Solution Approach 1:
The system continuously monitors gaze detection accuracy by comparing detected gaze points with actual user interaction points (such as cursor positions or touch locations). When discrepancies are detected, the system automatically initiates recalibration procedures, creating a closed-loop feedback mechanism that maintains accuracy despite head movements and environmental changes.
Solution Approach 2:
The calibration parameters are made dynamic rather than static. The system continuously updates calibration data based on real-time performance metrics, allowing the gaze tracking system to adapt to changing conditions such as head position changes, different viewing environments, and component drift over time.
2Measurement precision
If real-time calibration operations are performed continuously, then gaze tracking accuracy is maintained, but device complexity increases
Solution Approach 1:
Instead of performing full calibration procedures continuously, the system performs partial calibration operations only when necessary. It monitors performance metrics and triggers recalibration only when accuracy degradation exceeds threshold levels, reducing unnecessary computational overhead while maintaining adequate accuracy.
Solution Approach 2:
The system performs automatic self-calibration using the user's natural interaction behavior as calibration data. By leveraging existing user actions (such as clicking on displayed elements or touching the screen) as reference points, the system eliminates the need for separate manual calibration sessions, reducing complexity while maintaining accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Maintains accurate gaze tracking by continuously updating calibration data, enhancing the device's ability to determine the user's on-screen point of gaze despite environmental changes and component drift, thereby improving operational control.
Implementation Method 1
a light source that emits beams of light that reflect off of a user's eyes
Data Source
AI summary
An electronic device may have a display and a gaze tracking system. Control circuitry in the electronic device can produce a saliency map in which items of visual interest are identified among content that has been displayed on a display in the electronic device. The saliency map may identify items such as selectable buttons, text, and other items of visual interest. User input such as mouse clicks, voice commands, and other commands may be used by the control circuitry in identifying when a user is gazing on particular items within the displayed content. Information on a user's actual on-screen point of gaze that is inferred using the saliency map information and user input can be compared to measured eye position information from the gaze tracking system to calibrate the gaze tracking system during normal operation of the electronic device.