Gaze Tracking with Rotating Screen Using Single Monocular Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional gaze tracking systems fail to accurately track eye gaze in three dimensions when the angle of the screen changes, as they require re-mapping of the screen onto the camera frame and are not capable of handling screen rotation, leading to inaccuracies in distance and point mapping.
Innovation Solution
A gaze tracking system that includes a gaze vector calculating circuit, a coordinate change computing circuit, a plane calculating circuit, and an intersection calculating circuit to dynamically adjust for screen angle changes, calculating a parametric equation of the eye gaze vector and the current screen plane to maintain accurate tracking without additional calibration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional gaze tracking techniques are used with a stationary screen assumption, then the system can perform basic gaze estimation, but the accuracy deteriorates when the screen angle changes
Solution Approach 1:
The system dynamically calculates the screen plane equation based on real-time screen angle information. The plane calculating circuit computes a current plane equation that adapts to changing screen angles, allowing the gaze tracking system to maintain accuracy regardless of whether the screen is stationary or rotated.
Solution Approach 2:
The system changes the parameter representation of the screen plane from a fixed reference frame to a dynamic parameter-based approach. By representing the screen plane as a function of angle parameters and camera position, the system can accurately track gaze across different screen orientations without requiring re-mapping or additional calibration.
2Measurement precision
If screen calibration techniques involving mirrors are used, then the system can establish initial screen plane mapping, but the device complexity increases and additional sensors are required
Solution Approach 1:
The invention extracts and eliminates the need for mirrors and complex calibration procedures from the gaze tracking system. By using a simplified approach where the screen plane is defined by angle parameters and camera position, the system achieves accurate screen plane mapping without requiring additional optical components or calibration targets.
Solution Approach 2:
The system performs self-calibration by automatically calculating the screen plane equation based on inherent system parameters (camera position, screen angle). This eliminates the need for external calibration devices and allows the system to adapt to different screen configurations autonomously without user intervention or additional hardware.
3Adaptability or versatility
If the screen angle changes, then the mapping of distance from eye to screen points must be re-mapped, but conventional algorithms cannot handle this dynamic re-mapping
Solution Approach 1:
The system employs dynamic calculations that continuously update the screen plane equation based on current screen angle and camera position. This dynamic approach allows the system to handle screen rotation and angle changes in real-time, maintaining accurate distance mapping without requiring algorithms to be re-written or re-calibrated for each configuration.
Data Source
AI summary
A gaze tracking system, method, and computer product for tracking an eye gaze on a screen of a device including a single monocular camera, the system including measuring a rotation of a hinged plane of a display screen with respect to the eye gaze, combining the rotation with a three-dimensional movement of the camera, a position of the camera being constant with respect to the display screen, and estimating a point of gaze localization on the display screen using the single monocular camera as the input, in absence of a sensor, and without performing a display screen calibration.