Eye Tracking Illuminator Control for Glasses Reflections
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In eye tracking systems, especially in virtual reality applications, reflections from glasses worn under VR glasses can reduce the accuracy of determining eye direction and gaze direction due to interference from optic arrangements, making it difficult or impossible to identify pupils and glints reliably.
Innovation Solution
A method and system where illuminators are arranged at fixed positions relative to the user's eyes, and an image sensor detects both reflected light from the eyes and optic arrangements. The system identifies blobs caused by optic reflections, switches off the corresponding illuminator if predefined criteria are met, and adjusts camera parameters to maintain image brightness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple illuminators are used to illuminate the user's eyes for eye tracking, then the image brightness and tracking accuracy are improved, but reflections from optic arrangements (glasses) create harmful blobs that reduce measurement precision
Solution Approach 1:
The system performs preliminary identification of blobs caused by optic reflections in the captured image. By detecting these harmful reflections before they interfere with pupil and glint identification, the system can proactively switch off the corresponding illuminators to prevent measurement errors, thereby maintaining gaze direction determination accuracy.
Solution Approach 2:
The system converts the harmful effect of optic reflections into a useful diagnostic signal. The reflections create distinct blobs in the image that serve as indicators of which illuminators are causing interference. By identifying and analyzing these blobs, the system can automatically adjust illuminator configuration to eliminate the harmful effects while maintaining effective eye tracking.
2Reliability
If all illuminators remain active continuously, then eye tracking reliability is maintained, but energy consumption increases
Solution Approach 1:
Instead of continuous operation, the system implements periodic evaluation of illuminator performance by analyzing captured images for harmful reflections. The illuminators are switched off only when and where needed based on periodic detection of optic reflections, maintaining reliability while reducing unnecessary energy consumption during periods when reflections are not present.
Solution Approach 2:
The system autonomously monitors its own operation by analyzing images for blobs indicating harmful reflections. When such reflections are detected, the system automatically switches off the problematic illuminators without external intervention, thereby self-regulating energy consumption while maintaining eye tracking reliability through adaptive illuminator management.
3Object-generated harmful factors
If illuminators are switched off to eliminate reflections, then harmful blobs are reduced, but image brightness may decrease affecting detection quality
Solution Approach 1:
Instead of switching off all illuminators uniformly, the system applies local quality control by selectively switching off only the specific illuminators that are causing harmful reflections. Each illuminator is evaluated independently based on the presence of associated blobs in the image, allowing the system to eliminate reflections from problematic areas while maintaining adequate illumination and image brightness from other illuminators.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances the accuracy of eye direction and gaze direction determination by reducing the impact of optic reflections, allowing for more reliable eye tracking even when glasses are worn, and conserves energy by only activating illuminators when necessary.
Implementation Method 1
an image of the eye of the user is received from an image sensor. The image is the result of the image sensor detecting light from the plurality of illuminators reflected from the eye of the user
Data Source
AI summary
A method for controlling illuminators in an eye tracking system and a corresponding system are disclosed. The system includes a plurality of illuminators arranged such that each illuminator of the illuminators is located at a respective fixed position in relation to an eye of a user when using the system. The method comprises illuminating the eye of the user by means of the plurality of illuminators, and receiving an image of the eye of the user from an image sensor, the image resulting from the image sensor detecting light from the plurality of illuminators reflected from the eye of the user and reflected from an optic arrangement located between the plurality of illuminators and the eye of the user. The method further comprises determining a pupil position of a representation in the image of a pupil of the eye, and identifying one or more blobs in the image, wherein a blob is a representation in the image of a reflection from the optic arrangement of light from an illuminator of the plurality of illuminators. On a condition that there is at least one blob of the one or more blobs for which one or more predefined criteria are met, the method comprises identifying an illuminator of the plurality of illuminators associated with the at least one blob of the one or more blobs, and switching off the identified illuminator of the plurality illuminators.