Display Internal Light Sources for Gaze Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gaze interaction technologies rely on external light sources and cameras, which can be inefficient and prone to noise interference, limiting their accuracy and convenience in various applications.
Innovation Solution
A method and system using internal light sources within a display to estimate a user's gaze position, involving image processing to extract glint positions, calculate cornea and pupil centers, and determine the visual axis, while removing noise from external light sources to activate or deactivate a gaze adjustment function based on toggle areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If external light sources and cameras are used for gaze estimation, then gaze interaction technology can be implemented, but noise interference increases and measurement precision decreases
Solution Approach 1:
The patent extracts the light source function from external devices and integrates it into the display itself. The display pixels serve as both the visual output and the gaze estimation light sources, eliminating the need for separate external light sources and cameras. This integration removes the noise interference from external light sources while maintaining gaze estimation capability.
Solution Approach 2:
The display pixels perform multiple functions: they display visual content to the user and simultaneously serve as light sources for gaze estimation. This multi-functionality eliminates the need for separate dedicated light sources and cameras, reducing system complexity and noise interference while maintaining measurement precision.
2Ease of operation
If external light sources and cameras are used for gaze estimation, then gaze interaction can be achieved, but device complexity increases
Solution Approach 1:
The patent merges the display function with the gaze estimation light source function. By using display pixels as both the visual output and the light sources for gaze tracking, the system eliminates the need for separate external light sources and cameras, significantly reducing device complexity while maintaining ease of operation.
Solution Approach 2:
The display system serves itself by using its own pixels as the light sources for gaze estimation. This self-service approach eliminates the need for separate dedicated hardware components, reducing overall device complexity while maintaining the convenience of gaze interaction.
3Reliability
If multiple external light sources and cameras are used, then gaze estimation is possible, but power consumption increases
Solution Approach 1:
The display pixels serve dual purposes: displaying visual content and providing light sources for gaze estimation. This multi-functionality eliminates the need for separate dedicated light sources and cameras, reducing overall power consumption while maintaining reliable gaze detection accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances gaze interaction accuracy and convenience by utilizing internal light sources, reducing noise interference and power consumption, allowing precise control of devices through gaze alone without additional hardware.
Implementation Method 1
obtaining an image including eyes of a user, using a camera
Implementation Method 2
obtaining an image including the eyes of the user, based on at least two internal light sources included in the display
Data Source
AI summary
A method and apparatus for a user interface using a gaze interaction is disclosed. The method for the user interface using the gaze interaction may include obtaining an image including eyes of a user, estimating a gaze position of the user, using the image including the eyes of the user, and determining whether to activate a gaze adjustment function for controlling a device by a gaze of the user, based on the gaze position of the user with respect to at least one toggle area on a display.