Eyeball Tracking via Under-Display Infrared Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current eye tracking technologies for VR/AR devices, which use cameras outside the screen, suffer from inaccurate tracking angles and delayed responses due to the camera's deviation from the optical axis, leading to poor user experience and potential dizziness or vomiting.
Innovation Solution
A method and device for eyeball tracking that incorporates an infrared sensing layer under the display unit, emitting and detecting infrared light to capture eyeball activity information, allowing for precise and timely recognition of user intentions and executing corresponding operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a camera outside the screen is used for eye tracking, then the device structure is simplified, but the tracking accuracy and response time deteriorate due to deviation from the optical axis
Solution Approach 1:
The sensing unit is merged with the display unit by being integrated under the eyeball activity recognition region of the display screen. This combination allows the sensing unit to be positioned at the optical axis where the eyeball image is formed, eliminating the need for separate external camera placement while achieving accurate tracking.
Solution Approach 2:
The sensing unit is positioned in a different spatial dimension (under the display screen) rather than outside the screen edge. This dimensional change allows the sensing unit to capture eyeball images through the display panel at the optical axis position, resolving the contradiction between structural simplicity and tracking accuracy.
2Device complexity
If a camera outside the screen is used for eye tracking, then the device structure is simplified, but the response time increases due to delayed detection
Solution Approach 1:
The sensing unit is integrated with the display unit, allowing simultaneous detection of eyeball activity as the user views the screen. This merging eliminates the time delay associated with external camera detection while maintaining structural simplicity.
Solution Approach 2:
The sensing unit is positioned to capture eyeball images in advance as they are formed on the display screen during normal viewing. This preliminary detection enables real-time tracking without waiting for external camera capture, reducing response time.
3Measurement precision
If the sensing unit is positioned under the eyeball activity recognition region, then tracking accuracy improves, but the device thickness increases
Solution Approach 1:
The sensing unit utilizes the thin film structure of the display panel to position itself under the eyeball activity recognition region. This approach allows accurate tracking while minimizing the increase in device thickness, as the sensing unit integrates with the existing thin display structure.
4Ease of manufacture
If the camera is placed at the edge of the device, then manufacturing is easier, but the optical axis alignment becomes difficult
Solution Approach 1:
The sensing unit is merged with the display unit, which already has a defined optical axis for image display. This merging eliminates the need for separate optical axis alignment procedures, as the sensing unit automatically aligns with the display's optical axis, simplifying both manufacturing and alignment.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables quick and accurate control of devices using eye movements, improving user experience and reducing device thickness, making it suitable for flexible wearable devices.
Implementation Method 1
the infrared sensing layer is configured to emit infrared light when receiving the light source trigger signal
Implementation Method 2
receive an infrared light signal reflected by an user's eyeball to capture the eyeball activity information
Data Source
AI summary
The present invention provides a method and a device for eyeball tracking operation. By providing a sensing unit under the eyeball recognition region of the display unit, compared with the structure in which the camera is disposed at the edge position independently of the display screen, the sensing unit of the present invention can emit infrared light or detect infrared light signals reflected by the human eye, so as to timely capture the user's eyeball activity. The information is compared with the presetting eyeball activity information, and the operation instruction corresponding to the eyeball activity information is executed, so that the user can quickly control the device through the eyeball activity, thereby effectively improving the user experience.