Near-Eye Display Sensor-Pixel Integration for Eye Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current near-eye display technologies lack dynamic controls for real-time adjustments in brightness, contrast, and image size, which are essential for high-performance applications like augmented and virtual reality, especially considering individual user eye characteristics and eye movements.
Innovation Solution
The integration of a microlens array and pixels in the same plane, along with sensors and infrared illumination pixels, allows for real-time pupil and iris image capture and analysis. This setup enables dynamic adjustments to the display based on user eye tracking, using AI to optimize brightness, contrast, and image focus.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sensors and display pixels are placed in different planes, then the display can provide high brightness and resolution, but the system cannot capture accurate pupil and iris images for dynamic control
Solution Approach 1:
The patent combines the sensor array and display pixel array into the same physical plane, creating an integrated structure where both functions coexist without requiring complex optical path alignment between separate planes. This merging enables direct capture of pupil and iris images while maintaining display performance.
2Adaptability or versatility
If dynamic controls are added to adjust brightness, contrast, and image size in real-time, then the display can adapt to individual user characteristics, but the device complexity and processing requirements increase
Solution Approach 1:
The system implements real-time feedback by continuously capturing pupil and iris images through the integrated sensor array, analyzing user eye characteristics, and dynamically adjusting display parameters (brightness, contrast, image size) based on the analyzed feedback. This creates a closed-loop control system that adapts to individual users automatically.
Solution Approach 2:
The display system performs self-adjustment by using its own integrated sensor array to capture user eye characteristics and automatically modifying its display parameters without requiring external control devices or manual intervention, enabling the system to serve itself in the adaptation process.
3Measurement precision
If the focus plane of the sensor is the same as the display pixels, then the system structure is simplified, but the sensor cannot capture clear images of the pupil and iris
Solution Approach 1:
The patent applies different focal properties to different regions of the integrated array: display pixels are optimized for projecting images to the user's retina, while sensor elements are optimized for capturing images of the user's pupil and iris. This local differentiation of optical quality enables both functions to perform optimally despite being in the same plane.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enhances the immersive experience by providing personalized and dynamic display adjustments, reducing motion sickness and improving visual acuity, while also enabling precise diagnostic and therapeutic applications for vision-related issues.
Implementation Method 1
Infrared quantum dots have ability absorb visible light and convert to infrared light (or light of other wavelengths)
Implementation Method 2
display system having a microlens array and pixels in the same plane
Implementation Method 3
the sensor pixels can detect the reflected image of this grid pattern to map the curvature of the eyeball
Data Source
AI summary
A display system may comprise an array of pixels arranged to display an image and one or more imaging sensors. Each imaging sensor may be arranged with at least one pixel of the array. The display system may further comprise at least one communication line to provide an image to the array of pixels and to output the sensed data of the plurality of imaging sensors. The display system may further comprise an array of non-visible light quantum dots. The array non-visible light quantum dot may be arranged with the array of pixels such that each quantum dot converts light from the array of pixels to emissions in a non-visible light wavelength range. The display system may further comprise a one or more sensor pixels sensitive to light in the non-visible light wavelength range.