Gaze-Tracking Display Panel with Peripheral Image Sensing Pixels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Near-eye display devices face challenges in improving form factor and reducing manufacturing costs while maintaining resolution, particularly in wearable devices that utilize separate camera devices for gaze tracking.
Innovation Solution
A display device design that incorporates display pixels in a foveated area and image sensing pixels in a peripheral area, eliminating the need for a separate camera device by integrating gaze tracking functionality within the display panel.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a separate camera device is used for gaze tracking, then gaze tracking functionality is achieved, but device complexity and manufacturing cost increase
Solution Approach 1:
The patent merges the gaze tracking function with the display panel by integrating image sensing pixels directly into the display structure. The display panel simultaneously performs display and eye tracking functions, eliminating the need for separate camera devices and reducing overall system complexity.
Solution Approach 2:
The display panel is designed to serve multiple functions: displaying visual information through display pixels and tracking user gaze through image sensing pixels. This multi-functional design allows a single component to replace what would traditionally require separate dedicated devices.
2Adaptability or versatility
If a separate camera device is used for gaze tracking, then gaze tracking functionality is achieved, but manufacturing cost increases
Solution Approach 1:
The patent merges the gaze tracking function with the display panel by integrating image sensing pixels directly into the display structure. The display panel simultaneously performs display and eye tracking functions, eliminating the need for separate camera devices and reducing overall system complexity.
3Area of moving object
If display size is reduced for wearable devices, then form factor is improved, but maintaining resolution becomes more difficult
Solution Approach 1:
The patent applies different pixel densities to different regions of the display panel. The foveated area (central region) uses high-resolution display pixels to maintain perceived quality, while the peripheral area uses lower-resolution pixels dedicated to gaze tracking. This regional differentiation allows smaller display sizes while maintaining effective resolution where the user's gaze is focused.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This design enhances the form factor and reduces manufacturing costs while maintaining resolution, enabling efficient gaze tracking without additional hardware.
Implementation Method 1
an infrared ray (IR) light source is used to track the user's gaze, and this light may be reflected from the user's eyes and transmitted to the camera
Implementation Method 2
a light emitting pixel that is disposed in the second region and emits light during a second period, which is different from the first period
Data Source
AI summary
A display device according to an embodiment may include: a plurality of first display pixels disposed in a first region of a substrate; a plurality of image sensing pixels that are disposed in a second region positioned at the periphery of the first region of the substrate, and generate pixel signals; and a driving circuit that is disposed on the substrate, generates a plurality of first data signals based on input image data, provides the plurality of first data signals to the plurality of first display pixels, receives the pixel signal from the plurality of image sensing pixels, and generates image data corresponding to the user's gaze based on the pixel signal.