Display Panel Driving Circuit Gaze-Based Partial Image Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality display systems experience delays in rendering images that reflect a user's gaze, leading to dizziness due to latency between gaze changes and image updates, particularly with existing display systems operating at 60 Hz, where a delay of at least 16.6 microseconds occurs.
Innovation Solution
A display device and system that includes a display panel and a driving circuit capable of receiving higher-resolution image data and user gaze data, selecting partial image data to reflect the user's gaze, and driving the display panel to display images based on this data, thereby reducing the need for graphic processing unit rendering and minimizing latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the display system uses graphic processing unit to render image data reflecting user gaze, then the image can be updated to reflect gaze changes, but a delay of at least 16.6 microseconds occurs due to rendering time
Solution Approach 1:
The patent divides the full-resolution image into multiple lower-resolution regions. Instead of rendering the entire high-resolution image through the graphic processing unit, the system segments the image and only processes the region corresponding to the user's gaze area at high resolution, while other regions can be handled at lower resolution or pre-computed, thereby reducing overall rendering time and delay.
Solution Approach 2:
The patent applies partial action by only processing and rendering the portion of the image that corresponds to the user's gaze area at full resolution. The display panel driving circuit receives gaze data and selectively processes only the relevant image region, avoiding the need to render the entire high-resolution image, thus reducing rendering delay while maintaining sufficient image quality for the user's viewing area.
2Productivity
If the display operates at 60 Hz to provide smooth image updates, then the display refresh rate is sufficient, but a delay of at least 16.6 microseconds occurs between gaze change and image update
Solution Approach 1:
The patent implements preliminary action by having the display panel driving circuit prepare and store gaze data and corresponding image regions in advance. When a gaze change is detected, the system can quickly retrieve pre-processed image data and display it without waiting for complete real-time rendering, thereby reducing the perceived latency while maintaining the 60 Hz refresh rate schedule.
Solution Approach 2:
The patent introduces dynamics by making the image processing approach adaptive based on gaze movement. When the user's gaze is detected to be in a particular region, the system dynamically adjusts which image regions are processed at high resolution versus low resolution. This dynamic adaptation allows the system to maintain smooth 60 Hz operation while reducing latency for the currently viewed area by optimizing processing resources in real-time.
3Loss of time
If the display panel driving circuit processes and displays partial image data based on gaze, then latency is reduced, but the system complexity increases due to additional processing requirements
Solution Approach 1:
The patent introduces an intermediary approach by having the display panel driving circuit act as a mediator between the graphic processing unit and the display panel. The driving circuit receives full-resolution image data from the GPU, processes it by selecting and adjusting only the necessary partial regions based on gaze data, and then sends the optimized data to the display panel. This intermediary function reduces latency by avoiding complete re-rendering while distributing the processing complexity across multiple components rather than concentrating it in one place.
Data Source
AI summary
A display device includes: a display panel configured to display a first image having a first resolution; and a display panel driving circuit configured to drive the display panel, wherein the display panel driving circuit is configured to receive image data corresponding to a second image having a second resolution that is higher than the first resolution, to receive gaze data indicating a user's gaze, to select partial image data which reflects the user's gaze from the image data based on the gaze data, and to drive the display panel to display the first image based on the partial image data.