Gaze-Adaptive Display Driving for VR/AR Power Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Display apparatuses used for VR and AR applications face challenges in achieving high display performance with reduced power consumption, particularly when high driving frequencies and reduced sizes are required, and the insertion of black images between frames can lead to unnaturalness or recognition of black images, complicating the balance between driving frequency and power consumption.
Innovation Solution
The electronic device incorporates a display apparatus divided into sub-display portions, with gaze detection and arithmetic processing to allocate sections for different driving frequencies and luminance adjustments, using transistors with silicon and oxide semiconductors, and a luminance conversion circuit to manage image data luminance, allowing high driving frequency near the gaze point and reduced frequency elsewhere.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If display is performed at a high driving frequency to achieve clear moving images, then display quality is improved, but power consumption increases
Solution Approach 1:
The display apparatus divides the display area into multiple regions (first region with high frame rate, second region with low frame rate) based on user gaze detection. This segmentation allows different parts of the display to operate at different frequencies, maintaining high display quality in the foveal region while reducing power consumption in peripheral regions.
Solution Approach 2:
The patent applies local quality by providing high frame rate display (e.g., 120Hz) only in the first region corresponding to the user's gaze point, while using lower frame rate (e.g., 30Hz) in the second region. This ensures that the critical viewing area maintains high display quality while peripheral areas consume less power.
2Reliability
If black image data is inserted between frames to reduce motion blur, then moving image clarity is improved, but unnaturalness occurs when driving frequency is reduced
Solution Approach 1:
The patent segments the display regions to apply black image insertion selectively. The first region (high frame rate) uses black image insertion between frames to reduce motion blur, while the second region (low frame rate) does not use black image insertion to avoid unnatural appearance. This regional differentiation resolves the contradiction between motion blur reduction and display naturalness.
Solution Approach 2:
Different display processing methods are applied to different regions: black image insertion is applied locally to the first region where high frame rate is maintained, while the second region uses standard frame display without black insertion. This local differentiation ensures that motion blur reduction is achieved where needed without causing unnaturalness in low frame rate regions.
3Area of stationary object
If display area is reduced to decrease device size, then device compactness is improved, but drawing processing capacity requirements increase
Solution Approach 1:
The patent segments the display area into regions with different frame rates. By reducing the frame rate in the second region (peripheral area), the overall drawing processing capacity requirement is reduced, allowing for smaller device size while maintaining acceptable display quality in the critical first region.
Solution Approach 2:
The patent applies high frame rate (high processing capacity) only to the first region corresponding to user gaze, while using low frame rate (low processing capacity) in the second region. This local differentiation reduces the overall drawing processing capacity requirement, enabling device size reduction while maintaining high display quality where the user actually looks.
Data Source
AI summary
An electronic device with a novel structure is provided. The electronic device includes a display apparatus, a gaze detection portion, and an arithmetic portion. The display apparatus includes a display portion divided into a plurality of sub-display portions and a functional circuit including a luminance conversion circuit. The gaze detection portion has a function of detecting the user's gaze. The arithmetic portion has a function of allocating the plurality of sub-display portions to a first section or a second section with the use of the detection result of the gaze detection portion. The functional circuit has a function of performing display on the sub-display portion included in the first section with a first driving frequency and performing display on the sub-display portion included in the second section with a second driving frequency lower than the first driving frequency. The luminance conversion circuit has a function of converting image data displayed on the second section to image data with reduced luminance to be displayed in the sub-display portion.