Foveated Rendering for Display Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current graphical processing systems waste resources by rendering high detail across the entire display, as human visual acuity decreases significantly outside the focused area, leading to inefficient use of processing power and memory.
Innovation Solution
Employing an eye tracking device to determine the user's gaze point and dynamically adjust the display resolution and rendering quality based on the distance from the gaze point, using a virtual pixilation scheme to allocate resources effectively, rendering high resolution only in the focused area and decreasing resolution and quality in peripheral areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If high resolution rendering is applied across the entire display, then image quality is improved, but processing power consumption increases
Solution Approach 1:
The patent applies different rendering qualities to different regions of the display based on the user's gaze point. The foveated region (where the user is looking) is rendered at high resolution, while peripheral regions are rendered at progressively lower resolutions. This resolves the contradiction by providing high image quality only where the user can actually perceive it, rather than uniformly across the entire display, thereby reducing processing power consumption while maintaining perceived image quality.
2Measurement precision
If high detail graphical items are rendered across the entire display, then visual fidelity is improved, but graphics processing device resources are wasted
Solution Approach 1:
The system renders high detail graphical items only in the foveated region surrounding the user's gaze point, while using lower detail representations in peripheral regions. This eliminates the waste of graphics processing resources on rendering high detail in areas where the user's visual acuity cannot perceive the difference, while maintaining visual fidelity where it matters most to the user.
Solution Approach 2:
The rendering quality distribution is dynamically adjusted based on the user's gaze point position. As the user moves their eyes to different parts of the display, the high-detail foveated region moves accordingly, and the rendering quality of different regions is continuously adapted. This dynamic adjustment ensures that processing resources are always allocated to the region where the user is currently focusing, optimizing the balance between visual fidelity and resource utilization.
3Measurement precision
If uniform high resolution is maintained across the display, then image quality is preserved, but processing efficiency decreases
Solution Approach 1:
Instead of maintaining uniform high resolution across the entire display, the patent implements variable resolution rendering where only the foveated region (typically 10-20 degrees of visual angle around the gaze point) is rendered at high resolution. Peripheral regions use progressively lower resolutions. This approach preserves perceived image quality while dramatically improving processing efficiency by reducing the total number of pixels that require high-detail rendering.
Solution Approach 2:
The system applies high-resolution rendering only partially - specifically to the portion of the display where the user's visual acuity is sufficient to perceive the quality (the foveated region). This partial application of high-resolution rendering is sufficient to maintain perceived image quality while avoiding the excessive processing requirements of uniform high-resolution rendering across the entire display, thereby improving processing efficiency.
Data Source
AI summary
According to the invention, a method for changing a display based on a gaze point of a user on the display is disclosed. The method may include determining a gaze point of a user on a display. The method may also include causing a first area of the display to be displayed in a first manner, the first area including the gaze point and a surrounding area. The method may further include causing a second area of the display to be displayed in a second manner, the second area being different than the first area, and the second manner being different than the first manner.