Foveated Rendering via Eye Tracking for Graphics Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current graphical processing systems waste resources by maintaining high image quality across the entire display, as users typically focus on only a portion of the screen, leading to inefficiencies in processing power and resource allocation.
Innovation Solution
Incorporating an eye tracking device to determine the user's gaze point, allowing the graphics processing device to dynamically adjust image quality, with higher quality in the focused area and lower quality outside the focus area, thereby optimizing resource allocation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high image quality is maintained across the entire display, then the user experiences good visual quality in all areas, but the graphics processing device consumes excessive processing power and resources
Solution Approach 1:
The patent implements foveated rendering that applies different rendering qualities to different regions of the display based on user gaze location. High-resolution rendering is applied only to the foveal region where the user is looking, while lower-resolution rendering is applied to peripheral regions. This local differentiation resolves the contradiction by maintaining high image quality only where visually relevant, thereby reducing overall processing power consumption.
Solution Approach 2:
The display is segmented into multiple regions (foveal region and peripheral regions) based on user gaze position. The graphics processing device then processes each region differently according to its importance to the user. This segmentation allows the system to allocate processing resources efficiently, rendering high quality only in the foveal region while using reduced quality in peripheral regions, thus resolving the contradiction between image quality and processing power consumption.
2Manufacturing precision
If high image quality is maintained across the entire display, then the user perceives detailed graphics in all areas, but the system wastes resources producing graphical items that cannot be fully appreciated due to limited visual acuity outside the focused area
Solution Approach 1:
The system applies local quality differentiation by rendering graphical items at high resolution only in the foveal region corresponding to user gaze, while using lower resolution for peripheral regions. This matches human visual acuity characteristics and eliminates resource waste on rendering detailed graphics in areas where the user lacks the visual capacity to appreciate them, directly resolving the contradiction between graphical item quality and resource waste.
Solution Approach 2:
The system uses eye tracking feedback to continuously monitor user gaze position and dynamically adjusts rendering quality accordingly. This feedback mechanism ensures that high-quality rendering is always applied to the current foveal region while peripheral regions receive reduced quality rendering, preventing resource waste on unperceived graphical items and resolving the contradiction between quality and resource efficiency.
3Manufacturing precision
If the graphics processing device renders all graphical items at full resolution, then the display provides consistent quality across the screen, but the processing capacity is insufficient for complex 3D graphical items
Solution Approach 1:
The system differentiates rendering quality by region, applying high resolution only to the foveal region where users focus their attention. This local quality approach increases the graphics processing capacity available for complex 3D graphical items in the foveal region while using computational resources more efficiently in peripheral regions, thereby resolving the contradiction between display quality consistency and graphics processing capacity.
Solution Approach 2:
The rendering quality is dynamically adjusted based on real-time eye tracking data. The system transitions between different rendering quality levels depending on the user's gaze position, allowing the graphics processing device to allocate capacity dynamically to where it is most needed. This dynamic adaptation resolves the contradiction by providing high quality where required while maintaining overall processing capacity for complex 3D graphics.
Data Source
AI summary
An eye tracking device determines a user's gaze point on a display device and a setting for a foveated region associated with a fixation position, based on a first location of the fixation position. The eye tracking device defines at least one of a size, shape, or positioning of the foveated region relative to the fixation position. The eye tracking device determines a second location of the fixation position associated with a change of user gaze and changes the foveated region setting. At least one of the shape or size of the foveated region changes based on the eye tracking device determining that a distance difference between the first and second locations is larger than a threshold. At least one of the size or the shape of the foveated region is continuously adjusted based on the fixation position being in smooth pursuit between the first location and the second location.