Eye Tracking Saccade Prediction for Foveated Graphics Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current graphical processing systems waste resources by rendering high-quality images across the entire screen, even though users typically focus on only a portion, leading to inefficiency in resource allocation.
Innovation Solution
Implementing an eye tracking system to predict gaze points and adjust image quality dynamically, focusing on areas where the user's attention is directed, while reducing quality in peripheral regions to conserve resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-quality graphical items are displayed across the entire screen, then visual quality and information completeness are improved, but graphics processing device resources and energy consumption increase
Solution Approach 1:
The patent applies local quality by rendering graphical items at different quality levels across different regions of the display. High-quality rendering is applied only to the region corresponding to the user's gaze (foveated region), while lower-quality rendering is applied to peripheral regions. This resolves the contradiction by concentrating graphics processing resources where visual quality matters most (at the user's focal point) while reducing resources in peripheral areas where the user is not focused.
Solution Approach 2:
The patent segments the display into multiple regions based on user gaze position. The display is divided into a central foveated region (high quality) and peripheral regions (lower quality). This segmentation allows the system to allocate graphics processing resources efficiently by treating different spatial regions differently, thus resolving the contradiction between overall visual quality and processing resource consumption.
2Quantity of substance
If graphical items are displayed across the entire screen, then information completeness is improved, but user attention efficiency decreases due to lack of focus on peripheral content
Solution Approach 1:
The patent applies local quality by providing high-quality graphical rendering only in the region where the user is focused (foveated region), while using lower-quality rendering in peripheral regions. This ensures that the user receives maximum information quality at their focal point while still receiving basic information from peripheral regions, thus balancing information completeness with user attention efficiency.
3Manufacturing precision
If full-screen high-quality rendering is used, then visual fidelity is improved, but processing power and memory requirements increase
Solution Approach 1:
The patent implements local quality by applying high visual fidelity rendering only to the foveated region corresponding to user gaze, while using reduced-quality rendering for peripheral regions. This resolves the contradiction by concentrating processing power and memory resources on the region where visual fidelity is most important (at the user's focal point) rather than uniformly across the entire display.
Solution Approach 2:
The patent segments the rendering task into high-fidelity rendering of the foveated region and low-fidelity rendering of peripheral regions. This segmentation allows the system to meet visual fidelity requirements at the critical foveated area while reducing overall processing power and memory consumption, thus resolving the contradiction between visual fidelity and processing requirements.
Data Source
AI summary
According to the invention, techniques for refining a ballistic prediction are described. In an example, an eye tracking system may record images over time of content presented on a display. Saccade data may be received and used as a trigger to retrieve particular ones of the recoded images. The eye tracking system may compare the images to identify a change in the content. The location of this change may correspond to a sub-area of the display. The output of the ballistic prediction may include a landing point that represents an anticipated gaze point. This landing point may be adjusted such that a gaze point is now predicted to fall within the sub-area when the change is significant.