Image Stream Display with Predictive Foveated Rendering

The system performs preliminary gaze prediction to determine where the user will look at the future display time before actually rendering the image. By predicting the future point of regard and pre-determining the rendering area in advance, the system prepares the high-resolution rendering zone beforehand, ensuring that when the image is displayed, the rendered area matches the user's actual gaze position despite the rendering time required. This preliminary action resolves the contradiction by anticipating the gaze position before rendering begins.

The system applies local quality by rendering only the specific area around the predicted point of regard with high resolution, while rendering peripheral areas with lower resolution. This is achieved by determining a first area around the predicted point of regard and a second area outside this first area, then applying different rendering quality parameters to each region. This approach maintains perceptual image quality in the foveal region where the user is actually looking, while significantly reducing overall rendering time and computational resource consumption by lowering quality in peripheral regions that the user is less likely to notice.

The system extracts and processes only the relevant portion of the scene by identifying and isolating the area around the predicted point of regard as the primary rendering target. By separating the scene into a first area (around the point of regard) that requires high-quality rendering and a second area (peripheral regions) that can be rendered with lower quality or skipped entirely, the system eliminates wasteful computational resource expenditure on areas that will not be viewed, while still maintaining reliability for the critical viewed region.