Foveated Image Rendering via Gaze-Tracking Resolution Layers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current computer graphics techniques render images at equal resolution across the entire display, wasting computational resources since the human visual system can only perceive fine detail within a small central circle, ignoring the user's gaze point and failing to account for aliasing and system latency.
Innovation Solution
A method and system for foveated image rendering that tracks the user's gaze point to generate nested eccentricity layers with varying resolutions, antialiasing these layers to remove artifacts, and smoothly blending them to produce a foveated image, reducing computational waste and latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If every region of an image is rendered at equal resolution, then the visual quality is consistent across the entire display, but computational resources are wasted in regions where fine detail cannot be perceived
Solution Approach 1:
The patent applies local quality by rendering different regions of the image at different resolutions based on the user's gaze point. The foveal region (center of gaze) is rendered at high resolution while peripheral regions are rendered at progressively lower resolutions, matching the human visual system's varying sensitivity across the visual field. This resolves the contradiction by maintaining high visual quality where needed while reducing computational waste in less sensitive regions.
Solution Approach 2:
The patent implements dynamics by continuously tracking the user's gaze point and dynamically adjusting the resolution distribution across the image. As the gaze point moves, the high-resolution rendering region shifts accordingly, and the eccentricity layers are recalculated in real-time. This dynamic adaptation ensures computational resources are always allocated to the currently relevant visual regions while maintaining visual quality consistency in the foveal area.
2Productivity
If the human visual system's eccentricity sensitivity is utilized to reduce rendering resolution in peripheral regions, then computational efficiency improves, but visual artifacts and aliasing may appear at the boundaries of eccentricity layers
Solution Approach 1:
The patent uses nested doll by creating multiple concentric eccentricity layers centered on the gaze point, with each layer nested within the previous one. These layers transition from high resolution at the center to lower resolution at the periphery. By nesting multiple layers with gradual resolution transitions, the patent maintains computational efficiency while minimizing visual artifacts through smooth blending between layers.
Solution Approach 2:
The patent applies preliminary action by pre-calculating and applying antialiasing filters to the eccentricity layers before final rendering. The antialiasing operation is performed in advance on each eccentricity layer to prevent aliasing artifacts from appearing at the boundaries where resolution transitions occur. This preliminary processing ensures that when the layers are composited, visual artifacts are minimized while computational efficiency is maintained.
3Speed
If foveated rendering is implemented without antialiasing, then rendering speed increases, but aliasing artifacts appear at the boundaries of eccentricity layers
Solution Approach 1:
The patent applies preliminary action by performing antialiasing operations on the eccentricity layers before final composition and display. The antialiasing filter is applied in advance to each layer, removing potential aliasing artifacts at the resolution transition boundaries. This preliminary processing step ensures that when the layers are rapidly composited and displayed, the rendering speed is maintained while aliasing artifacts are eliminated from the final image.
Data Source
AI summary
A method and system for foveated image rendering are provided herein. The method includes tracking a gaze point of a user on a display device and generating a specified number of eccentricity layers based on the gaze point of the user. The method also includes antialiasing the eccentricity layers to remove artifacts, rendering a foveated image based on the eccentricity layers, and displaying the foveated image to the user via the display device.