Foveated Image Reconstruction With Grid Compression and CAC
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image rendering techniques in mixed reality environments struggle to balance high-resolution imagery in the user's point of focus with reduced resolution in peripheral vision, leading to computational inefficiencies and color distortions due to chromatic aberration, which degrades the immersive and realistic experience.
Innovation Solution
A method involving the generation of a grid around the foveated region for high-resolution rendering, with data compression outside this area, and implementing a chromatic aberration correction protocol during decompression to maintain color accuracy and reduce computational load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-resolution rendering is applied to the entire field of view, then visual realism is improved, but computational resources are exhausted
Solution Approach 1:
The field of view is segmented into a foveated region (high-resolution) and peripheral regions (reduced-resolution). The grid is divided into multiple zones where the central zone corresponding to the foveated region maintains full resolution while outer zones use compressed, lower-resolution data, thereby reducing overall computational load while preserving visual realism where needed.
Solution Approach 2:
Different regions of the display are assigned different resolution qualities based on user attention. The foveated region receives high-resolution rendering for maximum visual realism, while peripheral regions use reduced-resolution rendering to conserve computational resources, matching the human visual system's attentional distribution.
2Productivity
If data compression is applied to peripheral regions, then computational load is reduced, but color accuracy deteriorates due to chromatic aberration
Solution Approach 1:
A chromatic aberration correction protocol is applied to the compressed peripheral region data before rendering. This preliminary correction action compensates for the color distortion introduced by compression and display characteristics, maintaining color accuracy in peripheral regions while still using compressed data to reduce computational load.
3Use of energy by moving object
If foveated rendering is implemented, then computational resources are optimized, but visual continuity across the field of view is compromised
Solution Approach 1:
The system uses eye-tracking feedback to dynamically identify and update the foveated region boundaries. This feedback mechanism ensures that the high-resolution region is continuously adjusted to match user gaze, maintaining visual continuity and coherence in the user's field of view while optimizing computational resources based on actual attention patterns.
Data Source
AI summary
Methods, systems, and storage media for rendering images are disclosed. Exemplary implementations may: receive object(s) in an area of interest of a mixed reality environment; identify a foveated region; generate a grid in proximity to the foveated region; determine coordinate(s), wherein each coordinate is defined based on a spatial orientation in the grid; assign the coordinate(s) to the object(s) in the area of interest; compress a portion of the grid external to the foveated region and data associated with the object(s) covered by the portion of the grid external to the foveated region; implement a chromatic aberration correction (CAC) protocol to the compressed coordinate data and compressed object data; transmit the foveated region, compressed coordinate data and object data; decompress the compressed coordinate data and object data; and render an environment associated with the area of interest using the foveated image and object data external to the foveated image.