Shading Atlas Error Concealment in Split Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing graphics processing systems face challenges in handling packet loss and corruption during vector streaming, leading to incomplete or corrupted frames in split rendering architectures, particularly in augmented and virtual reality applications.
Innovation Solution
A client device decodes an encoded shading atlas, identifies and error conceals intersecting patches using prior valid versions, and renders frames using in-painting for unrecoverable regions, employing a graphics processing pipeline with error concealment techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If packet transmission is used for vector streaming in split rendering, then bandwidth efficiency is improved, but packet loss and corruption occur leading to incomplete or corrupted frames
Solution Approach 1:
The shading atlas is divided into multiple independently decodable slices. When packet loss occurs, only the affected slices are corrupted while other slices remain intact and can be decoded independently, preventing complete frame corruption and enabling selective error concealment.
Solution Approach 2:
The system stores prior valid versions of shading atlas patches at the client device before transmission errors occur. When corruption is detected, these pre-stored valid versions are immediately used to conceal errors without requiring retransmission, maintaining rendering continuity.
2Manufacturing precision
If error concealment using prior valid versions is applied to corrupted patches, then frame rendering quality is improved, but additional processing overhead is introduced
Solution Approach 1:
Error concealment is applied selectively only to intersecting patches that are actually corrupted by transmission errors, rather than processing the entire shading atlas. This localized approach maintains rendering quality for affected regions while minimizing unnecessary processing overhead for unaffected regions.
Solution Approach 2:
The system copies prior valid patch versions into the current shading atlas where corruption is detected, replacing erroneous data with validated historical data. This copying operation is simpler and more efficient than regenerating or retransmitting the corrupted patches.
3Reliability
If slices are used to divide the encoded shading atlas, then error propagation is reduced, but decoding complexity increases
Solution Approach 1:
The encoded shading atlas is segmented into multiple slices that can be independently decoded. This segmentation limits error propagation to only the affected slice while allowing other slices to be decoded successfully, and the independent structure actually simplifies the decoding process by allowing parallel processing of slices.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
A client device of a split rendering graphics processing architecture, receives an encoded shading atlas for a current frame. The encoded shading atlas is characterized by slices. The client decodes the received encoded shading atlas and identifies unsuccessfully decoded slices. The client then determines whether each patch of the decoded shading atlas intersects an identified unsuccessfully decoded slice. The client determines, for each intersecting patch, whether a prior valid version of each intersecting patch is stored at the client device. The client error conceals each intersecting patch having a prior valid version stored at the client device with the corresponding prior valid version to create an error concealed atlas. The client renders the current frame using the error concealed atlas.