Split Rendering PVS Concealment for UDP Packet Loss
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current techniques fail to address delays and packet losses in split rendering environments, leading to visual artifacts in displayed images due to incorrect shading of surfaces.
Innovation Solution
A client device determines data loss in video packets and identifies concealment information for affected primitives based on previous frames, updating the primitives' information to minimize visual artifacts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If UDP is used for PVS transmission in split rendering, then transmission speed and real-time performance are improved, but packet loss and data loss occur leading to visual artifacts
Solution Approach 1:
The system performs preliminary actions by detecting packet loss conditions in advance and preparing concealment information from previous frames before the actual rendering occurs. When packet loss is detected, the system has already identified affected primitives and prepared fallback rendering information, enabling continuous rendering without interruption.
Solution Approach 2:
The patent introduces an intermediary mechanism (concealment information processing unit) that mediates between the unreliable UDP transmission and the rendering pipeline. This intermediary detects packet loss, identifies affected primitives, and provides concealment information to maintain rendering continuity, thus resolving the contradiction between speed and reliability.
2Productivity
If PVS information is transmitted over UDP, then real-time rendering performance is improved, but delays and packet losses cause incorrect shading of surfaces
Solution Approach 1:
The system implements feedback mechanisms where the rendering system continuously monitors PVS packet delivery and provides feedback about lost packets to the concealment information processing unit. This feedback loop enables real-time detection of packet loss and dynamic adjustment of rendering parameters to maintain shading accuracy despite UDP transmission uncertainties.
Solution Approach 2:
The patent applies parameter changes by switching between different rendering parameters based on packet loss conditions. When packets are received successfully, normal shading parameters are used; when packet loss is detected, the system changes to concealment parameters derived from previous frames, thus maintaining visual quality across varying transmission conditions.
3Reliability
If error concealment is implemented for PVS data loss, then visual artifact reduction is improved, but processing complexity increases
Solution Approach 1:
The system segments the PVS data into individual primitive records, allowing selective error concealment only for affected primitives rather than the entire frame. This segmentation approach reduces processing complexity by limiting error concealment operations to only the necessary portions of the rendering data, while still improving visual quality for lost regions.
Solution Approach 2:
The patent uses copying by creating concealment information copies from previous frame data. Instead of complex real-time reconstruction, the system copies relevant primitive information from previously successful frames to replace lost current frame data. This copying mechanism simplifies processing while effectively reducing visual artifacts in lost regions.
Data Source
AI summary
This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for PVS over UDP for split rendering. A graphics processor may obtain, a PVS and a set of video packets. The graphics processor may determine, if a data loss associated with the PVS or the set of video packets is detected, one or more first visible primitives in the set of visible primitives that are currently affected by the data loss associated with the PVS or the set of video packets. The graphics processor may identify concealment information for the one or more first visible primitives in the set of visible primitives based on the one or more first visible primitives in a previous frame. The graphics processor may update information associated with the one or more first visible primitives based on the concealment information for the one or more first visible primitives.