XR Streaming Configuration for Congestion-Aware Latency Sync
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In low-latency network communication for XR rendering applications, the use of UDP packets leads to silent data packet drops in congested scenarios, disrupting latency prediction and synchronization with display panels due to variable latency introduced by congestion control algorithms.
Innovation Solution
A data processing system and method that processes quality of service, media processing latency, and client device operational information to generate streaming configuration parameters, optimizing network performance by managing congestion control while maintaining low latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If congestion control algorithms are applied to manage UDP packet transmission rates, then network reliability is improved, but latency variability increases causing inaccuracies in latency prediction algorithms
Solution Approach 1:
The system performs preliminary latency prediction using historical data and network conditions before actual packet transmission. By predicting latency in advance and pre-adjusting rendering timing, the system compensates for the variability introduced by congestion control algorithms, maintaining both reliability and timing accuracy
Solution Approach 2:
The system implements a feedback mechanism where actual latency measurements from previous transmissions are continuously fed back to adjust future latency predictions. This closed-loop approach allows the system to adapt to changing network conditions and congestion control behavior, maintaining prediction accuracy despite variable latency
2Speed
If UDP packets are used for data transmission to achieve low latency, then transmission speed is improved, but data packet delivery reliability deteriorates in congested scenarios
Solution Approach 1:
The system applies congestion control algorithms partially, adjusting transmission rates based on network conditions rather than applying full congestion control. This selective approach maintains high transmission speeds during good network conditions while providing sufficient rate adjustment to prevent packet loss during congestion
Solution Approach 2:
The system dynamically changes transmission parameters such as packet size, transmission interval, and rate adjustment factors based on network conditions. By adapting these parameters in real-time, the system maintains high transmission speeds when possible while ensuring reliable delivery when network congestion is detected
3Measurement precision
If predictive timing algorithms are used to synchronize rendering with display panels, then synchronization precision is improved, but sensitivity to latency variability increases
Solution Approach 1:
The system performs preliminary timing adjustments based on predicted latency before rendering begins. By pre-synchronizing the rendering timeline with display panel timing using predicted values, the system maintains precise synchronization even when actual latency varies, reducing the impact of timing variations on final synchronization accuracy
Data Source
AI summary
Disclosed is data processing system having at least one server communicably couplable to at least one display apparatus, wherein at least one server has at least one processor configured to obtain quality of service information from network traffic regulator of communication network, wherein communication network is between at least one server and at least one display apparatus, obtain media processing latency information from at least one rendering application executing at the at least one server, and obtain client device operational information from at least one display apparatus; process quality of service information, media processing latency information, and client device operational information together to generate streaming configuration parameters; and control at least one rendering application to generate images for displaying at the at least one display apparatus and send images via communication network to at least one display apparatus, according to generated streaming configuration parameters.