Delay-Aware Packet Pacing for Real-Time Multimedia
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing split rendering techniques struggle to balance rendering delays at the receiver device with congestion control requirements at the sender device, leading to inefficiencies in resource usage and network performance.
Innovation Solution
A method where a processor in a device transmits an indication of processing delay associated with media content packets to a second device, and receives these packets in a packet arrival pattern based on the processing delay, facilitating balanced rendering and congestion control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If densely packed packets are transmitted to the receiver device, then rendering efficiency at the receiver is improved, but congestion control at the sender device deteriorates
Solution Approach 1:
The packet transmission system dynamically adjusts packet spacing based on real-time processing delay feedback from the receiver. The sender transitions from static packet scheduling to dynamic packet spacing, where inter-packet time gaps are adjusted according to the receiver's rendering capability and current processing state, resolving the contradiction between dense packing for rendering efficiency and sparse packing for congestion control
Solution Approach 2:
The receiver device transmits processing delay information back to the sender device, creating a feedback loop. The sender uses this feedback to adjust its packet transmission timing, allowing the system to adapt packet density based on actual receiver processing capacity, thereby balancing rendering efficiency with congestion control
2Reliability
If sparsely packed packets are transmitted from the sender device, then congestion control is improved, but rendering efficiency at the receiver device deteriorates
Solution Approach 1:
The system dynamically adjusts packet transmission density based on receiver processing delay feedback. When the receiver reports smaller processing delays, the sender increases packet density to improve rendering efficiency. When processing delays are larger, the sender reduces density to prevent congestion, thus adaptively balancing both requirements
Solution Approach 2:
The sender changes the time gap parameter between packets based on processing delay feedback. By adjusting this temporal parameter dynamically, the system optimizes the balance between packet density for rendering efficiency and spacing for congestion control, rather than using a fixed transmission pattern
3Device complexity
If packet transmission timing is not aligned with processing delay, then system complexity is reduced, but resource utilization deteriorates
Solution Approach 1:
The receiver device self-assesses its processing delay and communicates this information to the sender. The sender then autonomously adjusts its transmission timing based on this information, creating a self-regulating system that optimizes resource utilization without requiring complex centralized scheduling or intervention
Data Source
AI summary
This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for rendering delay aware packet pacing for real time multimedia applications. A processor of a first device transmits, to a second device, an indication of a processing delay associated with a set of packets associated with media content. The processor receives, from the second device, the set of packets in a packet arrival pattern that is based on the processing delay.