Flexible Deadline Video Delivery for Wireless Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Real-time video delivery in wireless networks faces challenges due to the burstiness of video traffic, leading to short-term congestion and potential loss of large video frames, which affects user experience, especially when I-frames are delayed, causing dependent frames to become useless and resulting in freezing screens.
Innovation Solution
A joint design of the radio resource scheduler and video encoder at the network side, combined with a video decoder at user terminals, where the scheduler sets flexible delivery deadlines and the decoder buffers late frames to ensure proper decoding of dependent frames, and the encoder embeds bit budget information in frames to support relaxed delay bounds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If strict delay bounds are enforced for real-time video delivery, then transmission quality is maintained, but video frames may be lost during short-term congestion leading to freezing screens
Solution Approach 1:
The patent applies dynamics by making the delay bound flexible rather than fixed. The network component dynamically adjusts the delay bound based on network conditions and frame types. For I-frames during congestion, the delay bound is extended to allow late delivery, while for other frames strict deadlines are maintained. This dynamic adjustment resolves the contradiction between maintaining transmission quality and ensuring continuous playback.
Solution Approach 2:
The patent changes the parameter of delay bound from a fixed value to a variable parameter that can be adjusted based on frame type and network conditions. The encoder embeds information about frame types (I-frames, P-frames, B-frames) and the network component uses this information to adaptively modify delivery deadlines, allowing late I-frames to be buffered and decoded later, thus preventing freezing screens while maintaining overall quality.
2Measurement precision
If I-frames are prioritized for immediate delivery, then decoding accuracy is improved, but network congestion causes I-frame delays making dependent frames useless
Solution Approach 1:
The patent applies preliminary action by having the encoder pre-mark I-frames with special identifiers and embed decoding information in advance. The network component is pre-configured to recognize these markers and apply extended delay bounds to marked I-frames. This preliminary preparation allows the system to handle I-frame delays proactively rather than reactively, maintaining decoding accuracy even when delivery is delayed.
Solution Approach 2:
The patent introduces an intermediary mechanism in the form of a buffer at the network component that temporarily holds late I-frames. This buffer acts as a mediator between the delayed I-frame delivery and the decoder, allowing the system to wait for I-frames without losing dependent frames. The buffer mediates the timing mismatch between I-frame arrival and dependent frame processing, preserving decoding accuracy.
3Productivity
If video frames are buffered to handle late delivery, then continuous playback is maintained, but network congestion causes increased delay for subsequent frames
Solution Approach 1:
The patent applies local quality by implementing selective buffering rather than uniform buffering for all frames. The network component identifies I-frames specifically and applies extended delay bounds only to these frames, while P-frames and B-frames maintain their original strict deadlines. This localized approach to buffering I-frames prevents propagation of delays to subsequent frames, maintaining continuous playback without widespread delay accumulation.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Embodiments are provided herein for a system and methods for real-time video (or other real-time traffic) delivery, e. g., for cellular or wireless networks. The schemes herein address real-time video delivery by a joint design of the radio resource scheduler and the video encoder at the network side, and of the decoder at the users' terminals. The system design reduces frame loss and hence improves user quality of experience. In an embodiment, a radio node detects a frame of a real-time traffic flow. Upon determining that a transmission deadline corresponding to a rate for real-time traffic flow does not support a size of the frame, the transmission deadline is extended according to the size of the frame and a size of a next frame. The frame and the next frame are scheduled for forwarding within the extended transmission deadline.