Media Frame Decoding Latency Reduction via Preliminary Buffering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In point-to-multipoint media frame transmission, there is a significant latency issue when switching to a new channel, as client devices must wait for an independent frame (I-frame) to decode dependent frames (P-frames and B-frames), leading to undesirable delays in playback.
Innovation Solution
A method where client devices immediately start buffering media frames and request supplemental information via unicast messages to decode dependent frames without waiting for an I-frame, allowing decoding and playback to begin as soon as supplemental information is received.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If client devices wait for an independent frame (I-frame) before decoding dependent frames (P-frames and B-frames), then decoding accuracy is ensured, but playback latency increases significantly
Solution Approach 1:
The system performs preliminary actions by buffering dependent frames (P-frames and B-frames) as soon as they are received, without waiting for the I-frame to arrive. This allows the decoding process to start immediately once the I-frame is received, significantly reducing playback latency while ensuring decoding accuracy is maintained.
Solution Approach 2:
The frame reception and processing is segmented into two independent streams: one for receiving and buffering dependent frames, and another for receiving the I-frame. This segmentation allows parallel processing of frame types, eliminating the sequential waiting time that caused latency while maintaining the required decoding dependency relationship.
2Loss of time
If client devices buffer frames immediately without waiting for I-frame, then playback latency is reduced, but decoding reliability may be compromised
Solution Approach 1:
The system performs preliminary buffering of dependent frames without compromising reliability, as the buffering action is preparatory and does not attempt decoding until the I-frame is received. This preliminary action reduces latency by eliminating idle waiting time while maintaining decoding reliability through conditional decoding execution.
Solution Approach 2:
The I-frame acts as an intermediary that enables the decoding of previously buffered dependent frames. By buffering frames in advance and using the I-frame as an enabling intermediary, the system achieves low-latency playback while ensuring that decoding only occurs when all necessary reference information is available, thus maintaining reliability.
3Productivity
If I-frames are transmitted at longer intervals to improve coding efficiency, then bandwidth utilization improves, but channel switching latency increases
Solution Approach 1:
The system performs preliminary buffering of dependent frames that arrive between I-frames, so that when an I-frame is received (regardless of the interval), the dependent frames are already ready for immediate decoding. This preliminary action allows the system to maintain long I-frame intervals for coding efficiency while achieving low latency through pre-positioned frames.
Solution Approach 2:
The system maintains continuous useful action by continuously receiving and buffering dependent frames as they arrive, without idle periods. This continuous buffering ensures that when an I-frame arrives at any interval, the decoder can immediately process frames without waiting, thus maintaining high coding efficiency with long I-frame intervals while achieving low latency through uninterrupted frame preparation.
Data Source
AI summary
A technique that permits an earlier start of the decoding and play out of media frames received via a point-to-multipoint transmission is described. The media frames comprise frames of a first type that cannot be decoded without knowledge of supplemental information and frames of a second type that include the supplemental information. According to a method aspect of this technique, frames of the first type are received and immediately buffered without waiting for reception of a frame of the second type. In a next step, a request message requesting supplemental information required for a decoding of the buffered frames of the first type is sent. Upon receipt of the requested supplemental information, the buffered frames are decoded based on the received supplemental information.