Layered Multimedia Transmission Asynchronous Scheduling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multimedia streaming systems face buffer underruns due to insufficient network resources, leading to interruptions in service quality, especially in wireless channels with varying conditions, and inefficient packet scheduling in scalable video coding.
Innovation Solution
A mechanism for asynchronous transmission of layered encoded multimedia signals using channel and content-aware scheduling, where packet prioritization is applied before scheduling, allowing for efficient use of receiver buffers and exploiting less stringent packet expiry deadlines, with a client feedback mechanism to manage asynchronous data streams effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If synchronous transmission of layered encoded multimedia signals is used, then transmission coordination is simplified, but buffer underruns occur due to insufficient network resources
Solution Approach 1:
The multimedia signal is segmented into multiple layers (base layer and enhancement layers), allowing independent transmission and reception. The base layer can be received and played back even when enhancement layers are lost, preventing buffer underruns and ensuring service continuity.
Solution Approach 2:
The transmission system dynamically adapts to varying network conditions by adjusting which layers are transmitted and received. When network resources are sufficient, enhancement layers are transmitted for higher quality; when resources are constrained, only the base layer is transmitted to maintain continuous playback.
2Manufacturing precision
If higher enhancement layers are transmitted to improve quality, then picture quality increases, but network resources are consumed faster causing buffer underruns
Solution Approach 1:
Different parts of the multimedia signal (different layers) are transmitted with different priorities and quality levels. The base layer is transmitted with high reliability to ensure continuous playback, while enhancement layers are transmitted conditionally based on available network resources, optimizing the trade-off between quality and bandwidth consumption.
Solution Approach 2:
The system changes transmission parameters (which layers to transmit, transmission rates) based on real-time network conditions and receiver buffer status. When bandwidth is abundant, more enhancement layers are transmitted; when bandwidth is constrained, transmission shifts to base layer only, preventing buffer underruns while adapting picture quality to available resources.
3Reliability
If all layers are transmitted simultaneously to maximize quality, then service quality is optimized, but transmission efficiency decreases under resource constraints
Solution Approach 1:
Instead of transmitting all layers simultaneously, the system transmits only the necessary portion (base layer) when resources are constrained, and adds enhancement layers when resources are abundant. This partial action approach ensures transmission efficiency under resource constraints while maintaining the capability to provide full quality when resources permit.
Solution Approach 2:
The receiver provides feedback about buffer status and reception conditions to the transmitter. Based on this feedback, the transmitter adjusts which layers to transmit next, optimizing transmission efficiency by avoiding transmission of layers that would not be received or would cause buffer underruns, while maintaining service quality when conditions permit.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
The present invention refers to an apparatus, method and system for transmission of layered encoded multimedia signals, wherein a separator (1) separates a layered encoded multimedia signal (MS) in a base layer data stream (P) and at least one enhancement layer data stream (Q, R), each data stream including a plurality of data packets (Pxy, Qxy, Rxy) having a content sequence index. A memory (2P, 2Q, 2R) buffers the data packets of the base layer stream (P) and the at least one enhancement layer data stream (Q, R), and a scheduler (3) schedules the buffered data packets (Pxy, Qxy, Rxy) into an asynchronous data stream on the basis of a first content sequence index (CSI1), wherein data packets of said at least one enhancement layer data stream (Q, R) having a content sequence index lower than said first content sequence index (CSI1) are discarded.