Scalable Video Bitstream Layer Independence Signaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding and decoding technologies face challenges in efficiently managing spatial, quality, and multiview scalability within video bitstreams, particularly in adapting to varying resolutions and scene activities without significant increases in bandwidth or storage requirements.
Innovation Solution
The method involves obtaining syntax elements from an encoded video bitstream to determine the number of layers and their independence, allowing for adaptive output modes and layer selection, enabling efficient decoding and resampling of video data to accommodate different resolutions and activities within a coded video sequence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple layers with different resolutions are included in the coded video sequence, then adaptability to varying resolutions is improved, but device complexity increases due to layer management and output mode determination
Solution Approach 1:
The video content is segmented into multiple independent layers, each representing a different resolution version. The bitstream is divided into base layer bitstreams and enhancement layer bitstreams, allowing receivers to selectively decode only the layers they need based on their capabilities and network conditions, thus improving adaptability without requiring the receiver to process all possible resolutions simultaneously.
Solution Approach 2:
The system dynamically adapts the output by allowing receivers to select which layers to decode and output based on real-time conditions. The output layer determination is dynamic rather than fixed, enabling the same bitstream to serve multiple resolution requirements without increasing the fundamental complexity of the decoding architecture.
2Productivity
If scalable video coding with multiple layers is implemented, then coding efficiency is improved, but bandwidth requirements increase due to transmission of multiple layer bitstreams
Solution Approach 1:
The enhancement layer bitstreams are structured to contain or reference the base layer information. The enhancement layers are nested within the overall scalable video structure, where lower-resolution base layers provide the foundation and higher-resolution enhancement layers add incremental detail. This nesting allows efficient bandwidth utilization because receivers can discard enhancement layers they don't need while retaining the base layer.
Solution Approach 2:
The system changes the resolution parameter across different layers rather than transmitting multiple complete video streams. By encoding video at multiple resolutions within a unified scalable structure with shared coding elements, the total bandwidth required is significantly reduced compared to transmitting separate independent video streams for each resolution.
3Adaptability or versatility
If layer independence is configured, then decoding flexibility is improved, but storage requirements increase due to maintaining multiple layer versions
Solution Approach 1:
The scalable video bitstream structure serves multiple functions simultaneously: it provides base layer content for low-resolution playback, enhancement layers for high-resolution playback, and supports various output configurations. This universal structure eliminates the need for separate storage of multiple complete video versions, as a single scalable bitstream can be adapted to different playback requirements.
Data Source
AI summary
A method of decoding an encoded video bitstream using at least one processor includes obtaining a coded video sequence from the encoded video bitstream; obtaining a first syntax element indicating a number of a plurality of layers included in the coded video sequence; obtaining a second syntax element indicating whether the plurality of layers included in the coded video sequence are all independent layers; based on the first syntax element indicating that the number of the plurality of layers is greater than one, and the second syntax element indicating that the plurality of layers are not all the independent layers, obtaining a third syntax element indicating an output mode; determining the output mode based on the third syntax element; determining one or more output layers from among the plurality of layers based on the determined output mode; and outputting the one or more output layers.