Scalable Video Bitstream Extraction Ordering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing scalable video compression systems lack an efficient method for bitstream extraction ordering, leading to suboptimal video decoding quality, particularly in terms of resolution, framerate, and quality, as current methods like Point Extraction and Layer, Level, and Refinement Extraction do not prioritize refinement packets effectively.
Innovation Solution
The proposed solution involves a bit extraction method referred to as FTS (Refinement Layer, Temporal Level, and Spatial Layer), where bits are extracted in the order of refinement, followed by temporal level, and then spatial layer, prioritizing coding gain to achieve higher end-to-end video decoding quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional bit extraction methods (Point Extraction or Layer, Level, and Refinement Extraction) are used, then the bitstream can be extracted following simple ordering rules, but the video decoding quality (resolution, framerate, and quality) becomes suboptimal
Solution Approach 1:
The patent changes the extraction ordering parameters from traditional methods to a new FTS (Refinement Layer, Temporal Level, and Spatial Layer) sequence. This parameter change optimizes the bit extraction order to prioritize refinement packets, thereby improving video decoding quality while maintaining operational simplicity through a systematic extraction framework.
2Device complexity
If bits are extracted without prioritizing refinement packets, then the extraction process is simpler, but the coding gain and end-to-end video decoding quality are reduced
Solution Approach 1:
The patent applies preliminary action by pre-establishing the FTS extraction sequence that prioritizes refinement packets before actual bit extraction occurs. This preliminary ordering strategy ensures that refinement packets are extracted first, maximizing coding gain while keeping the extraction process manageable through a predetermined protocol.
3Ease of manufacture
If a fixed bit extraction order is used, then the system is easier to implement, but it cannot adapt to different video sequences and achieves suboptimal quality
Solution Approach 1:
The patent introduces dynamics by making the extraction order adaptive based on video sequence characteristics. The FTS method dynamically adjusts the extraction sequence according to the specific video content and requirements, allowing optimal quality for different video sequences while maintaining a structured framework that remains relatively easy to implement.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
A scalable video compression system (100) having an encoder (120), bit extractor (140), and decoder (160) for efficiently encoding and decoding a scalable embedded bitstream (130) at different video resolution, framerate, and video quality levels is provided. Bits can be extracted in order of refinement layer (136), followed by temporal level (132), followed by spatial layer (134), wherein each bit extracted provides an incremental improvement in video decoding quality. Bit extraction can be truncated at a position in the embedded bitstream corresponding to a maximum refinement layer, a maximum temporal level, and a maximum spatial layer. For a given refinement layer, bits are extracted from all spatial layers in a lower temporal level prior to extracting bits from spatial layers in a higher temporal level for prioritizing coding gain to increase video decoding quality, and prior to moving to a next refinement layer.