Video Coding Sub-Picture Layering for Compression Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding technologies face challenges in efficiently reducing redundancy in video signals, particularly in handling multiple layers and regions within a video frame, which affects compression ratios and storage requirements.
Innovation Solution
The method involves decoding prediction information for a video sequence that includes multiple sub-pictures with different layer associations, allowing for user-selectable display of enhanced layers, independent or dependent layers, and varying spatial resolutions, enabling efficient encoding and decoding of video frames with improved compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If traditional video coding techniques are used, then bandwidth and storage requirements are reduced through compression, but visual quality and flexibility in handling multiple layers and regions are compromised
Solution Approach 1:
The video picture is divided into multiple sub-pictures, each representing different regions or layers. This segmentation allows independent encoding and decoding of specific regions, enabling selective quality enhancement and efficient bandwidth utilization by allocating different compression levels to different sub-pictures based on their importance.
Solution Approach 2:
The patent introduces a layered dimension to traditional video coding by organizing video content into multiple layers (base layer, enhancement layers) with different quality levels. This multi-layer structure enables receivers to select and decode only the necessary layers according to available bandwidth and quality requirements, effectively resolving the contradiction between compression and visual quality.
2Manufacturing precision
If multi-layer coding is implemented, then visual quality and region-specific enhancement are improved, but device complexity and processing requirements increase
Solution Approach 1:
The patent employs dynamic layer selection and adaptive decoding strategies where the decoder can dynamically adjust which layers to process based on available resources, picture type, and region importance. This dynamic approach reduces processing complexity by avoiding unnecessary decoding of all layers while maintaining visual quality where needed.
Solution Approach 2:
Different regions of the video picture are assigned different quality levels through the sub-picture structure. Important regions (e.g., foreground objects, regions of interest) are encoded with higher quality in enhancement layers, while less important regions use base layer quality only. This local quality differentiation improves overall visual quality without uniformly increasing complexity across the entire picture.
3Productivity
If sub-pictures with different layer associations are used, then compression efficiency and bandwidth utilization are improved, but decoding complexity and processing time increase
Solution Approach 1:
The patent performs preliminary organization of video data into sub-pictures with explicit layer associations during encoding. This preliminary structuring includes metadata that identifies which sub-pictures belong to which layers and their spatial relationships. During decoding, this pre-organized structure allows for efficient processing by eliminating the need for complex real-time analysis, thus reducing decoding time while maintaining high compression efficiency.
Data Source
AI summary
Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that partitions a current picture into a plurality of sub-pictures. Each of the plurality of sub-pictures corresponds to a different region of the current picture. The processing circuitry encodes each of the plurality of sub-pictures based on one or more layers associated with the respective one of the plurality of sub-pictures. The plurality of sub-pictures includes (i) a first sub-picture that is associated with a first number of layers, and (ii) a second sub-picture that is associated with a second number of layers that is different from the first number of layers.