Coding Areas for Flexible Video Partitioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies, such as H.265/HEVC, lack flexibility in spatial partitioning of coded pictures, which limits their ability to efficiently support parallel processing and error resilience in applications like 360° video streaming and low-delay conversational applications.
Innovation Solution
The introduction of Coding Areas (CAs) as a more flexible spatial region definition concept, allowing for rectangular regions within a picture that can have their own coding characteristics, and the use of indication data to signal the partitioning and coding order of these areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If fixed-size blocks (macroblocks or CTUs) are used for picture partitioning, then the coding process is simplified and processing is more regular, but the flexibility for parallel processing and error resilience is limited
Solution Approach 1:
The picture is divided into multiple coding areas (CAs) that can be independently processed. Each CA contains one or more CTUs and can be encoded/decoded in parallel with other CAs, enabling efficient parallel processing while maintaining the simplicity of fixed-size CTU blocks within each area.
Solution Approach 2:
The patent introduces dynamic partitioning where the picture can be divided into different numbers and configurations of coding areas based on application requirements. The number of CAs, their sizes, and their positions can be adapted dynamically to optimize for parallel processing, error resilience, or other specific needs.
2Reliability
If slices are used for picture partitioning, then error resilience is improved through independent slice reconstruction, but the flexibility for parallel processing and adaptive streaming is limited
Solution Approach 1:
The patent segments the picture into coding areas that can be independently processed and reconstructed. Similar to slices, each CA can be independently decoded, providing error resilience. However, CAs offer greater flexibility in configuration and can be processed in parallel more efficiently than traditional slices.
Solution Approach 2:
Coding areas serve multiple functions: they enable parallel processing like tiles, provide error resilience like slices, and support adaptive streaming configurations. This multi-functionality makes CAs more versatile than traditional partitioning methods that were designed for single-purpose use.
3Productivity
If tiles are used for picture partitioning, then parallel processing capability is enhanced, but error resilience and flexibility for different applications are reduced
Solution Approach 1:
The patent divides the picture into multiple coding areas that can be processed in parallel, similar to tiles. However, unlike fixed grid-based tiles, CAs can be configured with different numbers, sizes, and positions to optimize for specific applications such as 360° video streaming or low-delay conferencing.
Solution Approach 2:
The patent allows dynamic adjustment of CA parameters including the number of CAs, their dimensions, and their positions within the picture. This enables optimization of parallel processing efficiency for different resolutions, aspect ratios, and application requirements while maintaining the core benefit of parallel processing.
4Device complexity
If a single picture structure is used, then the coding process is straightforward, but the ability to support diverse applications like 360° video and low-delay conferencing is limited
Solution Approach 1:
The patent introduces dynamic picture partitioning into coding areas that can be configured based on application requirements. The same base picture structure can be adapted for different applications by adjusting the number, size, and arrangement of CAs, enabling support for 360° video, low-delay conferencing, and other specialized applications without fundamentally changing the coding framework.
Solution Approach 2:
The coding area concept provides a universal framework that can serve multiple application needs. By adjusting CA configuration parameters, the same basic structure can optimize for parallel processing in standard video, error resilience in unreliable networks, or low-latency processing in conferencing applications.
Data Source
AI summary
A video decoder for decoding an encoded video signal including encoded picture data and indication data of a picture of a video to reconstruct the picture of the video is provided. The video decoder includes an interface configured for receiving the encoded video signal, and a data decoder configured for reconstructing the picture of the video by decoding the encoded picture data using the indication data. The picture is partitioned into a plurality of coding areas. One or more coding areas of the plurality of coding areas include two or more coding tree units of the plurality of coding tree units, wherein each coding area of the one or more coding areas which includes two or more coding tree units exhibits a coding order for the two or more coding tree units of the coding area.