Video Encoder Decoder Flexible Tile Partitioning

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current video encoding and decoding technologies, such as H.265/HEVC, have limitations in efficiently handling complexity and flexibility in picture data, particularly in terms of tile sizes and CTU sizes, which affects parallel processing and decoding efficiency.

Innovation Solution

The proposed solution involves a video encoder and decoder that partition pictures into flexible-sized tiles with variable-sized coding tree units (CTUs), allowing for more efficient complexity handling and parallel processing. The encoder generates an encoded video signal with flags indicating the use of reference pictures and the presence of partial CTUs, while the decoder reconstructs the pictures by decoding each tile independently based on these flags.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If fixed-size blocks (macroblocks) are used for picture partitioning, then encoding simplicity is maintained, but processing flexibility and parallelization efficiency are limited

Engineering Contradiction:

Improveprocessing flexibilityVSAvoidencoding complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The picture is divided into multiple tiles, and each tile is further divided into coding tree units (CTUs) of variable sizes. This hierarchical segmentation allows different processing granularities and enables flexible parallel processing while maintaining manageable encoding complexity through modular structure.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces variable-sized CTUs that can adapt their dimensions based on picture characteristics and processing requirements. This dynamic partitioning allows the encoding system to optimize for different scenarios (e.g., high motion vs. low motion regions) while maintaining a systematic encoding framework.

Inventive Principle:

Principle #15Dynamics

2Productivity

If variable-sized coding tree units are implemented, then processing efficiency and parallelization are improved, but decoder complexity increases

Engineering Contradiction:

Improvedecoding efficiencyVSAvoiddecoder complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The encoded video signal includes syntax elements that indicate CTU size and partitioning information before decoding begins. This preliminary information allows the decoder to pre-configure processing parameters and allocate resources efficiently, reducing runtime complexity despite variable block sizes.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses syntax elements to signal CTU size parameters and partitioning configurations in the bitstream. The decoder reads these parameters and adapts its processing accordingly, enabling efficient variable-sized block handling through parameter-driven control rather than complex hardwired logic.

Inventive Principle:

Principle #35Parameter changes

3Productivity

If tiles are partitioned independently, then parallel processing capability is enhanced, but reference picture usage and encoding accuracy are affected

Engineering Contradiction:

Improveparallel processing capabilityVSAvoidencoding accuracy

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent introduces a flag mechanism that acts as an intermediary to control reference picture usage across tile boundaries. This flag allows the encoder to selectively enable or disable inter-tile reference operations, balancing parallel processing benefits with encoding accuracy requirements based on content characteristics.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent allows different tiles to have different reference picture configurations based on local content characteristics. Tiles with high spatial correlation can use reference pictures from other tiles, while tiles with independent content can be decoded independently, optimizing both accuracy and parallelization locally.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS20250159159A1Encoder and decoder, encoding method and decoding method with complexity handling for flexibly sized picture partitions

Publication Date: 2025.05.15 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV

AI summary

A video encoder according to embodiments is provided. The video encoder is configured for encoding a plurality of pictures of a video by generating an encoded video signal, wherein each of the plurality of pictures has original picture data. The video encoder has a data encoder configured for generating the encoded video signal having encoded picture data, wherein the data encoder is configured to encode the plurality of pictures of the video into the encoded picture data. Moreover, the video encoder has an output interface configured for outputting the encoded picture data of each of the plurality of pictures. Furthermore, a video decoders, systems, methods for encoding and decoding, computer programs and encoded video signals according to embodiments are provided.