Constrained Block Partitioning for Video Decoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-efficiency video coding (HEVC) faces challenges in effectively partitioning blocks of pixels due to limitations in current coding tree and residual quadtree structures, which affect processing efficiency and compatibility with virtual pipeline data units (VPDUs) in hardware decoders.

Innovation Solution

The implementation of constrained block partitioning using ternary-tree splits, with maximum block sizes limited to 64 or smaller, and the use of quadtree plus binary tree (QTBT) and multi-type-tree (MTT) structures to recursively split blocks, ensuring each VPDU can be processed entirely by a single pipeline stage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional coding tree structures are used for block partitioning, then coding flexibility is maintained, but processing efficiency and hardware decoder compatibility are reduced

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidpartitioning structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the block partitioning process into distinct phases: first applying quadtree partitioning to divide the current block into smaller regions, then applying binary tree partitioning only to specific sub-regions. This segmentation allows the encoder to achieve fine-grained partitioning where needed while maintaining coarser structures elsewhere, improving processing efficiency without uniformly increasing complexity across the entire partitioning structure.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If ternary-tree splits are allowed without size constraints, then partitioning flexibility is improved, but computational complexity increases

Engineering Contradiction:
Improvepartitioning flexibilityVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a size parameter constraint (maximum block size) that controls when ternary-tree splits can be applied. By changing the parameter from 'unrestricted size' to 'maximum size threshold', the system maintains partitioning flexibility for blocks that benefit from it while automatically disabling complex splits for smaller blocks where they would increase computational complexity without providing benefit.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If blocks are revisited during processing, then processing thoroughness is maintained, but processing efficiency decreases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidprocessing completeness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent performs preliminary partitioning actions by establishing a constrained partitioning structure upfront using quadtree and binary tree splits with maximum size limits. This preliminary structuring ensures that all necessary partitions are determined before processing begins, allowing the decoder to process each block exactly once without needing to revisit previously processed regions, thus maintaining both efficiency and completeness.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11924426B2Signaling block partitioning of image and video
Publication Date: 2024.03.05 HFI INNOVATION INC
  • US11924426B2 patent drawing
  • US11924426B2 patent drawing
  • US11924426B2 patent drawing

AI summary

A video system that applies constraints on block partitioning is provided. The system receives a partitioning control parameter from a bitstream specifying a maximum block size for enabling ternary-tree split that is constrained to be 64 or smaller. The system receives data from a bitstream for a block of pixels to be decoded as a current block of a current picture of a video. The system splits the current block into one or more partitions recursively, wherein ternary split is disallowed for a partition of the current block unless the partition is less than or equal to the maximum block size. The system reconstructs the one or more partitions of the current block.