Video Encoding Asymmetric Partitioning Hierarchical Coding Units

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video codecs face inefficiencies in encoding and decoding high-resolution video content due to their reliance on fixed macroblock sizes and limited partition shapes, which hinder optimal compression and decoding of high-resolution images.

Innovation Solution

The method involves splitting video data into maximum coding units and encoding them using deeper coding units with hierarchical structures, allowing for inter prediction using partitions split according to arbitrary ratios, and determining the optimal coding depth for each region to adapt encoding modes based on image characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If fixed macroblock sizes and limited partition shapes are used for encoding, then the encoding process is simple and consistent, but the compression efficiency for high-resolution video content deteriorates

Engineering Contradiction:
Improveencoding process simplicityVSAvoidcompression efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The video data is divided into maximum coding units, which are then recursively segmented into deeper coding units with different sizes and shapes. This hierarchical segmentation allows the system to adapt to high-resolution content by creating partitions that match the actual image characteristics, thereby improving compression efficiency while maintaining manageable encoding complexity through structured division

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic partitioning where coding units can have varying sizes and arbitrary shapes based on image characteristics. The encoding process dynamically selects partition types (e.g., symmetric, asymmetric, geometric) and determines optimal coding depths for different regions, transforming the static fixed-size macroblock approach into a flexible adaptive system that improves compression for high-resolution video

Inventive Principle:
Principle #15Dynamics

2Device complexity

If the maximum size of coding units is increased to reduce the number of partitions, then the encoding complexity decreases, but the ability to capture local image characteristics deteriorates

Engineering Contradiction:
Improveencoding complexityVSAvoidlocal image characteristics capture
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by allowing different regions of the video to have different coding unit sizes, shapes, and partition types based on their local characteristics. Smooth regions can use larger coding units for compression efficiency, while regions with edges or details can use smaller or geometrically-shaped units to preserve image quality, thus capturing local characteristics without uniformly increasing overall complexity

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The hierarchical structure of maximum coding units containing deeper coding units creates a nested organization where larger units provide overall structure and smaller units provide local detail. This nesting allows the system to maintain low complexity at higher levels while achieving high precision at lower levels, resolving the contradiction between coding unit size and local characteristic capture

Inventive Principle:
Principle #7Nested doll (Nesting)

3Adaptability or versatility

If arbitrary ratio partitions are used to improve compression efficiency, then the adaptability to image characteristics improves, but the device complexity for handling multiple partition types increases

Engineering Contradiction:
Improveadaptability to image characteristicsVSAvoiddevice complexity for partition handling
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically selects from multiple partition types (symmetric, asymmetric, geometric) based on local image characteristics rather than using all types uniformly. This dynamic adaptation improves versatility for different image regions while managing device complexity by activating only the necessary partition types for each specific coding unit based on its characteristics

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3402189B1Method and apparatus for encoding video by prediction using asymmetric partition types, and computer-readable storage medium for storing a generated bitstream
Publication Date: 2021.05.05 SAMSUNG ELECTRONICS CO LTD
  • EP3402189B1 patent drawingFigure 1~3
  • EP3402189B1 patent drawingFigure 4
  • EP3402189B1 patent drawingFigure 5

AI summary

Disclosed is a method and apparatus of encoding a video, the method including: encoding the video data of maximum coding unit based on deeper coding units of hierarchical structures according to at least one split region of the maximum coding unit, with performing inter prediction using partitions obtained by splitting the coding unit according to arbitrary ratios, and determining a coding depth; and outputting a bitstream including the encoded video data corresponding to a coding depth according to maximum coding units and information regarding the coding depth and encoding modes.