Inter Prediction Mode-Based Image Processing for Video Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In moving picture compression techniques, the prediction error and compression performance are compromised due to the splitting of prediction units and the increase in additional information, particularly with bi-directional inter prediction methods.

Innovation Solution

The method involves using multiple partitioning modes for inter prediction, where motion information from different prediction units is derived and combined to generate prediction blocks of various shapes, reducing prediction error and additional information by applying different partitioning modes for each reference picture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If bi-directional inter prediction is used with prediction blocks of the same type averaged, then prediction can be performed, but prediction error increases and compression performance deteriorates due to splitting of prediction units and increase of additional information

Engineering Contradiction:
Improveprediction accuracyVSAvoidprediction unit splitting complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The prediction block is divided into multiple sub-prediction units (first and second sub-prediction units) with different partitioning modes. Each sub-prediction unit can be processed independently with optimized partitioning, reducing the overall prediction error while managing complexity through structured segmentation rather than uniform splitting.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different partitioning modes are applied to different sub-prediction units within the same prediction block. The first sub-prediction unit uses a first partitioning mode and the second sub-prediction unit uses a second partitioning mode, allowing each region to be optimized for its specific characteristics rather than using a uniform approach.

Inventive Principle:
Principle #3Local quality

2Reliability

If prediction blocks are split into multiple units, then prediction accuracy can be improved, but additional information amount increases which deteriorates compression performance

Engineering Contradiction:
Improveprediction accuracyVSAvoidadditional information amount
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

Multiple sub-prediction units with different partitioning modes are combined to form the final prediction block. The first prediction block and second prediction block are merged through averaging or weighted averaging to produce the final prediction, achieving accurate prediction while minimizing the information overhead by combining results rather than transmitting separate units.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If multiple partitioning modes are applied to different reference pictures, then prediction error is reduced and compression performance is enhanced, but the complexity of deriving motion information increases

Engineering Contradiction:
Improvecompression performanceVSAvoidmotion information derivation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Motion information is derived separately for each sub-prediction unit before combining the prediction blocks. By preparing motion information in advance for each partitioned region with its specific partitioning mode, the complex task is broken down into manageable steps, reducing the overall computational burden while maintaining high prediction accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10939099B2Inter prediction mode-based image processing method and device therefor
Publication Date: 2021.03.02 ROSEDALE DYNAMICS LLC
  • US10939099B2 patent drawing
  • US10939099B2 patent drawing
  • US10939099B2 patent drawing

AI summary

The present invention discloses an inter prediction mode-based image processing method and an apparatus therefore. Specifically, a method for processing an image based on an inter prediction may include: deriving motion information of a first prediction unit determined by a first partitioning mode of a current block and motion information of a second prediction unit determined by a second partitioning mode of the current block; generating a prediction block of the first prediction unit by using the motion information of the first prediction unit and generating a prediction block of the second prediction unit by using the motion information of the second prediction unit; and generating a prediction block of the current block in units of sub-prediction unit determined by combining the first prediction unit and the second prediction unit by using the first prediction block and the second prediction block.