Non-Rectangular Prediction Regions in Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The next-generation Versatile Video Coding (VVC) standard faces higher computational complexity and increased bit-rate compared to its predecessor, HEVC, while aiming to improve visual quality and maintain low bit-rate, especially for ultra-high-definition and high-frame-rate videos.

Innovation Solution

The method involves partitioning coding blocks into non-rectangular prediction regions, processing residual signals to minimize pixel value inconsistencies along borders, and using adaptive filtering techniques based on coding block characteristics such as size, shape, and distance from borders, to enhance prediction accuracy and reduce bitstream size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If non-rectangular prediction regions are used to improve prediction accuracy, then visual quality improves, but computational complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The coding block is divided into multiple non-rectangular prediction regions with different prediction modes, allowing each region to be optimized independently for better prediction accuracy while managing complexity through structured segmentation

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different prediction processing techniques are applied to different regions within the coding block based on local characteristics, enabling optimized prediction accuracy in each region while avoiding uniform complex processing across the entire block

Inventive Principle:
Principle #3Local quality

2Measurement precision

If complex adaptive processing is applied to minimize pixel inconsistencies, then visual quality improves, but bit-rate increases

Engineering Contradiction:
Improvepixel value consistencyVSAvoidbit-rate
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

Processing parameters such as filter strength and processing range are adaptively adjusted based on coding block characteristics, enabling effective pixel inconsistency minimization while avoiding excessive processing that would increase bit-rate

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If extensive pixel processing is performed on residual signals, then prediction error reduces, but computational complexity increases

Engineering Contradiction:
Improveprediction errorVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Pixel processing is selectively applied only to specific regions and pixels within the residual signal that benefit most from processing, avoiding unnecessary computation on already-accurate regions while still reducing prediction errors where needed

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20200213595A1Methods, Systems, And Apparatuses For Adaptive Processing Of Non-Rectangular Regions Within Coding Units
Publication Date: 2020.07.02 COMCAST CABLE COMM LLC
  • US20200213595A1 patent drawing
  • US20200213595A1 patent drawing
  • US20200213595A1 patent drawing

AI summary

Systems and methods are described herein for processing video. A coding block of a plurality of coding blocks that are part of a video frame may be partitioned into non-rectangular prediction regions. Prediction areas may be determined based on one or more predetermined criteria that correspond to the non-rectangular prediction regions. Residual signals comprising a difference between the prediction areas and non-rectangular prediction regions may be determined. One or more pixels in the residual signals may be processed to generate processed residual signals. The processing may be based on at least one characteristic of the coding block and configured to minimize inconsistencies of pixel values along a border between the processed residual signals. The coding block comprising the processed residual signals may be encoded for transmission in a bitstream.