Non-Square Video Coding Blocks for High-Resolution Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video compression techniques face inefficiencies in coding high-resolution images due to the use of square coding blocks, which transmit unnecessary prediction information and fail to consider image characteristics, leading to reduced coding efficiency, especially when varying image sizes and motion prediction are employed.

Innovation Solution

The use of non-square coding and transform blocks with variable shapes and sizes, along with a method to determine the coding order based on intra-picture prediction modes, allows for improved coding efficiency by optimizing the transmission of prediction signals and considering image characteristics, particularly by prioritizing low-frequency transform coefficients and utilizing highly correlated motion vector information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If square coding blocks are used for video compression, then the coding structure is simple and uniform, but unnecessary prediction information is transmitted and image characteristics are not considered, leading to reduced coding efficiency

Engineering Contradiction:
Improvecoding structure complexityVSAvoidcoding efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The video frame is divided into multiple coding blocks of different sizes (e.g., 16x16, 32x32, 64x64 pixels) rather than using uniform square blocks. This segmentation allows the encoder to adapt the block size to the local image characteristics, improving coding efficiency by matching the block structure to the actual content variations in different regions of the image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The coding block size is made dynamic and adaptable rather than fixed. The encoder can selectively choose different block sizes for different regions of the image based on local characteristics such as texture complexity, motion activity, and frequency content. This dynamic adaptation optimizes the trade-off between prediction accuracy and bit rate allocation.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If various sized coding units are used to adapt to image characteristics, then prediction accuracy improves, but the amount of coding bits increases due to transmission of prediction information for each block

Engineering Contradiction:
Improveprediction accuracyVSAvoidcoding bits
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

Different prediction methods and block sizes are applied to different regions of the image based on local characteristics. For example, smooth regions may use larger blocks with simpler prediction modes, while regions with high frequency content or motion use smaller blocks with more detailed prediction. This local adaptation improves prediction accuracy where needed while avoiding unnecessary complexity in uniform regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The encoder dynamically changes prediction parameters such as block size, prediction mode, and transform type based on local image characteristics. By adapting these parameters to match the local content, the system achieves higher prediction accuracy in complex regions while maintaining efficiency in simpler regions, thereby optimizing the overall bit rate allocation.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If large coding units are used for high resolution images, then the amount of transmitted bits is reduced, but prediction errors may increase

Engineering Contradiction:
Improvetransmitted bitsVSAvoidprediction error
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The image is segmented into multiple coding blocks of varying sizes. Large blocks are used in regions with smooth content or low activity where prediction errors are naturally smaller, reducing the bit rate. In regions with high frequency content, motion, or texture variations, the image is segmented into smaller blocks to maintain prediction accuracy. This hierarchical segmentation allows the system to reduce overall bit rate while maintaining prediction quality where it matters most.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12143624B2Method and apparatus for encoding or decoding video signal
Publication Date: 2024.11.12 KONINKLIJKE PHILIPS NV
  • US12143624B2 patent drawing
  • US12143624B2 patent drawing
  • US12143624B2 patent drawing

AI summary

The present invention relates to a video signal decoding method and apparatus therefor. A decoding method according to an embodiment of the present invention comprises: setting a structure of a coding block constituting a current image; setting a structure of transform blocks corresponding to the coding block; and generating a prediction signal by using the transform blocks, and wherein the coding block includes any one or more blocks of a square block and a non-square block.