Video Encoding Using Rectangular Block Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding methods, such as H.264/AVC, face challenges in prediction accuracy due to the use of only square block modes, which degrades the accuracy of predicting pixels from spatially distant areas, leading to inefficiencies in encoding and decoding processes.

Innovation Solution

The proposed solution involves a video encoding and decoding apparatus that selectively uses one-dimensional and two-dimensional integer transforms to decompose macroblocks into rectangular or square blocks, allowing for a more efficient encoding scheme by generating bitstreams based on the costs of encoding with or without rectangularly encoded bitstreams, thereby improving prediction accuracy and encoding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If only square block modes are used for encoding, then the transform efficiency is improved, but the prediction accuracy is degraded

Engineering Contradiction:
Improvetransform efficiencyVSAvoidprediction accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The current block is divided into multiple sub-blocks (e.g., four 4×4 sub-blocks in an 8×8 current block) that are encoded separately using different block modes. This segmentation allows each sub-block to use the most appropriate encoding mode (square or rectangular) based on its local characteristics, thereby improving prediction accuracy while maintaining transform efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The encoding mode is made dynamic and adaptive rather than fixed. The encoder selectively determines whether to use square block mode or rectangular block mode for each sub-block based on rate-distortion optimization. This dynamic selection allows the system to adapt to different local characteristics of the video content, improving prediction accuracy without sacrificing overall transform efficiency.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If rectangular block encoding is introduced to improve prediction accuracy, then the device complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidencoding complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Different encoding modes (square or rectangular) are applied to different local regions (sub-blocks) based on their specific characteristics. This local quality approach ensures that each sub-block is encoded with the most appropriate mode for its local content, improving prediction accuracy while limiting the increase in overall device complexity by applying complexity only where needed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The block mode parameter is changed dynamically for each sub-block based on rate-distortion optimization. The encoder evaluates both square and rectangular block modes and selects the one that provides the best prediction accuracy for each sub-block. This parameter change approach allows the system to improve prediction accuracy while managing device complexity through selective application.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If multiple encoding modes are selectively used, then the encoding efficiency is improved, but the ease of operation deteriorates

Engineering Contradiction:
Improveencoding efficiencyVSAvoiddecoding complexity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The encoder performs preliminary evaluation of both square and rectangular block modes for each sub-block and determines the optimal mode in advance. The selected mode information is then encoded and transmitted to the decoder. This preliminary action allows the decoder to simply follow the encoder's decisions without needing to perform complex evaluations, thereby improving encoding efficiency while maintaining ease of operation at the decoder side.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses rate-distortion optimization as a feedback mechanism to select the appropriate block mode for each sub-block. The encoder evaluates the prediction accuracy and bit rate consumption of different modes and selects the one that provides the best overall performance. This feedback-based selection improves encoding efficiency while keeping the decoding process relatively simple, as the decoder only needs to follow the encoder's mode selections.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9386324B2Image encoding/decoding apparatus and method using multi-dimensional integer transform
Publication Date: 2016.07.05 SK TELECOM CO LTD

AI summary

The present disclosure relates to a video encoding/decoding apparatus and method using a multi-dimensional integer transform. The video encoding method of the present disclosure includes: decomposing subblocks in units of a rectangular block and successively encoding rectangular block units to output a rectangularly encoded bitstream of each subblock; encoding the subblocks in units of a square block to output a squarely encoded bitstream of each subblock; calculating an encoding cost involving at least one rectangularly encoded bitstream; calculating an encoding cost not involving the rectangularly encoded bitstream; and on the basis of the calculations, using one or more of the squarely encoded bitstream and the rectangularly encoded bitstream to generate and output the bitstream of the macroblock. According to the disclosure, since the coding scheme for encoding or decoding a video with a higher efficiency is selectively determined, the prediction accuracy can increase and thereby improve the video encoding efficiency.