Video Encoding Padding Area Handling for Coding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video codecs face inefficiencies in encoding and decoding high-resolution video content, particularly when dealing with images that do not match the size of basic processing units, leading to increased data processing and reduced coding performance.

Innovation Solution

A method and apparatus for video encoding and decoding that involve padding the input image to make its size a multiple of a maximum coding unit, determining coding units by splitting the padded area, and encoding bitstreams with information about nonzero coefficients, quantization parameters, and prediction modes to optimize compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If padding is performed to make image size a multiple of maximum coding unit, then processing efficiency is improved, but device complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The image is divided into multiple maximum coding units, and each maximum coding unit is further segmented into coding units. This hierarchical segmentation allows efficient processing of large images while managing complexity through structured division. The padding area is also segmented and handled separately to optimize processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Padding is performed in advance to make the image size a multiple of the maximum coding unit size before the main encoding process. This preliminary action ensures that subsequent processing can proceed efficiently without needing to handle edge cases of incomplete blocks during the main processing flow.

Inventive Principle:
Principle #10Preliminary action

2Loss of energy

If conventional encoding method is used for padding area, then device complexity is reduced, but compression efficiency deteriorates

Engineering Contradiction:
Improvecompression efficiencyVSAvoiddevice complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

Different encoding approaches are applied to different regions: the input image area uses standard encoding methods, while the padding area uses simplified encoding with predetermined parameters. This local differentiation optimizes compression efficiency for each region's characteristics while managing overall complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

For the padding area, only essential encoding operations are performed with predetermined parameters, rather than applying the full conventional encoding process. This partial action is sufficient for padding regions since they don't contain actual image content, thereby improving efficiency without requiring complete encoding functionality.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If padding area is encoded with full conventional method, then encoding completeness is improved, but data transmission increases

Engineering Contradiction:
Improveencoding completenessVSAvoiddata transmission
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The padding area is extracted and identified separately from the input image area. By distinguishing the padding region, the encoder can apply simplified encoding with predetermined parameters, generating minimal data for this non-content region while maintaining completeness of the overall encoded output.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The padding area, which contains no actual image information, is encoded with minimal data using predetermined parameters. The decoder recovers the original image by discarding the padding area after decoding, thus minimizing data transmission for regions that don't contribute to the actual image content.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentEP3152904B1Video encoding and decoding methods and apparatuses for padding area of image
Publication Date: 2019.12.04 SAMSUNG ELECTRONICS CO LTD
  • EP3152904B1 patent drawingFigure 1A~2A
  • EP3152904B1 patent drawingFigure 2B~3B
  • EP3152904B1 patent drawingFigure 4

AI summary

Provided is a video encoding method including: performing padding outside an input image such that a size of the input image is a multiple of a maximum coding unit; when a current maximum coding unit includes a padding area generated via the padding, determining a coding unit by splitting the current maximum coding unit by using a boundary of the input image and the padding area; determining information indicating whether a coding unit included in the padding area includes a nonzero coefficient to be 0; and encoding a bitstream including the determined information.