Adaptive Interpolation Region Division for Video Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding technologies face limitations in coding efficiency due to inadequate division of regions based on motion vectors and spatial coordinates, which do not sufficiently consider texture information, leading to suboptimal interpolation filter coefficients and increased bit-rates.

Innovation Solution

The proposed solution involves calculating the energy of residual signals to perform region division, adjusting region ranges based on encoding information, and selecting optimal interpolation filter coefficients for each region, reducing prediction error energy and overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If region division is performed based on motion vectors and spatial coordinates, then the interpolation filter can be adapted to different areas, but the texture information is not sufficiently considered leading to suboptimal filter coefficients

Engineering Contradiction:
Improveinterpolation accuracyVSAvoidtexture information consideration
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent applies local quality by dividing the picture into multiple regions and selecting different interpolation filter coefficients for each region based on local texture characteristics. The encoder determines texture information for each region and chooses filter coefficients that are optimal for that specific region's texture properties, rather than using a uniform filter across the entire picture.

Inventive Principle:
Principle #3Local quality

2Productivity

If multiple sets of interpolation filter coefficients are prepared and switched based on region, then the coding efficiency improves, but the overhead for transmitting filter index information increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidbit-rate overhead
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent merges the transmission of filter index information with the transmission of region division information. By combining these two types of information, the patent reduces the total overhead compared to transmitting them separately, while still enabling region-based adaptive interpolation filtering.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent applies partial action by allowing the encoder to selectively transmit filter index information only for regions where texture-based filter switching is beneficial, rather than requiring filter indices for all regions. This reduces the overall overhead while maintaining coding efficiency in the regions that benefit most from adaptive filtering.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of manufacture

If fixed region ranges are used for interpolation filter switching, then the encoding process is simplified, but the flexibility in handling different texture localities is reduced

Engineering Contradiction:
Improveencoding process simplicityVSAvoidlocality handling flexibility
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by making the region ranges adjustable rather than fixed. The encoder can dynamically determine and modify region ranges based on the actual texture distribution in the picture, allowing the system to adapt to different texture patterns and motion characteristics while maintaining a relatively simple encoding process.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10298945B2Video encoding method, video decoding method, video encoding apparatus, video decoding apparatus, and programs thereof
Publication Date: 2019.05.21 NIPPON TELEGRAPH & TELEPHONE CORP
  • US10298945B2 patent drawing
  • US10298945B2 patent drawing
  • US10298945B2 patent drawing

AI summary

Regions based on which an interpolation method of a fractional-accuracy pixel is switched are optimized, and the interpolation method is switched for each of the divided regions, thereby reducing residual energy of inter-frame prediction with motion compensation. A video encoding apparatus is provided with: an encoding information acquiring unit which acquires encoding information for each block; a region classification unit which performs a region classification on a block-by-block basis in accordance with the encoding information; a divided region redefinition processing unit which shifts a region dividing line in a horizontal direction, a region dividing line in a vertical direction, or both the region dividing line in the horizontal direction and the region dividing line in the vertical direction based on a result of the region classification, and determines a region dividing line with which density of blocks belonging to a particular region classification is greater than or equal to a predetermined threshold value; an interpolation method switching unit which switches an interpolation method of a fractional-accuracy pixel for each of divided regions divided by the region dividing line; an interpolation performing unit which performs interpolation of the fractional-accuracy pixel for each of the divided regions; a picture encoding unit which encodes a picture using inter-frame prediction with motion compensation of fractional-accuracy for an interpolated picture; and a region classification information encoding unit which encodes information on the region classification.