Video Processing Template Matching Without Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding techniques suffer from low coding efficiency due to the reliance on interpolation processes in reference template derivation and candidate determination, leading to increased complexity and reduced effectiveness.

Innovation Solution

The proposed method eliminates interpolation processes in reference template derivation and introduces alternative methods for candidate determination, such as using integer precision and different interpolation filters, and reusing information between coding tools to reduce computation complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If interpolation process is used in reference template derivation, then template matching can be performed, but coding efficiency deteriorates and complexity increases

Engineering Contradiction:
Improvetemplate matching accuracyVSAvoidcoding efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts and removes the interpolation process from the reference template derivation. Instead of using interpolation to generate reference templates, the patent directly uses integer-pixel matched templates from the reference picture, eliminating the harmful interpolation step while maintaining template matching functionality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the parameter of template derivation from interpolation-based to direct integer-pixel matching. By modifying how the reference template is obtained (from interpolated fractional pixels to direct integer pixel copies), the patent maintains template matching accuracy while significantly improving coding efficiency and reducing complexity.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If conventional candidate determination method is used, then candidate list can be generated, but coding efficiency deteriorates due to repeated calculations

Engineering Contradiction:
Improvecandidate determination flexibilityVSAvoidcoding efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent performs preliminary action by determining candidate list information once during the first coding tool execution, and then reuses this pre-determined information for the second coding tool. This avoids repeated calculations and improves coding efficiency while maintaining candidate determination flexibility.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent recovers and reuses the candidate list determination information that would otherwise be recalculated. By preserving the results from the first coding tool and applying them to the second coding tool, the patent eliminates redundant computations and significantly improves productivity.

Inventive Principle:
Principle #34Discarding and recovering

3Adaptability or versatility

If multiple coding tools perform independent calculations, then comprehensive coding can be achieved, but computation complexity increases

Engineering Contradiction:
Improvecoding tool functionalityVSAvoidcomputation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the calculations by having the second coding tool reuse the candidate list determination information from the first coding tool instead of performing independent calculations. This combining approach maintains the functionality of multiple coding tools while significantly reducing overall computation complexity.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20240244187A1Method, apparatus, and medium for video processing
Publication Date: 2024.07.18 BYTEDANCE INC
  • US20240244187A1 patent drawing
  • US20240244187A1 patent drawing
  • US20240244187A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a target video block of a video and a bitstream of the video, a reference template for the target video block without involving an interpolation process; and performing the conversion based on the reference template. Compared with the conventional solution, the proposed method can advantageously improve the template matching based video coding and thus improve the coding effectiveness and coding efficiency.