Partial Reconstruction Template Matching for Video Decoding

Solution Overview

Problem

Existing video coding technologies face inefficiencies in motion vector derivation, particularly due to the need for full reconstruction of neighboring blocks before applying template matching, which can introduce delays and increase power usage in video decoding processes.

Innovation Solution

The implementation of decoder-side motion vector derivation techniques using partial reconstruction of neighboring blocks, allowing for template matching to be applied earlier in the decoding process, thereby reducing delays and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If full reconstruction of neighboring blocks is performed before template matching, then template matching accuracy is improved, but decoding delay and power consumption increase

Engineering Contradiction:

Improvetemplate matching accuracyVSAvoiddecoding delay

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing partial reconstruction of neighboring blocks before template matching instead of waiting for full reconstruction. This allows the template matching process to start earlier in the decoding pipeline, reducing overall decoding delay while maintaining sufficient accuracy for motion vector derivation

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements partial reconstruction of neighboring blocks rather than full reconstruction. Specifically, only the necessary portions of neighboring blocks are reconstructed to create the template for template matching, which reduces the computational workload and power consumption while still providing adequate matching accuracy

Inventive Principle:

Principle #16Partial or excessive action

2Measurement precision

If full reconstruction of neighboring blocks is performed before template matching, then template matching accuracy is improved, but power consumption increases

Engineering Contradiction:

Improvetemplate matching accuracyVSAvoiddecoding power consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by stationary object

Solution Approach 1:

The patent implements partial reconstruction of neighboring blocks rather than full reconstruction. Specifically, only the necessary portions of neighboring blocks are reconstructed to create the template for template matching, which reduces the computational workload and power consumption while still providing adequate matching accuracy

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The patent extracts only the essential components needed for template matching from the neighboring blocks, rather than performing complete reconstruction. This selective extraction approach reduces unnecessary computational operations and associated power consumption

Inventive Principle:

Principle #2Taking out (Extraction)

3Measurement precision

If template matching is delayed until full reconstruction, then processing accuracy is improved, but productivity decreases

Engineering Contradiction:

Improvemotion vector derivation accuracyVSAvoiddecoding throughput

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The patent applies preliminary action by performing partial reconstruction of neighboring blocks before template matching instead of waiting for full reconstruction. This allows the template matching process to start earlier in the decoding pipeline, reducing overall decoding delay while maintaining sufficient accuracy for motion vector derivation

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS10757442B2Partial reconstruction based template matching for motion vector derivation

Publication Date: 2020.08.25 QUALCOMM INC

AI summary

A method of decoding video data includes determining, by a video decoder, a neighboring block in a current frame is inter coded. The method includes, in response to determining the neighboring block is inter coded, determining, by the video decoder, a template for a current block in the current frame based on a partial reconstruction of the neighboring block. The method includes determining, by the video decoder, a reference block in a reference frame corresponding to the template for the current block and determining, by the video decoder, motion vector information for the current frame based on the reference block and the template. The method includes generating, by the video decoder, a predictive block for the current block of video data based on the motion vector information and decoding, by the video decoder, the current block of video data based on the predictive block.