Video Motion Compensation Sharpening Filter

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video processing technologies face challenges in improving the quality of inter predictive coding due to artifacts caused by motion estimation and motion compensation, particularly the interpolation of reference frames on fractional-pel positions, which result in ringing artifacts and blurring of edges.

Innovation Solution

A video coder and decoder that incorporate a non-linear sharpening filter to reduce these artifacts by filtering prediction blocks based on fractional-pel motion vectors, allowing adaptive sharpening to improve edge quality and reduce signaling overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion compensation with fractional-pel interpolation is used to improve prediction accuracy, then prediction quality is improved, but ringing artifacts and edge blurring are introduced

Engineering Contradiction:
Improveprediction accuracyVSAvoidringing artifacts and edge blurring
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent extracts and removes the harmful artifacts (ringing and blurring) from the prediction block by applying a deblocking filter that specifically targets and eliminates these artifacts while preserving the beneficial fractional-pel prediction accuracy

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary processing stage (deblocking filter) between motion compensation and prediction that mediates between the high-frequency details from fractional-pel interpolation and the artifact reduction need, allowing both goals to be achieved

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If a sharpening filter is applied to reduce artifacts and improve edge quality, then edge sharpness is improved, but device complexity and computational resources increase

Engineering Contradiction:
Improveedge sharpnessVSAvoidfilter processing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies the sharpening filter selectively only to specific regions where edges are detected, rather than processing the entire prediction block, thereby improving edge sharpness where needed while minimizing unnecessary computational complexity in homogeneous regions

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies partial sharpening action only to the extent necessary for edge enhancement, using controlled filter strength and scope to achieve sufficient edge sharpness without the full computational cost of applying strong sharpening across the entire image

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3354026B1Apparatus and method for video motion compensation
Publication Date: 2021.09.15 HUAWEI TECH CO LTD
  • EP3354026B1 patent drawingFigure 1
  • EP3354026B1 patent drawingFigure 2
  • EP3354026B1 patent drawingFigure 3

AI summary

The present invention relates to a video coder for predictive coding a video stream of subsequent frames according to motion compensation into an encoded video bit stream, comprising a frame buffer (207) configured to store at least one reference frame of the video stream, an inter prediction unit (210) configured to generate a prediction block of a current block of the current frame from a reference block of the reference frame. Said prediction block is generated by means of a motion vector having a fractional-pel resolution, said fractional-pel resolution defining for each integer position of a motion vector a plurality of associated fractional positions. The video coder further comprises a sharpening filter (211) configured to filter the prediction block, and a control unit (212) configured to control the sharpening filter (211) depending on the integer or fractional position of the motion vector used for generating the prediction block.