Interleaved Intra Gradient Filter for Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-Efficiency Video Coding (HEVC) Intra prediction methods, such as Intra gradient filtering and bi-directional prediction, do not achieve optimal coding efficiency for all Intra prediction modes, particularly due to increased complexity and availability issues with boundary samples.

Innovation Solution

The proposed solution involves an 'Interleaved Intra gradient filter' that selectively applies the Intra gradient filter to specific directional Intra prediction modes and uses padding techniques for bi-directional prediction to ensure availability of boundary samples, along with adaptive filtering and scanning schemes to optimize coding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If Intra gradient filter is applied to all directional Intra prediction modes, then coding efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidfiltering complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the 33 directional Intra prediction modes into multiple groups (e.g., first group with modes 2-10, second group with modes 11-19, etc.) and applies the Intra gradient filter selectively to specific groups rather than all modes. This segmentation allows the encoder to improve coding efficiency for modes that benefit most from filtering while avoiding the complexity overhead for modes where filtering provides minimal gain, thus resolving the contradiction between coding efficiency and device complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different filtering strategies to different local regions of the prediction mode space. Specifically, it applies Intra gradient filtering to certain directional modes (e.g., modes 2-10 and 11-19) while using alternative methods (e.g., bi-directional prediction or no filtering) for other modes (e.g., modes 20-33). This local quality approach ensures that filtering complexity is concentrated only where it provides the most benefit, balancing coding efficiency improvement with complexity reduction.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If bi-directional prediction is used for all modes, then prediction accuracy is improved, but boundary sample availability issues increase complexity

Engineering Contradiction:
Improveprediction accuracyVSAvoidboundary sample handling complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the Intra prediction modes into groups where bi-directional prediction is applied to some groups (e.g., modes 2-19) while other groups (e.g., modes 20-33) use different prediction methods. This segmentation avoids the boundary sample availability issues that arise when bi-directional prediction is applied universally, as certain modes have inherent availability problems that would require complex handling mechanisms.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies bi-directional prediction partially, only to specific mode groups where it provides significant accuracy improvement, rather than excessively applying it to all modes. This partial action approach achieves the necessary prediction accuracy for critical modes while avoiding the complexity overhead of handling boundary sample availability issues for all modes, thus resolving the contradiction between prediction accuracy and complexity.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If Intra gradient filter is applied to modes with unavailable boundary samples, then prediction quality improves, but complexity increases due to sample padding requirements

Engineering Contradiction:
Improveprediction qualityVSAvoidsample padding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments modes into categories based on boundary sample availability characteristics. It applies Intra gradient filtering only to modes where boundary samples are naturally available or easily obtainable, while using alternative approaches for modes with unavailable boundary samples. This segmentation eliminates the need for complex sample padding mechanisms while maintaining prediction quality for the modes that require filtering.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and identifies the specific subset of modes that benefit from Intra gradient filtering without requiring complex sample padding operations. By taking out only the modes that can be effectively filtered with available boundary samples (e.g., modes 2-19), it avoids the complexity of implementing padding mechanisms while still achieving prediction quality improvement for the appropriate mode set.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10499053B2Method of improved directional intra prediction for video coding
Publication Date: 2019.12.03 MEDIATEK INC
  • US10499053B2 patent drawing
  • US10499053B2 patent drawing
  • US10499053B2 patent drawing

AI summary

A method of Intra prediction filtering to determine whether to turn on or off the Intra prediction filter based on interleaved Intra prediction mode sets implicitly is disclosed. In one embodiment, initial Intra prediction block is derived based on neighboring reconstructed pixels of the current block. If the Intra prediction filter is on for the current Intra prediction mode, the Intra prediction filter is applied to the initial Intra prediction block to form a filtered Intra prediction block and Intra prediction encoding or decoding is applied to the current block using the filtered Intra prediction block as a predictor for the current block. For example, Intra gradient filter can be applied for even modes of Intra prediction modes from v to (v+8) and/or from h and (h+8). Bi-directional Intra prediction filter can be applied to some or all other modes.