Template-Based Intra Prediction Complexity Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The complexity and coding efficiency associated with template-based Intra prediction in video coding, particularly in High Efficiency Video Coding (HEVC), are not adequately addressed, leading to increased computational requirements and suboptimal performance.

Innovation Solution

A method and apparatus for video coding using template-based Intra prediction, where N template matching candidates are evaluated for the current block, with costs associated with template matching Intra prediction used to select the final Intra mode from a candidate group, including neighboring Intra modes, most probable modes, and previous coded modes, and allowing different weights and filter precisions for interpolation filters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If template-based Intra prediction is applied to all Intra modes, then coding efficiency is improved, but computational complexity increases significantly

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent changes the parameter of template size from full block size to reduced sizes (e.g., 4x4, 8x8, or other sizes smaller than the current block). This parameter change reduces the number of template matching operations required, thereby decreasing computational complexity while still maintaining improved coding efficiency compared to conventional Intra prediction methods.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies template-based prediction selectively rather than to all blocks. It uses template matching for deriving Intra modes only when beneficial, while falling back to conventional Intra prediction methods for other cases. This partial application reduces overall computational complexity while still achieving coding efficiency improvements in suitable scenarios.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If full template matching is performed for all Intra prediction modes, then prediction accuracy is improved, but processing time increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the template matching process by using different template sizes for different regions or blocks. Instead of applying uniform full-size template matching across all blocks, it divides the processing into segments with appropriate template sizes, reducing total processing time while maintaining prediction accuracy where needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different template sizes and matching strategies to different local regions based on their characteristics. For regions where high prediction accuracy is critical, larger templates are used, while for other regions, smaller templates suffice. This local differentiation reduces overall processing time while maintaining necessary prediction accuracy.

Inventive Principle:
Principle #3Local quality

3Reliability

If multiple template sizes are used for different blocks, then coding efficiency is further improved, but implementation complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidimplementation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces dynamic selection of template sizes based on block characteristics, prediction mode, and other contextual factors. This dynamic adaptation allows the system to achieve high coding efficiency by using appropriate template sizes for each block, while the decision logic is designed to manage implementation complexity through systematic rules and heuristics.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10397569B2Method and apparatus for template-based intra prediction in image and video coding
Publication Date: 2019.08.27 MEDIATEK INC
  • US10397569B2 patent drawing
  • US10397569B2 patent drawing
  • US10397569B2 patent drawing

AI summary

A method and apparatus for video coding using template-based Intra prediction are disclosed. According to one method, the template-based Intra prediction searches N template matching candidates to reduce the complexity. In another method, the template-based Intra prediction assigns different weights for different pixel locations of template or uses different pixel precision for interpolation filter during cost evaluation among template matching candidates. In yet another method, truncated template size is used to reduce the complexity. In yet another method, the left and top templates may have different sizes for non-square block. In yet another method, inverse templated-based Intra prediction is used.