Intra Prediction Interpolation for Video Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video compression standards, such as HEVC, face limitations in intra prediction efficiency due to the use of simple pixel repetition, which fails to effectively model intensity changes in natural imagery, especially with larger block sizes, leading to suboptimal compression performance.

Innovation Solution

The proposed solution introduces interpolation methods that use exact interpolation instead of approximation, applying interpolation to all positive directions, and allowing the encoder to decide based on RD performance, signaling the choice using a 1-bit flag, thereby enhancing prediction efficiency by modeling intensity changes more accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If simple pixel repetition is used for intra prediction, then device complexity is reduced, but manufacturing precision (prediction accuracy) deteriorates

Engineering Contradiction:
Improveprediction complexityVSAvoidprediction accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent changes the prediction method from simple pixel repetition to interpolation-based prediction. It introduces new prediction modes that use linear interpolation between reference samples, transforming the prediction parameters from discrete pixel values to continuous interpolated values, thereby improving prediction accuracy while maintaining manageable complexity

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces dynamic prediction modes that adaptively select between different prediction methods (planar, angular, gradient) based on the local image characteristics. This dynamic approach allows the system to optimize prediction accuracy for different regions while maintaining overall efficiency

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If interpolation is applied to all positive directions, then prediction accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidprediction complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the prediction directions into different categories (positive directions, negative directions, planar modes) and applies interpolation selectively to specific segments. By dividing the prediction space and applying different methods to different segments, the patent improves accuracy where needed while controlling overall complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies interpolation-based prediction locally to specific regions and directions where it provides the most benefit. Instead of uniformly applying complex interpolation everywhere, it targets the application to positive directions and specific prediction modes, achieving local optimization without global complexity increase

Inventive Principle:
Principle #3Local quality

3Device complexity

If approximate interpolation calculation is used, then device complexity is reduced, but manufacturing precision (prediction accuracy) deteriorates

Engineering Contradiction:
Improvecalculation complexityVSAvoidinterpolation accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent replaces complex floating-point interpolation calculations with simplified integer-based arithmetic operations. By substituting the calculation mechanism from floating-point to integer arithmetic, it maintains prediction accuracy while dramatically reducing computational complexity and hardware requirements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP3632102B1Method and apparatus for intra prediction with interpolation
Publication Date: 2024.09.18 INTERDIGITAL MADISON PATENT HLDG
  • EP3632102B1 patent drawingFigure 1
  • EP3632102B1 patent drawingFigure 2
  • EP3632102B1 patent drawingFigure 3(a)~3(b)

AI summary

An improved method of performing intra prediction for encoding or decoding uses interpolation such that substitute samples are found for samples to be used in the interpolation calculation that lie outside a normal reference range. The substitute samples can be repeated end samples from the bottom of a reference portion to the left of the target block, or right samples of a reference portion above the target block. An encoder can signal to a decoder whether to use intra prediction or interpolation prediction.