Composite Reference Array for Video Intra Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding and decoding methods face challenges in achieving high compression efficiency due to limitations in intra prediction, particularly when dealing with complex spatial redundancies and directional structures within video frames.

Innovation Solution

The method involves forming a composite reference array by projecting multiple reference arrays onto a closest reference array, allowing for more accurate prediction of target pixels using a Gaussian filter, which enhances intra prediction accuracy and compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple reference arrays are projected and combined to form a composite reference array, then prediction accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomplexity of reference array processing
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The reference samples are segmented into multiple reference arrays based on different spatial regions or directions. Each reference array contains samples from specific neighboring blocks, allowing the prediction process to selectively combine relevant segments rather than processing all samples uniformly, thus improving accuracy while managing complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the reference arrays are treated with different qualities or weights based on their relevance to the target block. The projection process selectively emphasizes locally relevant reference samples while downweighting or excluding less relevant ones, achieving higher prediction accuracy without uniformly increasing complexity across all reference data.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If a composite reference array is formed by projecting multiple reference arrays, then intra prediction accuracy is enhanced, but encoding complexity increases

Engineering Contradiction:
Improveintra prediction accuracyVSAvoidencoding complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The multiple reference arrays are projected and combined into a composite reference array before the actual prediction process. This preliminary action organizes and pre-processes the reference data in advance, making the subsequent prediction operation more efficient and accurate while concentrating the complexity work in a preparatory stage rather than during repeated prediction operations.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If reference arrays from different spatial locations are combined, then compression efficiency is improved, but processing complexity increases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Multiple reference arrays from different spatial locations are merged into a single composite reference array. This combining process integrates diverse reference information that improves prediction accuracy and compression efficiency, while the unified composite structure simplifies subsequent processing compared to handling multiple separate arrays.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The composite reference array serves multiple functions: it provides reference samples for prediction, enables selective projection of relevant regions, and supports both accurate prediction and efficient processing. This multi-functionality achieves improved compression efficiency without proportionally increasing processing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11558604B2Method and apparatus for intra prediction using a composite reference array
Publication Date: 2023.01.17 INTERDIGITAL VC HOLDINGS INC
  • US11558604B2 patent drawing
  • US11558604B2 patent drawing
  • US11558604B2 patent drawing

AI summary

Methods and apparatus for intra prediction in video encoding and decoding using a composite reference array are described. In one exemplary embodiment, the composite reference array is formed from two or more reference arrays of a plurality of reference arrays. The composite reference array can be formed by projecting along a prediction direction, one or more of the plurality of reference arrays onto a reference array closest to the block of the video data being encoded or decoded. The filter coefficients for the interpolation filter are then determined based on the locations of the predictors on different reference arrays. Interpolating reference samples from different reference arrays, the predictor value for a target sample can be obtained.