Intra-image predictor interpolation subsets

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video data encoding and decoding systems, such as High Efficiency Video Coding (HEVC), face challenges in efficiently predicting and interpolating samples across regions of images, particularly in selecting appropriate prediction operations and interpolation processes for subsets of samples, which affects compression efficiency and image quality.

Innovation Solution

An image encoding and decoding apparatus that selects a prediction operation from a set of candidate operations based on prediction direction and applies different interpolation processes for various subsets of samples within an image region, using an intra-image predictor to generate predicted samples from reference samples, thereby optimizing the interpolation process according to the relationship between interpolation processes and sample positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a single interpolation process is applied to all predicted samples, then the device complexity is reduced, but the image quality and compression efficiency deteriorate

Engineering Contradiction:
Improveimage qualityVSAvoidinterpolation process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the current image region into multiple subsets of predicted samples based on their positions. Different interpolation processes are applied to different subsets, allowing the system to achieve high image quality where needed while maintaining reasonable complexity. Specifically, samples closer to reference samples may use simpler interpolation while distant samples use more complex processes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies the principle of local quality by selecting different interpolation processes for different spatial locations within the image region. Samples at different positions relative to reference samples receive tailored interpolation treatment, ensuring optimal quality for each local area rather than applying a uniform process throughout.

Inventive Principle:
Principle #3Local quality

2Productivity

If multiple interpolation processes are applied to different subsets of samples, then the compression efficiency is improved, but the device complexity increases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidinterpolation process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the image region into subsets based on sample positions, enabling differentiated interpolation strategies. This segmentation allows the encoder to optimize compression efficiency for each subset while the decoder can efficiently reconstruct using the same segmentation logic, balancing complexity and performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameters of the interpolation process based on the position of samples within the image region. By adjusting interpolation parameters according to sample locations relative to reference samples, the system achieves better compression efficiency without requiring entirely different interpolation algorithms for each subset.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If reference samples are selected based on prediction direction, then the prediction accuracy is improved, but the computational complexity of selecting and processing reference samples increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidreference sample processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary selection of reference samples based on prediction direction before the actual interpolation process. By pre-identifying which reference samples to use for each predicted sample based on the prediction direction, the system reduces the computational complexity during the main interpolation phase while maintaining high prediction accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12047602B2Image data encoding and decoding
Publication Date: 2024.07.23 SONY GROUP CORP
  • US12047602B2 patent drawing
  • US12047602B2 patent drawing
  • US12047602B2 patent drawing

AI summary

An image encoding apparatus comprises a selector configured to select, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples; and an intra-image predictor configured to interpolate predicted samples of the current region with respect to one or more of a group of reference samples being samples decoded from previously encoded samples of the current image, the group of reference samples being selected in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples, in which the intra-image predictor is configured to apply an interpolation process to the group of reference samples in order to generate each predicted sample; in which the intra-image predictor is configured to apply a different respective interpolation process for a plurality of subsets of the predicted samples, according to a relationship between a plurality of interpolation processes and a corresponding plurality of subsets of sample positions in the array of samples.