Constrained Inter-Image Prediction for Screen Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video data compression systems face high computational complexity in implementing inter-prediction for screen content sequences, which achieves high compression ratios but is resource-intensive.

Innovation Solution

A constrained inter-image prediction mode is introduced, where the number of candidate block positions and reference images is reduced, allowing for a simpler prediction process by fixing the motion vector and reference index at zero, thereby reducing computational complexity without significant loss in compression performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If inter-prediction is applied to screen content sequences, then compression ratio is improved, but computational complexity increases substantially

Engineering Contradiction:
Improvebit rateVSAvoidcomputational complexity
Core Design Contradiction:
Loss of substanceVSDevice complexity

Solution Approach 1:

The patent changes the parameters of inter-prediction by fixing the motion vector to (0,0) and limiting reference image selection, transforming the complex inter-prediction process into a simpler constrained mode that maintains compression efficiency while reducing computational burden

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies a partial form of inter-prediction by constraining the motion vector to specific values and limiting reference image candidates, achieving sufficient compression for screen content without the full computational overhead of general inter-prediction

Inventive Principle:
Principle #16Partial or excessive action

2Device complexity

If the number of candidate block positions and reference images is reduced, then computational complexity is decreased, but prediction accuracy may deteriorate

Engineering Contradiction:
Improvecomputational complexityVSAvoidprediction accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent changes the search parameters by fixing motion vector to (0,0) and limiting reference image candidates, which reduces computational complexity while maintaining sufficient prediction accuracy for screen content sequences characterized by temporal redundancy

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies different prediction strategies to different content types by using constrained inter-prediction specifically for screen content sequences, where temporal redundancy makes this simplified approach effective without sacrificing overall prediction quality

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11284105B2Data encoding and decoding
Publication Date: 2022.03.22 SONY GROUP CORP
  • US11284105B2 patent drawing
  • US11284105B2 patent drawing
  • US11284105B2 patent drawing

AI summary

A method encoding image data including: encoding the image data by an inter-image predictor in which a block of one or more samples of a current image is predicted from a reference block of samples located at one of a number of candidate block positions in a reference image; and selectively applying a constrained inter-image prediction mode in which, in comparison to an inter-image prediction mode for the encoding, one or both of the number of candidate block positions and the number of candidate reference images is reduced.