Image Encoding Zone Segmentation IBC Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding and decoding methods, such as those used in AVC and HEVC, face inefficiencies due to the increased computational resources and signaling costs associated with the Intra Block Copy (IBC) prediction mode, which also requires excessive memory storage for image data.

Innovation Solution

The method involves dividing an image into two distinct zones, where only one zone uses the IBC prediction mode, reducing computational complexity and memory storage by not applying IBC to the other zone and only storing data for one zone, with location information transmitted to the decoder to locate blocks in the other zone.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the IBC prediction mode is applied to all blocks in the image, then the coding performance is improved, but the computational complexity and memory storage requirements increase significantly

Engineering Contradiction:
Improvecoding performanceVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The image is divided into two distinct zones: a first zone where IBC prediction mode is applied to improve coding performance, and a second zone where conventional prediction modes are used to reduce computational complexity. This spatial segmentation allows the system to apply the computationally intensive IBC mode only where beneficial while using simpler modes elsewhere, thus resolving the contradiction between coding performance and computational complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different prediction modes are applied to different regions of the image based on local characteristics. The first zone (where IBC is applied) and second zone (where conventional prediction is used) are distinguished by their coding requirements. This local differentiation allows optimal coding performance in regions benefiting from IBC while maintaining efficiency in regions where it is less beneficial.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If the IBC prediction mode is applied to all blocks, then the coding performance is improved, but the memory storage requirements increase due to storing all image data

Engineering Contradiction:
Improvecoding performanceVSAvoidmemory storage
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The image is segmented into two zones with different storage requirements. Only blocks in the first zone require storage of decoded block data for IBC prediction, while blocks in the second zone use conventional prediction modes that do not require storing all image data. This reduces the total memory storage requirement compared to applying IBC to the entire image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The memory storage requirement is optimized by applying different storage strategies to different regions. The first zone requires storage of decoded block data to enable IBC prediction, while the second zone uses conventional prediction that requires minimal or no storage of previously decoded blocks. This local differentiation reduces overall memory consumption while maintaining coding performance where IBC is beneficial.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If the IBC prediction mode is applied to all blocks, then the coding performance is improved, but the signaling cost increases due to encoding specific syntax elements

Engineering Contradiction:
Improvecoding performanceVSAvoidsignaling cost
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The image is divided into zones with different prediction mode requirements. Syntax elements specific to IBC prediction mode are encoded only for blocks in the first zone, while blocks in the second zone use conventional prediction modes with different (and fewer) syntax elements. This reduces the total signaling cost compared to applying IBC syntax elements to all blocks throughout the image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The signaling approach is optimized locally for different regions. In the first zone, IBC-specific syntax elements are encoded to enable the prediction mode. In the second zone, conventional prediction syntax elements are used which have lower signaling overhead. This local differentiation reduces the overall signaling cost while maintaining coding performance in regions where IBC provides benefits.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3649778B1Method for encoding and decoding images, encoding and decoding device, and corresponding computer programs
Publication Date: 2024.07.24 ORANGE SA
  • EP3649778B1 patent drawingFigure 1
  • EP3649778B1 patent drawingFigure 2
  • EP3649778B1 patent drawingFigure 3A~3C

AI summary

The invention relates to the encoding of an image (ICj) divided into blocks, said image containing two separate zones (Z1,Z2). Said encoding method is characterised in that it implements the following: only in the event where the current block (Bu) pertains to one (Z1) of the zones of the image: encoding (C8a) the current block using a prediction, the current block being predicted using a previously encoded and then decoded block located in the other zone of the image, the blocks of said other zone having been previously encoded and then decoded, and encoding (C100a)) information (ibc_flag) indicating the application of said prediction; and for any decoded block pertaining to the other (Z2) zone of the image, storing (C101b)) the decoded block data.