Intra Prediction Efficiency via Gradient-Based Mode Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image coding devices face inefficiencies in encoding efficiency despite increasing the number of directional prediction modes, as the additional computation and code amount do not proportionally improve encoding efficiency.

Innovation Solution

An image coding device that uses intra-frame prediction based on adjacent pixels or higher-layer coding blocks, and encodes flags to indicate matching prediction directions between coding blocks, reducing computation and code amount while enhancing encoding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the number of directional prediction modes is increased, then the prediction efficiency increases when edge direction matches the prediction mode direction, but the code amount and computation increase without proportional improvement in encoding efficiency

Engineering Contradiction:
Improveprediction efficiencyVSAvoidcode amount
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the prediction mode selection process into two stages: first determining whether to use directional prediction or average prediction based on gradient calculation, and then selecting the specific directional mode only if needed. This segmentation avoids computing all directional prediction modes when they are not necessary, thereby reducing code amount while maintaining prediction efficiency when edges are present.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by selectively applying directional prediction only to blocks where edge detection indicates it is beneficial. Instead of computing all directional prediction modes for every block (excessive action), the method performs gradient calculation first and only proceeds with directional prediction when the gradient threshold is exceeded, thus avoiding unnecessary computation and code overhead.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If the number of directional prediction modes is increased, then the probability that edge direction matches prediction mode direction increases, but the computation amount increases without commensurate improvement in encoding efficiency

Engineering Contradiction:
Improveprediction efficiencyVSAvoidcomputation amount
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

The patent performs preliminary gradient calculation and edge detection before selecting directional prediction modes. This preliminary action identifies blocks that actually benefit from directional prediction, allowing the system to skip computation of multiple directional modes for blocks where average prediction is sufficient, thereby reducing overall computation amount while maintaining high prediction efficiency where needed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The method performs partial computation by calculating gradients and only proceeding with directional prediction for blocks exceeding the gradient threshold. This avoids the excessive computation that would result from evaluating all directional prediction modes for every block, thus reducing computation amount while maintaining prediction efficiency for blocks where directional prediction is actually beneficial.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If conventional intra prediction modes are used for all blocks, then the encoding process is simple, but the encoding efficiency does not improve when block edges have different directions

Engineering Contradiction:
Improveencoding efficiencyVSAvoidencoding process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies local quality by using different prediction strategies for different regions: average prediction for blocks without significant edges and directional prediction for blocks with detectable edges. This localized approach improves encoding efficiency for blocks with edges while keeping the encoding process simple for blocks without edges, thus achieving better overall encoding efficiency without excessive complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces dynamic selection between average prediction and directional prediction based on gradient calculation results. This dynamic approach allows the encoding process to adapt to local characteristics of each block, improving encoding efficiency for blocks with edges while maintaining simplicity for blocks without edges, thus achieving a balance between encoding efficiency and process complexity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11831892B2Image coding device, image decoding device, image coding method, and image decoding method
Publication Date: 2023.11.28 MITSUBISHI ELECTRIC CORP
  • US11831892B2 patent drawing
  • US11831892B2 patent drawing
  • US11831892B2 patent drawing

AI summary

When a coding mode selected by an encoding controlling part 1 is an intra prediction mode, an intra prediction part 4 carries out an intra-frame prediction process using pixels adjacent to a partition Pin which is generated through a division by a block dividing part 2 or pixels adjacent to a higher layer partition Pin−1 to which the partition Pin belongs to generate a prediction image (Pin).