Image Predictive Decoding Motion Information Candidate Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In video encoding, the selection of motion information for prediction blocks is not optimized, leading to inefficient coding due to the inclusion of motion information from neighboring blocks that are not suitable, resulting in suboptimal prediction signals and increased encoding costs.

Innovation Solution

An image predictive decoding method that selects candidates for motion information based on previously-encoded or decoded prediction information of the target coding block and surrounding blocks, optimizing the use of motion information for more efficient encoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion information from all neighboring blocks is used as candidates for prediction blocks, then the prediction signal accuracy may improve, but the encoding complexity and code amount increase due to selecting from more candidates

Engineering Contradiction:
Improveprediction signal accuracyVSAvoidencoding complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the set of neighboring blocks into different categories based on their spatial relationships with the current block. Specifically, it identifies blocks in the same picture (spatial neighbors) versus blocks in different pictures (temporal neighbors), and applies different selection rules for each category. This segmentation allows the decoder to efficiently select motion information candidates without considering all possible neighboring blocks, thereby reducing encoding complexity while maintaining prediction accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by treating different neighboring blocks differently based on their specific spatial and temporal relationships with the current block. Instead of using a uniform selection criterion for all neighbors, the method prioritizes blocks that are locally more relevant (e.g., adjacent spatial blocks in the same picture) over distant or less relevant blocks. This localized approach optimizes the candidate selection process by focusing computational resources on the most promising candidates.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If motion information from blocks in different pictures is included as candidates, then the adaptability of prediction increases, but the decoding complexity increases due to need for reference picture management

Engineering Contradiction:
Improveprediction adaptabilityVSAvoiddecoding complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-organizing and managing reference pictures before the actual prediction process. The decoder maintains a structured set of reference pictures with known identifiers and temporal relationships. When selecting motion information candidates, the decoder only needs to reference this pre-organized structure rather than dynamically managing all possible reference frames. This preliminary organization significantly reduces the complexity of handling inter-picture prediction while preserving the ability to adapt to different prediction scenarios.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If all neighboring blocks are considered for motion information selection, then the coding efficiency may improve, but the processing time increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies partial action by selecting a subset of the most relevant neighboring blocks as motion information candidates, rather than exhaustively processing all neighboring blocks. The method identifies and prioritizes a limited number of key candidates based on their spatial and temporal proximity to the current block. This partial selection approach achieves good prediction efficiency by focusing on the most influential candidates, while avoiding the excessive processing time that would result from evaluating all possible neighbors.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3661210B1Image predictive decoding method
Publication Date: 2023.08.09 NTT DOCOMO INC
  • EP3661210B1 patent drawingFigure 1
  • EP3661210B1 patent drawingFigure 2(A)~2(B)
  • EP3661210B1 patent drawingFigure 3(A)~3(B)

AI summary

In an embodiment, an encoding target region in an image is partitioned into a plurality of prediction regions. Based on prediction information of a neighboring region neighboring a target region, the number of previously-encoded prediction regions in the target region, and previously-encoded prediction information of the target region, a candidate for motion information to be used in generation of a predicted signal of the target prediction region as a next prediction region is selected from previously-encoded motion information of regions neighboring the target prediction region. According to the number of candidates for motion information selected, merging block information to indicate generation of the predicted signal of the target prediction region using the selected candidate for motion information and motion information detected by prediction information estimation means, or either one of the merging block information or the motion information is encoded. In addition, the motion information to be used in generation of the predicted signal of the target prediction region is stored into prediction information storage means.