3D-HEVC Advanced Residual Prediction Motion Vector Reuse

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D video coding techniques face increased complexity and inefficiency due to the need to assess multiple reference blocks for bi-directional prediction, particularly in advanced residual prediction (ARP) methods, which can lead to higher computational demands and reduced coding performance.

Innovation Solution

The implementation of advanced residual prediction (ARP) techniques in 3D-HEVC, including the reuse of motion vectors for prediction directions and selective application of ARP based on block size for chroma components, to simplify the prediction process and reduce overall coding complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If advanced residual prediction (ARP) mode is used for bi-directional prediction, then prediction accuracy is improved, but computational complexity increases due to assessing multiple reference blocks

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the reference block assessment process by identifying and assessing only specific candidate reference blocks based on motion vector relationships, rather than assessing all possible reference blocks. This segmentation reduces the number of assessments while maintaining prediction accuracy for bi-directional prediction in ARP mode.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by selectively performing reference block assessment only when certain conditions are met (e.g., when motion vectors indicate specific spatial or temporal relationships), rather than universally assessing all reference blocks for every bi-directional prediction, thus reducing overall computational complexity.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If multiple reference blocks are assessed for bi-directional prediction, then prediction quality is improved, but coding efficiency decreases due to higher computational demands

Engineering Contradiction:
Improveprediction qualityVSAvoidcoding efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies local quality by differentiating the reference block assessment process based on local characteristics such as block size, motion vector magnitude, and prediction direction. Different numbers of reference blocks are assessed depending on these local conditions, optimizing prediction quality where needed while maintaining coding efficiency elsewhere.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes parameters such as the number of reference blocks to assess, the assessment threshold, and the selection criteria based on block size and motion information. These parameter changes allow the system to adapt between prediction quality and coding efficiency requirements for different video content scenarios.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If ARP is applied to all block types, then prediction performance is improved, but coding complexity increases

Engineering Contradiction:
Improveprediction performanceVSAvoidcoding complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by selectively applying ARP to specific block types (e.g., luma blocks of certain sizes, chroma blocks meeting specific criteria) rather than uniformly applying it to all blocks. This selective application maintains prediction performance for critical blocks while reducing coding complexity for less critical blocks.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent uses partial action by applying ARP only to blocks where it provides significant benefit, determined by block size thresholds and type-specific criteria. This partial application avoids the excessive complexity of universal ARP while maintaining adequate prediction performance across different block types.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10574965B2Simplified advanced residual prediction for 3D-HEVC
Publication Date: 2020.02.25 QUALCOMM INC
  • US10574965B2 patent drawing
  • US10574965B2 patent drawing
  • US10574965B2 patent drawing

AI summary

This disclosure describes techniques for 3D video coding. In particular, this disclosure is related to techniques for advanced residual prediction (ARP) in 3D-HEVC. According to one techniques of this disclosure, when performing inter-view ARP for a bi-directionally predicted block, the video coder may determine a motion vector for a first corresponding block as part of performing ARP for a first prediction direction and reuse that determined motion vector when performing ARP for a second prediction direction. According to another technique, for a bi-directionally predicted block, a video coder may apply ARP in only one direction for a chroma component of a block but apply ARP in two directions for a luma component of the block. According to another technique, a video coder may selectively apply ARP to chroma components based on block size. These simplifications, as well as other techniques included in this disclosure, may reduce overall coding complexity.