Disparity Vector Alignment for 3D Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional 3D video coding systems face issues where derived disparity vectors (DV) are associated with reference views different from the selected reference views, leading to incorrect usage of reference data in tools like TIVC, DIVC, IVRP, and VSP, especially when inter-view reference pictures other than the base view are allowed.

Innovation Solution

The solution involves aligning reference information by modifying the selected reference view or the derived DV, using techniques such as scaling the DV or converting depth values to match the selected reference view, ensuring that the reference view index aligns with the view index of the depth block, thereby correcting the reference data usage in DV derivation processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If disparity vectors are derived using conventional methods without aligning reference view indices, then the coding process is simpler and faster, but the reference data usage becomes incorrect leading to poor coding performance

Engineering Contradiction:
Improvecoding performanceVSAvoidcomplexity of DV derivation process
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing reference view alignment before using disparity vectors in coding tools. The method checks whether the reference view index of a derived DV matches the required reference view index, and if not, it converts the DV to the correct reference view beforehand. This ensures that when DVs are used in TIVC, DIVC, IVRP, or VSP tools, the reference data is correctly aligned, preventing coding errors and improving performance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent employs parameter changes by modifying the reference view index parameter of disparity vectors. When a DV is derived with a reference view index that differs from the required index, the patent converts the DV by adjusting its reference view index parameter to match the required view. This parameter transformation ensures correct reference data usage while maintaining the efficiency of inter-view prediction.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If inter-view reference pictures other than the base view are allowed, then the adaptability of the coding system is improved, but the risk of reference view mismatch and incorrect data usage increases

Engineering Contradiction:
Improveflexibility in reference picture selectionVSAvoidaccuracy of reference data usage
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements feedback by continuously checking whether the reference view index of a derived disparity vector matches the required reference view index before using it in coding tools. This feedback mechanism detects potential mismatches and triggers a conversion process to align the reference views, ensuring that the increased adaptability of selecting various inter-view reference pictures does not compromise the accuracy of reference data usage.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10244259B2Method and apparatus of disparity vector derivation for three-dimensional video coding
Publication Date: 2019.03.26 HFI INNOVATION INC
  • US10244259B2 patent drawing
  • US10244259B2 patent drawing
  • US10244259B2 patent drawing

AI summary

A method and apparatus of three-dimensional/multi-view coding using aligned reference information are disclosed. The method operates by receiving input data associated with a current block of a current frame in a dependent view, determining a first DV (Disparity Vector) from one or more neighboring blocks of the current block, wherein the first DV refers to a first reference view to derive first reference information, selecting a second reference view for the current block to derive second reference information, aligning the first reference information associated with the first reference view with the second reference information associated with the second reference view, and applying inter-view encoding or decoding to the input data utilizing the first DV or the second reference information after applying said aligning the first reference information with the second reference information.