Interlayer Video Disparity Vector Prediction Using Depth Map Fallback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video codecs face challenges in effectively encoding and decoding high-resolution video content, particularly in determining disparity vectors for interlayer prediction, which affects encoding performance and accuracy.

Innovation Solution

The proposed method determines a disparity vector using a default disparity vector and a reference layer depth map when it is not predictable from peripheral blocks, improving encoding performance and accuracy by utilizing a default disparity vector and a reconstructed depth map.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If disparity vector is predicted from peripheral blocks, then encoding complexity is reduced, but prediction accuracy deteriorates when peripheral blocks are unavailable or unreliable

Engineering Contradiction:
Improveencoding complexityVSAvoiddisparity vector prediction accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces a fallback mechanism using reference layer depth map and default disparity vector as an intermediary solution when peripheral block prediction fails. This mediator provides a reliable alternative prediction method that maintains accuracy without permanently increasing complexity, as it only activates when needed.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent dynamically changes the prediction method based on availability of peripheral blocks. When peripheral blocks are unavailable, the system switches from peripheral block-based prediction to depth map-based prediction with default disparity vector, adapting parameters according to current encoding conditions.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If default disparity vector and depth map are used for prediction, then prediction accuracy is improved, but encoding complexity increases

Engineering Contradiction:
Improvedisparity vector prediction accuracyVSAvoidencoding complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies depth map-based prediction partially, only when peripheral blocks are unavailable or unreliable. This partial application of the more complex method avoids unnecessary computational overhead while maintaining accuracy where needed, balancing complexity and precision.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system uses available information (reference layer depth map and default disparity vector) to serve itself when external information (peripheral blocks) is unavailable. This self-service mechanism ensures continuous operation with accurate prediction without requiring additional external resources.

Inventive Principle:
Principle #25Self-service

3Productivity

If peripheral blocks are used for disparity vector prediction, then encoding speed is maintained, but reliability deteriorates when blocks are unavailable

Engineering Contradiction:
Improveencoding speedVSAvoidprediction reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent prepares alternative prediction methods (depth map-based prediction with default disparity vector) in advance as a cushion against potential failure of peripheral block prediction. This prior preparation ensures reliability without affecting normal encoding speed, as the alternative is ready when needed.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The system implements feedback by checking the availability and reliability of peripheral blocks before using them for prediction. Based on this feedback, it dynamically selects the appropriate prediction method, ensuring both speed and reliability by using the fastest reliable method available.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9894377B2Method for predicting disparity vector for interlayer video decoding and encoding apparatus and method
Publication Date: 2018.02.13 SAMSUNG ELECTRONICS CO LTD
  • US9894377B2 patent drawing
  • US9894377B2 patent drawing
  • US9894377B2 patent drawing

AI summary

An interlayer video decoding method and apparatus and an interlayer video encoding method and apparatus are provided. The decoding method includes: reconstructing, based on encoding information obtained from a bitstream, a first layer image and a first layer depth map; determining whether a disparity vector is predictable using peripheral blocks of a second layer current block; and when the disparity vector is not predictable using the peripheral blocks, determining a disparity vector of the second layer current block using a default disparity vector and the reconstructed first layer depth map.