Interlayer Video Decoding Using Sub-pixel Disparity Vectors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video codecs face challenges in effectively encoding and decoding high-resolution video content due to limitations in predicting images using macroblocks of predetermined sizes, which do not adequately leverage the spatial and temporal correlations within video data.

Innovation Solution

The method involves using a disparity vector with sub-pixel components for interlayer prediction between images in different layers, determining the position of an integer pixel in the reference layer corresponding to the disparity vector, and decoding the current layer using prediction information from the candidate area of the reference layer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If conventional video codecs use macroblocks of predetermined size for encoding, then the encoding process is simplified and hardware implementation is easier, but the prediction accuracy for high-resolution video content deteriorates

Engineering Contradiction:
Improveencoding simplicityVSAvoidprediction accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent divides the current block into multiple sub-blocks and performs separate prediction for each sub-block using different reference blocks from the reference layer. This segmentation allows the system to capture local variations in high-resolution video content more effectively, improving prediction accuracy while maintaining a systematic encoding approach that is implementable in hardware.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different prediction strategies to different sub-blocks based on their local characteristics. By selecting reference blocks locally for each sub-block rather than using a uniform approach for the entire block, the system adapts to local variations in the video content, thereby improving overall prediction accuracy for high-resolution content.

Inventive Principle:
Principle #3Local quality

2Device complexity

If video content is encoded using limited encoding methods based on predetermined macroblocks, then device complexity is reduced, but the ability to effectively encode high-resolution video content deteriorates

Engineering Contradiction:
Improveencoding method complexityVSAvoidhigh-resolution video encoding efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent extends the prediction process from a single layer to multiple layers by utilizing both current layer blocks and reference layer blocks. This inter-layer prediction approach adds a dimensional aspect to the encoding process, enabling more effective compression of high-resolution video content by leveraging correlations between different layers while maintaining manageable device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If sub-pixel disparity vectors are used for interlayer prediction, then prediction precision is improved, but the complexity of determining reference pixel positions increases

Engineering Contradiction:
Improveprediction precisionVSAvoidposition determination complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary rounding of sub-pixel disparity vector components to obtain integer pixel positions before using them to access reference blocks. This preliminary action simplifies the subsequent processing by converting fractional coordinates into discrete pixel positions that can be directly used for block extraction, thereby reducing the overall complexity of the system while maintaining sub-pixel level prediction precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10469866B2Method and apparatus for encoding and decoding video with respect to position of integer pixel
Publication Date: 2019.11.05 SAMSUNG ELECTRONICS CO LTD
  • US10469866B2 patent drawing
  • US10469866B2 patent drawing
  • US10469866B2 patent drawing

AI summary

Disclosed is a video decoding method including: obtaining a disparity vector having components in sub-pixel unit for interlayer prediction between images belonging to a current layer and a reference layer; determining a position of an integer pixel of the reference layer corresponding to a position indicated by the disparity vector obtained from the position of a current pixel of the current layer; and decoding the image of the current layer by using prediction information on a candidate area of the reference layer corresponding to the determined position of the integer pixel.