Inter-layer Prediction Using Enhanced Reference for Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding systems face inefficiencies in inter-layer prediction due to the limitations of inter-layer reference pictures, which lack high frequency information, leading to reduced prediction accuracy and coding efficiency in enhancement layer coding.

Innovation Solution

The use of an enhanced inter-layer reference (EILR) picture is introduced, generated by combining high frequency information from an inter-layer motion compensated picture processed with a high pass filter and low frequency information from the inter-layer reference picture processed with a low pass filter, to improve prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If inter-layer reference picture is used for prediction, then coding efficiency is improved, but prediction accuracy deteriorates due to loss of high frequency information

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprediction accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The prediction process is segmented into two distinct paths: one for extracting high frequency information via high pass filtering, and another for extracting low frequency information via low pass filtering. This segmentation allows each path to optimize for its specific frequency range, resolving the contradiction by preserving both coding efficiency (through selective filtering) and prediction accuracy (through complementary frequency information combination).

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The enhanced inter-layer reference picture is created by combining filtered versions of reference pictures, analogous to composite materials. The high pass filtered picture contributes high frequency components while the low pass filtered picture contributes low frequency components, creating a composite reference that maintains both the compression benefits and the prediction accuracy needed for enhancement layer coding.

Inventive Principle:
Principle #40Composite materials

2Loss of information

If inter-layer motion compensated picture is used, then high frequency information is preserved, but device complexity increases due to additional filtering operations

Engineering Contradiction:
Improvehigh frequency information preservationVSAvoidfiltering operation complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Different quality processing is applied to different frequency components of the reference picture. High frequency components are preserved through high pass filtering while low frequency components are processed through low pass filtering. This local quality approach ensures that each frequency band receives appropriate processing, preserving high frequency information without uniformly increasing complexity across all picture data.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The filtering operations change key parameters of the reference picture data - specifically frequency domain characteristics. By applying high pass and low pass filters with specific cutoff frequencies and characteristics, the system transforms the reference picture into frequency-separated versions, preserving high frequency information while managing complexity through parameterized filter design.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10148971B2Inter-layer prediction for scalable video coding
Publication Date: 2018.12.04 INTERDIGITAL MADISON PATENT HLDG
  • US10148971B2 patent drawing
  • US10148971B2 patent drawing
  • US10148971B2 patent drawing

AI summary

Systems, methods, and instrumentalities are disclosed for increasing the efficiency of inter-layer prediction using an enhanced inter-layer reference (EILR) picture as a reference picture for inter-layer prediction for encoding an enhancement layer. A luminance component and chrominance components of an inter-layer reference (ILR) picture may be enhanced. High frequency information may be obtained by processing an inter-layer motion compensated (ILMC) picture with a high pass filter. Low frequency information may be obtained by processing an ILR picture with a low pass filter. The EILR picture may be generated as a function of the high frequency information, the low frequency information, and/or the ILR picture.