Inter-layer Prediction Using Enhanced Reference for Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding systems face inefficiencies in inter-layer prediction due to the limitations of inter-layer reference pictures, which lack high frequency information, leading to reduced prediction accuracy and coding efficiency in enhancement layer coding.
Innovation Solution
The use of an enhanced inter-layer reference (EILR) picture is introduced, generated by combining high frequency information from an inter-layer motion compensated picture processed with a high pass filter and low frequency information from the inter-layer reference picture processed with a low pass filter, to improve prediction accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If inter-layer reference picture is used for prediction, then coding efficiency is improved, but prediction accuracy deteriorates due to loss of high frequency information
Solution Approach 1:
The prediction process is segmented into two distinct paths: one for extracting high frequency information via high pass filtering, and another for extracting low frequency information via low pass filtering. This segmentation allows each path to optimize for its specific frequency range, resolving the contradiction by preserving both coding efficiency (through selective filtering) and prediction accuracy (through complementary frequency information combination).
Solution Approach 2:
The enhanced inter-layer reference picture is created by combining filtered versions of reference pictures, analogous to composite materials. The high pass filtered picture contributes high frequency components while the low pass filtered picture contributes low frequency components, creating a composite reference that maintains both the compression benefits and the prediction accuracy needed for enhancement layer coding.
2Loss of information
If inter-layer motion compensated picture is used, then high frequency information is preserved, but device complexity increases due to additional filtering operations
Solution Approach 1:
Different quality processing is applied to different frequency components of the reference picture. High frequency components are preserved through high pass filtering while low frequency components are processed through low pass filtering. This local quality approach ensures that each frequency band receives appropriate processing, preserving high frequency information without uniformly increasing complexity across all picture data.
Solution Approach 2:
The filtering operations change key parameters of the reference picture data - specifically frequency domain characteristics. By applying high pass and low pass filters with specific cutoff frequencies and characteristics, the system transforms the reference picture into frequency-separated versions, preserving high frequency information while managing complexity through parameterized filter design.
Data Source
AI summary
Systems, methods, and instrumentalities are disclosed for increasing the efficiency of inter-layer prediction using an enhanced inter-layer reference (EILR) picture as a reference picture for inter-layer prediction for encoding an enhancement layer. A luminance component and chrominance components of an inter-layer reference (ILR) picture may be enhanced. High frequency information may be obtained by processing an inter-layer motion compensated (ILMC) picture with a high pass filter. Low frequency information may be obtained by processing an ILR picture with a low pass filter. The EILR picture may be generated as a function of the high frequency information, the low frequency information, and/or the ILR picture.


