Inter-layer residual prediction for scalable video coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional Scalable Video Coding (SVC) approaches limit inter-layer prediction to within the same layer, restricting coding efficiency and flexibility by not allowing prediction from lower layer pictures, which hampers the performance of High Efficiency Video Coding (HEVC) systems.
Innovation Solution
Implementing inter-layer residual prediction by reusing residual data from a reference layer, allowing enhancement layer encoders and decoders to predict using residuals from both lower and same-layer pictures, and employing upsampling and refining filters to enhance prediction accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional intra-layer prediction is used for enhancement layer, then layer structure simplicity is maintained, but coding efficiency is limited
Solution Approach 1:
The patent extends prediction from the traditional intra-layer dimension to an inter-layer dimension by introducing cross-layer prediction mechanisms. Enhancement layer blocks can now be predicted from both same-layer and lower-layer reference blocks, creating a multi-dimensional prediction structure that improves coding efficiency while managing complexity through selective application.
Solution Approach 2:
The prediction process is segmented into multiple modes: intra-layer prediction for maintaining simplicity and inter-layer prediction for improving efficiency. The encoder can selectively apply different prediction modes to different blocks based on their characteristics, allowing flexibility in balancing complexity and efficiency requirements.
2Loss of energy
If inter-layer residual prediction is implemented, then compression performance is improved, but processing complexity increases
Solution Approach 1:
The patent performs preliminary actions by first identifying suitable candidate blocks from lower layers and calculating their residuals before the actual encoding process. This pre-processing allows the encoder to evaluate potential prediction benefits and select the most effective candidates, reducing the complexity burden during main encoding while achieving improved compression performance.
Solution Approach 2:
Residual data from lower layers serves as an intermediary element that bridges the gap between base layer and enhancement layer. By using these pre-computed residuals as prediction inputs, the system reduces the processing complexity at the enhancement layer while still achieving improved compression through cross-layer information utilization.
3Adaptability or versatility
If prediction from lower layer pictures is allowed, then coding flexibility is enhanced, but computational requirements increase
Solution Approach 1:
The patent implements dynamic prediction mode selection where the encoder can adaptively choose between intra-layer and inter-layer prediction based on block characteristics, content complexity, and rate-distortion considerations. This dynamic approach enhances coding flexibility by allowing the system to adapt to different scenarios while managing computational requirements through intelligent selection rather than exhaustive processing.
Data Source
AI summary
Systems, devices and methods are described including performing scalable video coding using inter-layer residual prediction. Inter-layer residual prediction in an enhancement layer coding unit, prediction unit, or transform unit may use residual data obtained from a base layer or from a lower enhancement layer. The residual may be subjected to upsample filtering and/or refinement filtering. The upsample or refinement filter coefficients may be predetermined or may be adoptively determined.