Inter-layer Texture Prediction for Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current scalable video coding techniques face challenges in efficiently utilizing inter-layer correlation for improved coding efficiency, particularly in combining predictors from base and enhancement layers for accurate texture prediction, especially near borders and varying quantization parameters.
Innovation Solution
The method involves determining weights for base and enhancement layer predictors based on the distance from the border and quantization parameters, combining them to form a final predictor that adapts weighting for each pixel location, ensuring accurate inter-layer texture prediction by prioritizing predictors based on their proximity and accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single fixed weight is used for base layer predictor across all pixel locations, then the encoding complexity is reduced, but the prediction accuracy deteriorates especially near borders
Solution Approach 1:
The patent applies local quality by using different weight values for base layer predictors at different pixel locations. Specifically, pixels closer to block borders use different weights compared to pixels in the center, allowing the prediction to adapt to local characteristics and improve accuracy without uniformly increasing complexity across the entire block.
Solution Approach 2:
The patent introduces dynamic weighting where the weight for base layer predictors varies based on the distance from block borders. This dynamic approach allows the system to adaptively adjust prediction weights according to spatial position, improving prediction accuracy while maintaining a relatively simple encoding structure through predefined weight relationships.
2Productivity
If base layer predictor is heavily weighted for all pixels, then coding efficiency is improved through better inter-layer correlation, but accuracy near borders deteriorates due to discontinuities
Solution Approach 1:
The patent implements local quality by applying different weight strategies to different spatial regions. In border regions, the base layer predictor weight is reduced to avoid discontinuities and artifacts, while in central regions, the base layer predictor weight is increased to exploit inter-layer correlation and improve coding efficiency. This spatially adaptive weighting resolves the contradiction between overall efficiency and local accuracy.
3Device complexity
If inter-layer prediction is used without adaptive weighting, then the encoding process is simplified, but prediction accuracy deteriorates under varying quantization conditions
Solution Approach 1:
The patent applies parameter changes by adjusting the weight of base layer predictors based on quantization parameter (QP) values. When QP differences between layers are large, the base layer predictor weight is reduced to maintain accuracy, while when QP differences are small, the weight is increased to improve coding efficiency. This parameter-adaptive approach maintains reasonable complexity while improving accuracy under varying quantization conditions.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An apparatus for coding video information according to certain aspects is disclosed. Multi-layer video steams including a base layer and an enhancement layer can be coded. Predictors generated for the base layer and the enhancement layer can be combined to form a final predictor of the enhancement layer. Each predictor can be weighted such that those predictors which are more likely to produce high quality results can be factored more heavily in the final predictor. The conditions upon which the respective weights for enhancement layer predictors and base layer predictors are determined may be implicitly derived from the predictors or characteristics thereof. Alternatively, data may be generated explicating indicating the weights or providing information from which the weights can be determined.