Adaptive Inter-Layer Filters for Scalable Video Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D video systems face challenges in delivering full resolution stereoscopic content without degrading user experience, as subsampling reduces frame resolution and introduces issues like aliasing, and current compression methods do not efficiently utilize the correlation between base and enhancement layers for improved coding performance.
Innovation Solution
A multi-layered video encoding system that includes a base layer and one or more enhancement layers, with an encoder processing module filtering the base layer output to form a processed encoder output used as an enhancement layer estimate, and a decoder processing module reconstructing the enhancement layer using adaptive filters derived from previous signals stored in buffers, optimizing filter selection based on coding criteria to minimize distortion and bit overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If subsampling is used to reduce frame resolution for compression, then bit overhead is reduced, but video quality deteriorates due to aliasing and resolution loss
Solution Approach 1:
The video signal is divided into multiple layers (base layer and enhancement layers) with different resolution levels. The base layer contains the most important visual information at lower resolution, while enhancement layers add finer details. This segmentation allows the system to transmit essential content efficiently while optionally providing high quality when needed.
Solution Approach 2:
The patent introduces a quality dimension to the traditional binary choice between low and high resolution. By adding enhancement layers that carry additional detail information, the system creates a multi-dimensional quality spectrum, allowing receivers to access various quality levels based on their capabilities and network conditions.
2Adaptability or versatility
If base layer and enhancement layer are encoded separately, then coding flexibility is improved, but correlation between layers is not fully utilized for compression efficiency
Solution Approach 1:
The base layer is encoded first and stored in a buffer, then used as reference material for encoding the enhancement layer. This preliminary encoding of the base layer enables the encoder to exploit inter-layer correlations when processing enhancement layer data, improving compression efficiency while maintaining the flexibility of separate encoding.
Solution Approach 2:
The base layer output is fed back into the enhancement layer encoding process as reference information. This feedback mechanism allows the enhancement layer encoder to leverage the already-coded base layer data, reducing the information that needs to be transmitted in the enhancement layer and improving overall compression efficiency.
3Measurement precision
If adaptive filters are derived and applied to enhance prediction accuracy, then coding performance is improved, but processing complexity and bit overhead increase
Solution Approach 1:
The system dynamically adjusts filter parameters based on the statistical characteristics of the video data. By adapting filter coefficients to match the actual content being processed, the system achieves high prediction accuracy without requiring complex fixed-structure filters, thus improving performance while controlling processing complexity.
Data Source
AI summary
Adaptive interpolation filters for multi-layered video delivery are described. Combinations of such adaptive filters with other pre-processing steps in the context of frame or 2D compatible 3D and 2D scalable video delivery system are also addressed.