Inter-layer Reference Picture for Scalable Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Scalable video coding technologies, such as SVC and MVC, face limitations in compression efficiency and complexity due to reliance on inter-layer prediction modes, which can result in visual artifacts and increased computational complexity, especially when dealing with heterogeneous networks and diverse device capabilities.
Innovation Solution
A video coding system is implemented with a base layer coder, enhancement layer coder, and inter-layer prediction processing and management unit that processes the base layer picture into an inter-layer reference picture, allowing for flexible scalability types like spatial, quality, and view scalability, and packetizes inter-layer prediction information for efficient decoding across different devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If inter-layer prediction modes are used in scalable video coding, then compression efficiency is improved, but computational complexity increases
Solution Approach 1:
The video signal is segmented into multiple layers (base layer and enhancement layers), where each layer is processed independently through separate coding pipelines. This segmentation allows the system to apply inter-layer prediction selectively across layers rather than within every picture, reducing overall computational complexity while maintaining compression efficiency through layer-to-layer prediction.
2Productivity
If inter-layer prediction modes are used in scalable video coding, then compression efficiency is improved, but visual artifacts increase
Solution Approach 1:
An inter-layer reference picture is introduced as an intermediary between the base layer and enhancement layer. This intermediary serves as a prediction reference that mediates the prediction process, allowing the enhancement layer to be predicted from the base layer through a controlled transformation process. This intermediary mechanism reduces visual artifacts by providing a stable reference that bridges the two layers without direct problematic interactions.
3Adaptability or versatility
If multiple scalability types are supported, then adaptability to diverse devices is improved, but system complexity increases
Solution Approach 1:
The video coding system is designed with universal multi-functionality to support multiple scalability types (spatial, temporal, quality, and view scalability) through a unified architecture. The same base layer and enhancement layer structure can accommodate different scalability types by adjusting parameters and prediction modes, rather than requiring separate systems for each scalability type. This universal design improves adaptability to diverse devices while controlling system complexity through code reuse and standardized processing pipelines.
Data Source
AI summary
Systems, methods, and instrumentalities are provided to implement video coding system (VCS). The VCS may be configured to receive a video signal, which may include one or more layers (e.g., a base layer (BL) and/or one or more enhancement layers (ELs)). The VCS may be configured to process a BL picture into an inter-layer reference (ILR) picture, e.g., using picture level inter-layer prediction process. The VCS may be configured to select one or both of the processed ILR picture or an enhancement layer (EL) reference picture. The selected reference picture(s) may comprise one of the EL reference picture, or the ILR picture. The VCS may be configured to predict a current EL picture using one or more of the selected ILR picture or the EL reference picture. The VCS may be configured to store the processed ILR picture in an EL decoded picture buffer (DPB).