Scalable Video Coding Base Layer Exploitation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards, such as HEVC, lack spatial and quality scalability, which limits their adaptability to varying network conditions and device capabilities, and there is a need for improved efficiency and flexibility in scalable video coding.
Innovation Solution
The method exploits Base Layer information to enhance Enhancement Layer coding by reusing CU structure, mode, motion, and residual information, as well as applying advanced filtering techniques to improve coding efficiency and adaptability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If HEVC is used without scalability, then coding efficiency is improved, but adaptability to different network conditions and device capabilities deteriorates
Solution Approach 1:
The video bitstream is segmented into multiple scalability layers (base layer and enhancement layers), each containing specific coding information. The base layer contains essential coding data for low-resolution video, while enhancement layers add additional detail for higher resolutions. This segmentation allows the system to maintain high coding efficiency in the base layer while providing adaptability through selective delivery of enhancement layers based on network conditions and device capabilities.
Solution Approach 2:
The scalability layers are nested within each other, where the base layer is contained within the enhancement layer, which in turn contains the base layer information. This nested structure enables progressive enhancement of video quality and resolution without requiring complete re-encoding, thus maintaining coding efficiency while improving adaptability to different transmission conditions.
2Device complexity
If a single fixed-resolution video stream is transmitted, then device complexity is reduced, but adaptability to different display capabilities deteriorates
Solution Approach 1:
The video stream structure is made dynamic through the scalability layers, allowing the effective resolution and quality to be adjusted based on display capabilities. The base layer provides a dynamic foundation that can be enhanced with additional layers depending on the display device's capabilities, enabling adaptability without requiring multiple separate fixed-resolution streams.
Solution Approach 2:
The patent introduces an additional dimension to the video stream structure by adding scalability layers beyond the traditional single-resolution approach. This dimensional expansion allows the system to provide multiple resolution levels (low, medium, high) within a single stream structure, improving adaptability to different display capabilities while maintaining manageable device complexity through a systematic layering approach.
3Adaptability or versatility
If transcoding or re-encoding is performed for different resolutions, then adaptability to different networks is improved, but loss of time and processing resources increase
Solution Approach 1:
The video is pre-encoded with multiple scalability layers during the initial encoding process, so that the base layer and enhancement layers are ready for immediate use. This preliminary action eliminates the need for time-consuming transcoding or re-encoding operations when adapting to different network conditions, as the system can simply select and deliver the appropriate layers without performing additional encoding.
Solution Approach 2:
The scalability layer structure allows for efficient adaptation by selectively discarding enhancement layers when network conditions are poor, while the base layer remains intact and can be quickly recovered or re-transmitted without requiring complete re-encoding. This approach minimizes loss of time and processing resources by leveraging the pre-encoded base layer information rather than performing full transcoding.
Data Source
AI summary
A method and apparatus for scalable video coding are disclosed, wherein the video data is configured into a Base Layer (BL) and an Enhancement Layer (EL) and wherein the EL has higher spatial resolution or better video quality than the BL. According to embodiments of the present invention, information from the base layer is exploited for coding the enhancement layer. The information coding for the enhancement layer includes CU structure, motion vector predictor (MVP) information, MVP/merge candidates, intra prediction mode, residual quadtree information, texture information, residual information, context adaptive entropy coding, Adaptive Lop Filter (ALF), Sample Adaptive Offset (SAO), and deblocking filter.