External Reference Layer Processing for Multi-Layer Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently managing and processing reference layers coded using different standards or versions, which complicates multi-layer video coding, particularly in handling output and synchronization of pictures across layers.
Innovation Solution
The implementation of a system that minimizes the processing of reference layer pictures by providing decoded samples and representation formats externally, allowing the HEVC decoder to manage and synchronize enhancement layer pictures independently, using specific NAL unit headers and external means to handle output and decoding responsibilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the HEVC decoder processes reference layer pictures coded using different standards internally, then compatibility with multiple coding standards is achieved, but device complexity and processing overhead increase significantly
Solution Approach 1:
The patent extracts the reference layer picture processing from the HEVC decoder's internal processing pipeline and handles it externally through a separate interface. The external processor decodes reference layer pictures using appropriate decoders (H.264/AVC for BL, HEVC for EL) and provides decoded samples to the HEVC decoder via a defined interface, thereby removing the complexity of multi-standard processing from the HEVC decoder while maintaining compatibility
Solution Approach 2:
The patent introduces an intermediary processing stage between the external source and the HEVC decoder. This intermediary handles the decoding of reference layer pictures according to their specific coding standards and transforms them into a format suitable for the HEVC decoder, acting as a mediator that reconciles different standards without requiring the HEVC decoder to directly process multiple formats
2Productivity
If the HEVC decoder manages both base layer and enhancement layer decoding internally, then integrated processing is achieved, but computational resources and processing time increase
Solution Approach 1:
The patent segments the video decoding process into distinct functional components: base layer decoding (handled externally with H.264/AVC decoder), enhancement layer decoding (handled externally with HEVC decoder), and inter-layer prediction (handled internally by HEVC decoder). This segmentation allows each component to use optimized processing appropriate to its specific requirements, reducing overall computational resource consumption while maintaining integrated processing capabilities
3Reliability
If reference layer pictures are fully decoded and stored internally, then complete picture information is available for prediction, but memory requirements and processing overhead increase
Solution Approach 1:
The patent uses a copying approach where the enhancement layer decoder produces decoded samples that are then used by the HEVC decoder for inter-layer prediction, rather than requiring the HEVC decoder to maintain complete copies of reference layer pictures. The necessary prediction information is extracted and transmitted through the interface, reducing memory requirements while maintaining prediction accuracy
Data Source
Figure 1A
Figure 1B
Figure 2A
AI summary
An apparatus for coding video information according to certain aspects includes a memory and a processor. The memory unit is configured to store video information associated with an enhancement layer (EL) and a corresponding reference layer (RL). The processor is configured to: code an EL picture in a current access unit (AU), the EL coded using a first standard that is different from a second standard that is used to code the RL, wherein the coding of the EL picture is based on information associated with a RL picture in the current access unit, the information associated with the RL picture provided by an external means and consisting of: (1) decoded sample values of the RL picture; (2) a representation format of the RL picture; and (3) an indication of whether the RL picture is an instantaneous decoding refresh (IDR) picture.