Scalable Video Coding Pre-Processing for HDR and WCG
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current scalable video coding systems face challenges in efficiently delivering enhanced content like High Dynamic Range (HDR) and Wide Color Gamut (WCG) without increasing bandwidth and infrastructure costs, while also requiring complex algorithms that strain consumer devices and resources.
Innovation Solution
The method involves pre-processing video data using a system with a base layer pre-processor and an enhancement layer pre-processor, along with a reference processing unit, to map and convert bit-depth and color formats, allowing for efficient encoding and decoding of enhanced content using existing codecs with minimal modifications, and utilizing techniques like inverse tone mapping and weighted prediction to optimize bit-depth scalability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If content is delivered in enhanced format (HDR, WCG), then video quality is improved, but bandwidth and infrastructure costs increase
Solution Approach 1:
The patent divides the video stream into multiple layers (base layer and enhancement layer) with different quality levels. The base layer contains essential information for acceptable quality, while the enhancement layer adds HDR and WCG capabilities. This segmentation allows receivers to selectively decode only the base layer for standard quality or both layers for enhanced quality, thereby reducing the bandwidth required compared to transmitting only enhanced format content.
Solution Approach 2:
The enhancement layer is nested within the base layer structure, where the enhancement layer bits are positioned after the base layer bits in the bitstream. This nesting allows the base layer to serve as a foundation that can be independently decoded, while the enhancement layer builds upon it. The nested structure enables efficient bandwidth utilization by allowing receivers to skip the enhancement layer if not needed, thus reducing overall bandwidth requirements.
2Measurement precision
If content is delivered in enhanced format, then video quality is improved, but infrastructure upgrade costs increase
Solution Approach 1:
The scalable video coding system is designed to be universally compatible with both legacy and advanced receivers. The base layer is compatible with standard H.264/AVC decoders, while the enhancement layer provides HDR and WCG capabilities for advanced receivers. This multi-functionality allows the same bitstream to serve multiple purposes: basic video delivery for older infrastructure and enhanced video delivery for upgraded infrastructure, thereby reducing the need for complete infrastructure replacement.
Solution Approach 2:
The system performs preliminary processing at the encoder to separate video data into base and enhancement layers before transmission. This preliminary action ensures that the bitstream is prepared in advance to be compatible with both legacy and advanced receivers, eliminating the need for receivers to perform complex processing and reducing infrastructure upgrade requirements.
3Measurement precision
If complex algorithms are used for enhanced content delivery, then video quality is improved, but processing complexity and device strain increase
Solution Approach 1:
The processing complexity is segmented between encoder and receiver functions. The encoder performs complex tasks such as bit-depth conversion and color format transformation to create the enhanced layer, while the receiver only needs to perform simpler tasks like copying base layer data and optionally adding enhancement layer data. This segmentation reduces the processing burden on consumer devices and accelerators.
Solution Approach 2:
The system uses copying operations to transfer video data between layers. The enhancement layer is created by copying and transforming the base layer data through bit-depth conversion and color space transformation, rather than re-encoding the entire video. This copying approach significantly reduces processing complexity and computational resources required at the receiver end.
Data Source
AI summary
Methods for scalable video coding are described. Such methods can be used to deliver video contents in Low Dynamic Range (LDR) and/or one color format and then converting the video contents to High Dynamic Range (HDR) and/or a different color format, respectively, while pre-processing video content.