Scalable HDR Video Coding with IPT-PQ Reshaping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding and delivery technologies face challenges in efficiently handling high dynamic range (HDR) images, particularly in supporting both spatial and dynamic range scalability, which is essential for next-generation ATSC standards like ATSC 3.0, due to limitations in existing compression standards and display capabilities.
Innovation Solution
The implementation of video coding and delivery using a perceptually quantized color space, such as IPT-PQ, which reduces spatial resolution or dynamic range through transformation functions, reshaping, and non-linear quantization, allowing for efficient encoding and decoding of HDR content with both spatial and dynamic range scalability, enabling better picture quality at lower bit depths.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video content is encoded with high dynamic range and high spatial resolution, then picture quality is improved, but bandwidth and storage requirements increase
Solution Approach 1:
The video signal is divided into multiple layers with different characteristics (base layer with lower resolution/dynamic range, enhancement layers with higher quality). This segmentation allows progressive transmission where base layer provides basic quality at lower bandwidth, while enhancement layers add incremental quality improvements at additional bandwidth costs.
Solution Approach 2:
The encoding system varies multiple parameters simultaneously including spatial resolution, dynamic range, color depth, and frame rate across different layers. By changing these parameters in a coordinated manner, the system optimizes the balance between picture quality and bandwidth consumption for different service requirements.
2Adaptability or versatility
If video content is delivered with both spatial and dynamic range scalability, then adaptability to different displays is improved, but encoding complexity increases
Solution Approach 1:
The scalable video signal is segmented into distinct layers representing different combinations of spatial resolution and dynamic range. Each layer is independently encoded, allowing receivers to select appropriate layers based on display capabilities. This segmentation manages encoding complexity by breaking down the multi-dimensional scalability problem into manageable independent components.
Solution Approach 2:
The system adds scalability dimensions beyond traditional spatial resolution by incorporating dynamic range as an independent scalability dimension. This creates a multi-dimensional scalable video structure where both spatial and dynamic range parameters can be independently adjusted to match different display characteristics.
3Productivity
If video is encoded at lower bit depths to reduce bandwidth, then transmission efficiency is improved, but color accuracy and dynamic range representation deteriorate
Solution Approach 1:
Color and dynamic range information is segmented into base layer (lower bit depth) and enhancement layers (higher bit depth). The base layer provides acceptable color accuracy for standard dynamic range displays, while enhancement layers restore color precision and extended dynamic range for HDR-capable displays, optimizing transmission efficiency across different device types.
Data Source
AI summary
In a method to code and transmit scalable HDR video signals, HDR signals are processed and encoded in the IPT-PQ color space to generate a base layer at reduced spatial resolution and/or dynamic range, and an enhancement layer with a residual signal. A signal reshaping block before the base layer encoder allows for improved coding of HDR signals using a reduced bit depth. A decoder can use a BL decoder and backward reshaping to generate a decoded BL HDR signal at a reduced dynamic range and/or spatial resolution, or it can combine the decoded BL HDR signal and the EL stream to generate a decoded HDR signal at full dynamic range and full resolution.