Stereoscopic HDR Video Reshaping for Codec-Compatible 3D Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently encoding and decoding stereoscopic high dynamic range (HDR) video, particularly in ensuring compatibility with both HDR and SDR displays, while maintaining image quality and compression efficiency.
Innovation Solution
A stereoscopic HDR video pipeline that includes merging and reshaping processes to optimize encoding and decoding, using metadata for proper display management, and employing various video codecs like HEVC and VVC to handle HDR and SDR formats, along with techniques like frame packing and temporal scalability to ensure compatibility and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If stereoscopic HDR video is encoded using conventional methods, then compatibility with existing codecs is maintained, but compression efficiency and image quality deteriorate
Solution Approach 1:
The stereoscopic HDR video encoding process is segmented into distinct stages: merging left and right views into a combined view, applying reshaping to the merged view, and then encoding. This segmentation allows each stage to be optimized independently, improving overall compression efficiency while maintaining compatibility through standardized interfaces.
Solution Approach 2:
The merging and reshaping operations are performed as preliminary actions before the actual encoding process. By pre-processing the stereoscopic HDR content into a format optimized for compression, the subsequent encoding achieves better efficiency without requiring changes to existing codec standards.
2Manufacturing precision
If HDR content is transmitted without reshaping, then original image quality is preserved, but compatibility with SDR displays is lost
Solution Approach 1:
The reshaping process acts as an intermediary transformation that converts HDR content into a format suitable for both HDR and SDR displays. The merging function combines stereoscopic views, and the reshaping function adapts the dynamic range, enabling seamless compatibility across different display types while preserving visual quality through metadata-guided reconstruction.
Solution Approach 2:
The system changes key parameters of the video signal including dynamic range (through reshaping), color space (through merging), and bit depth. These parameter transformations enable the same encoded stream to be appropriately rendered on both HDR and SDR displays, achieving universal compatibility without sacrificing image quality.
3Reliability
If separate encoding is applied to left and right views, then stereo quality is maintained, but encoding complexity and processing time increase
Solution Approach 1:
The left and right stereoscopic views are merged into a single combined view before encoding. This merging operation maintains the stereo information while allowing the encoder to process a single unified stream, significantly reducing encoding complexity and processing time compared to separate encoding of each view.
Solution Approach 2:
The merged view encoding approach serves multiple functions simultaneously: it preserves stereo quality for HDR displays, enables efficient compression through unified processing, and provides compatibility with SDR displays through the reshaping metadata. This multi-functional approach eliminates the need for separate encoding pipelines.
Data Source
AI summary
Methods and systems for stereoscopic 3D video are described. Input HDR stereoscopic views in a first codeword representation are merged together by a first merging function to generate an input merged view to optimize a reshaping operation which generates a reshaped merged view in a second codeword representation and associated composer metadata. The reshaped merged view may be split and re-merged by a second frame packing function to optimize video encoding efficiency of an output coded bitstream based on the reshaped merged view. In a decoder, after extracting the reshaped merged view from the coded bitstream, a composer function applies the composer metadata to the decoded reshaped merge view to generate an output merged view in the first codeword representation. Then it generates output HDR stereoscopic views based on the output merged view.