Layered Video Encoding for 3D Compression and 2D Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding methods struggle to efficiently compress 3D and high-frequency video data signals while maintaining backward compatibility, leading to increased bit rates and compatibility issues with standard 2D video systems.
Innovation Solution
The method involves jointly compressing a primary and secondary video data signal, where the primary signal is self-contained and decodable by conventional systems, and the secondary signal is dependent on the primary, with both signals being multiplexed and provided with separate codes to ensure backward compatibility and efficient bit rate management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 3D video data signals are compressed using existing compression methods, then the video quality is maintained, but the bit rate increases significantly
Solution Approach 1:
The patent segments the 3D video signal into a base layer (2D video) and enhancement layers (stereo depth information). The base layer is compressed using existing standards while the enhancement layers add 3D information with additional compression techniques, allowing progressive transmission where receivers can decode based on available bandwidth.
Solution Approach 2:
The patent implements a nested structure where the 2D base layer is embedded within the 3D video signal, and stereo enhancement information is nested within the base layer. This allows standard 2D receivers to decode the base layer while 3D-capable receivers can access the nested enhancement layers for full 3D reconstruction.
2Ease of operation
If separate compression is applied to left and right views of a stereo pair, then decoding simplicity is maintained, but the bit rate doubles compared to mono systems
Solution Approach 1:
The patent merges the left and right view compression processes by using the base layer (common to both views) once, and only encoding the differential stereo information separately. This combining approach maintains decoding simplicity while avoiding the bit rate doubling that occurs with completely separate compression of each view.
Solution Approach 2:
The patent applies different compression qualities to different parts of the signal: the base layer uses standard compression for broad compatibility, while the stereo enhancement layers use more advanced compression techniques tailored to the specific characteristics of depth information, optimizing the overall bit rate efficiency.
3Reliability
If enhanced video data signals with higher frequency or resolution are transmitted, then video quality is improved, but processing power and transmission capacity requirements increase
Solution Approach 1:
The patent implements dynamic scalability where the video signal structure adapts to receiver capabilities. The base layer provides standard definition at standard frame rates, while enhancement layers dynamically add high definition and high frame rate content only when the receiver can process and display it, optimizing transmission capacity utilization.
Solution Approach 2:
The patent adds enhancement layers as an additional dimension to the base video signal, allowing receivers to selectively process only the necessary layers based on their processing power and transmission capacity constraints, rather than requiring all receivers to handle the full enhanced signal.
4Productivity
If a single compressed bitstream is used for both 2D and 3D content, then transmission efficiency is improved, but backward compatibility with standard 2D systems deteriorates
Solution Approach 1:
The patent segments the single compressed bitstream into clearly demarcated base layer and enhancement layer sections with separate syntax elements and parameter sets. This segmentation allows 2D-compatible receivers to parse and decode only the base layer portion, while 3D-capable receivers can access both layers, maintaining backward compatibility without sacrificing transmission efficiency.
Solution Approach 2:
The patent introduces an intermediary structure where the base layer acts as a mediator between standard 2D systems and advanced 3D systems. The base layer contains all necessary information for 2D playback, while additional intermediary enhancement layers provide 3D functionality, allowing a single bitstream to serve multiple system types.
Data Source
AI summary
Video data signals are encoded such that the encoded video data signal comprises at least a primary and at least a secondary video data signal. The primary and secondary video data signal are jointly compressed. The primary video data signal is compressed in a self-contained manner, and the secondary video data signal is compressed using data from the primary video data signal. The jointly compressed video data signal is split into separate bitstreams, at least a primary bitstream comprising data for the primary video data signal and at least a secondary bitstream comprising data for the secondary video data signal, whereafter the primary and secondary bitstreams are multiplexed into a multiplexed signal, and the primary and secondary signals are provided with separate codes.