Scalable Video Bitstream Encoding for Stereoscopic Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current stereoscopic video delivery methods face challenges in compression efficiency due to the doubling of information requirements, increased computational and memory throughput, and the need for backwards compatibility, particularly in encoding and decoding processes for 3D content.
Innovation Solution
The implementation of a multi-layer or scalable bitstream encoding method that uses a base layer and enhancement layers with inter-layer prediction, allowing for scalability in quality, resolution, bit-depth, and view availability, while maintaining compatibility with existing codecs like H.264/AVC, to efficiently deliver stereoscopic content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If separate bitstreams are encoded for each view (simulcast approach), then view availability and stereo depth information are transmitted, but compression efficiency deteriorates due to independent coding of correlated sequences
Solution Approach 1:
The patent combines multiple view sequences into a single integrated bitstream using multi-layer scalable coding. The base layer contains 2D-compatible information while enhancement layers add 3D and multi-view data, merging previously separate coding streams into one efficient representation that exploits inter-view correlations.
Solution Approach 2:
The patent introduces a new dimension of scalability by organizing video data into multiple layers (base layer and enhancement layers) with different view availability characteristics. This layered structure allows receivers to selectively decode based on their capabilities, transforming the single-dimension coding approach into a multi-dimensional solution.
2Loss of energy
If multi-layer scalable bitstreams are implemented, then compression efficiency is improved and backwards compatibility is maintained, but device complexity increases due to multiple encoding and decoding layers
Solution Approach 1:
The patent segments the video bitstream into distinct layers with specific functions: base layer for 2D compatibility and enhancement layers for 3D and multi-view capabilities. This segmentation allows independent processing of each layer, reducing overall complexity compared to handling all data in a single undifferentiated stream.
Solution Approach 2:
The base layer is encoded first with 2D-compatible information, and enhancement layers are subsequently added. This preliminary action ensures backwards compatibility is established before adding complex 3D features, allowing legacy devices to ignore enhancement layers while advanced devices can utilize them.
3Measurement precision
If stereoscopic content is delivered with full resolution for multiple views, then quality is improved, but computational and memory throughput requirements increase considerably
Solution Approach 1:
The patent applies local quality by providing different resolution and quality levels in different layers of the bitstream. The base layer provides lower-resolution 2D-compatible content requiring less computational power, while enhancement layers provide higher-resolution 3D content for devices with greater processing capability, allowing quality to be matched to local device capabilities.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A video encoding and decoding system for use in a multiview and bitdepth coding system is described. Such system can comprise a plurality of layer groupings, where each group can be adapted to encode and/or decode based on predictions from previous layers and a plurality of data categories from the input video data.