Multi-layered Frame-Compatible Video Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current stereoscopic video delivery technologies face challenges in efficiently compressing and decoding 3D content due to high bandwidth requirements and lack of backwards compatibility with existing infrastructure, leading to suboptimal quality and compatibility issues with consumer devices.
Innovation Solution
The implementation of a multi-layered frame-compatible video delivery system that multiplexes and encodes stereoscopic content into a base layer and enhancement layers, allowing for efficient compression and decoding while maintaining compatibility with legacy devices by using existing codecs like H.264/AVC and VC-1, and employing techniques such as inter-layer prediction and motion/disparity compensation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If simulcast encoding is used to deliver stereoscopic video, then compatibility with existing codecs is maintained, but compression efficiency is low and bandwidth requirements are high
Solution Approach 1:
The stereoscopic video stream is segmented into multiple layers: a base layer containing a down-sampled version of both left and right views, and enhancement layers containing the residual information needed to reconstruct the full-resolution views. This segmentation allows the base layer to be decoded by legacy devices while enhancement layers provide additional quality for 3D-capable devices.
Solution Approach 2:
The patent introduces a new dimension of quality by encoding video at multiple resolution levels and quality tiers simultaneously within a single bitstream. The base layer provides standard definition compatible with legacy devices, while enhancement layers add high definition capability for 3D displays, effectively adding a quality dimension without requiring separate transmission channels.
2Productivity
If two separate bitstreams are encoded for left and right views, then decoding can be performed in parallel on GPU architectures, but device complexity and computational requirements increase considerably
Solution Approach 1:
The patent merges the encoding of both left and right views into a single integrated bitstream structure. The base layer contains down-sampled versions of both views multiplexed together, while enhancement layers contain residuals for both views. This unified structure allows a single decoder to handle both views simultaneously, reducing device complexity compared to maintaining separate decoders for each view.
3Loss of energy
If multi-layer scalable bitstreams are used, then compression efficiency is high and scalability is achieved, but backwards compatibility with legacy devices is lost
Solution Approach 1:
The bitstream structure is designed to be universal, serving multiple functions and device types simultaneously. The base layer is encoded to be compatible with legacy H.264/AVC and VC-1 decoders, ensuring backwards compatibility. At the same time, enhancement layers are included that provide high-definition stereoscopic content for modern 3D-capable devices. A single bitstream thus serves both legacy 2D devices and modern 3D devices.
Solution Approach 2:
The base layer is prepared in advance with down-sampled versions of both left and right views, encoded using standard codecs that legacy devices can decode. This preliminary encoding ensures that when the bitstream is received by legacy devices, they can immediately decode and display the content without requiring any additional processing or enhancement layers, thus maintaining backwards compatibility while preserving the option for enhanced quality.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Multi-layered frame-compatible video delivery is described. Multi-layered encoding and decoding methods, comprising a base layer and at least one enhancement layer with reference processing, are provided. In addition, multi-layered encoding and decoding methods with inter-layer dependencies are described. Encoding and decoding methods that are capable of frame-compatible 3D video delivery are also described.