3D Video Encoding Architecture with Base and Enhancement Layers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D video delivery methods fail to provide full resolution stereoscopic material without increasing complexity and bandwidth, and are not backwards compatible with legacy devices, limiting their adoption and impacting user experience.
Innovation Solution
A 2D or frame compatible 3D video encoding and decoding system that includes a base layer and enhancement layers with pre-processing modules to refine the base layer output for improved prediction, using techniques like filtering and motion compensation, allowing for efficient exploitation of redundancies between views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If two separate and independent bitstreams are used to deliver full resolution stereoscopic material, then full resolution 3D delivery is achieved, but complexity and bandwidth requirements increase significantly
Solution Approach 1:
The patent combines two separate view bitstreams into a single multiplexed bitstream by interleaving macroblocks from left and right views. This merging approach maintains full resolution capability while reducing system complexity and bandwidth requirements compared to transmitting two independent bitstreams.
Solution Approach 2:
The patent segments the stereoscopic video into macroblock units and applies different prediction modes to different segments. By dividing the processing into manageable macroblock segments with specific prediction rules, the system achieves full resolution delivery with reduced complexity through efficient exploitation of inter-view redundancies.
2Manufacturing precision
If two separate and independent bitstreams are used for 3D video delivery, then full resolution is achieved, but bandwidth requirements increase
Solution Approach 1:
The patent merges two view bitstreams into one multiplexed bitstream, reducing bandwidth requirements by eliminating redundant data transmission while preserving full resolution quality through efficient macroblock interleaving and prediction techniques.
Solution Approach 2:
The patent discards redundant inter-view information by using motion-compensated prediction from the base layer to generate enhancement layer data. Only the residual differences are transmitted in the enhancement layer, recovering full resolution quality while minimizing bandwidth usage.
3Productivity
If MVC extension with intelligent reference buffer management is used, then coding efficiency is improved by 20-30%, but complexity issues and incompatibility with legacy devices remain
Solution Approach 1:
The patent segments the video coding into base layer and enhancement layer with clear functional divisions. The base layer provides coarse prediction while the enhancement layer refines specific macroblocks, achieving high coding efficiency through this segmented approach while maintaining compatibility with legacy decoders that can process the base layer independently.
Solution Approach 2:
The patent implements dynamic prediction mode selection where different macroblocks can use different prediction modes (copy, motion-compensated, or residual-only) based on content characteristics. This dynamic approach optimizes coding efficiency while keeping the base layer compatible with legacy devices.
4Productivity
If MVC extension is used for 3D video delivery, then coding efficiency is improved, but incompatibility with legacy devices occurs
Solution Approach 1:
The patent segments the bitstream into a base layer that is fully compatible with legacy MPEG-4 AVC decoders and an enhancement layer that provides 3D functionality. This segmentation allows legacy devices to play the base layer while 3D-capable devices can utilize the enhancement layer for improved coding efficiency.
Solution Approach 2:
The base layer serves multiple functions: it provides standalone 2D video compatibility with legacy devices, serves as a prediction reference for the enhancement layer, and enables progressive decoding where 3D quality is enhanced without sacrificing 2D compatibility.
Data Source
AI summary
Encoding and decoding architectures for 3D video delivery are described, such as 2D compatible 3D video delivery and frame compatible 3D video delivery. The architectures include pre-processing stages to pre-process the output of a base layer video encoder and/or decoder and input the pre-processed output into an enhancement layer video encoder and/or decoder of one or more enhancement layers. Multiplexing methods of how to combine the base and enhancement layer videos are also described.