3D Video Encoding with Layered Additional-View Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D video encoding methods face challenges in computational complexity and bandwidth requirements, particularly for stereoscopic 3D content, necessitating improved encoding technologies suitable for low-latency and low-power environments.
Innovation Solution
A video encoding apparatus that includes a processor to downsample and encode a low-resolution additional view, upscale and encode a residual signal, and utilize Low Complexity Enhancement Video Codec (LCEVC) to generate high-quality stereoscopic 3D content, incorporating disparity refinement using binocular disparity information to reduce residual signals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If left and right eye videos are encoded separately for s3D content, then video quality and immersion are improved, but encoding complexity and bandwidth requirements increase approximately twice compared to 2D videos
Solution Approach 1:
The patent segments the encoding process into two independent encoding paths: one for the reference view and another for the additional view. Each path processes its respective view separately through downsampling, encoding, upsampling, and residual encoding stages, allowing optimized handling of each view's characteristics while managing overall system complexity
Solution Approach 2:
The patent introduces a resolution dimension by encoding additional views at lower resolution and then upsampling them. This dimensional approach allows the system to handle multiple views without proportionally increasing computational complexity, as the upsampling process efficiently restores high resolution for the additional views
2Productivity
If conventional prediction-based techniques and common region extraction techniques are used for s3D video encoding, then encoding efficiency is improved, but computational volume and complexity still require improvement
Solution Approach 1:
The patent changes the resolution parameter by encoding additional views at a lower resolution level and then upsampling them. This parameter change reduces the computational volume required for encoding additional views while maintaining high-quality output, as the upsampling process efficiently restores the original resolution without requiring complex high-resolution encoding operations
3Manufacturing precision
If high-resolution s3D content is transmitted to meet demand for 4K UHD and immersive content, then video quality and immersion are improved, but data capacity and transmission requirements increase significantly
Solution Approach 1:
The patent segments the bitstream into base layer and enhancement layer components, allowing selective transmission and decoding. This segmentation enables efficient data utilization by transmitting only the necessary information for each view quality level, reducing overall data capacity requirements while maintaining high-quality output when needed
Data Source
AI summary
The present invention relates to a video encoding apparatus, a three-dimensional (3D) broadcast transmission apparatus including the same, and a 3D broadcast transmission method, and the video encoding apparatus includes a memory configured to store a program for encoding a 3D video and a processor configured to execute the program stored in the memory, wherein the processor encodes a downsampled low-resolution additional view to generate a base layer bitstream, upscales the encoded low-resolution additional view, and secondarily encodes a residual signal between a reference view and the upscaled additional view to generate an enhancement layer bitstream.