Stereoscopic 3D Encoding with Dual Enhancement Streams for Symmetry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing stereoscopic 3D image technologies fail to achieve symmetry in image quality between left and right images, leading to viewer discomfort, and existing encoding methods like SHVC and VEI do not effectively address this asymmetry due to the influence of the base layer's image quality on the enhancement layer's bitrate allocation.
Innovation Solution
A method and apparatus that generate multiple streams from stereoscopic 3D images using scalable high efficiency video coding (SHVC) and video enhancement information (VEI) encoding, where a single base layer is used to encode two enhancement layers, allowing for improved image quality symmetry by utilizing the -ibl option to prevent the base layer from being encoded and using it as a prediction signal for the enhancement layer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If SHVC encoding is used to encode enhancement layer with base layer upscaling, then encoding efficiency is improved, but image quality symmetry between left and right images deteriorates
Solution Approach 1:
The patent divides the encoding process into two separate enhancement layer encodings: first encoding the left image as base layer and right image as enhancement layer, then encoding the original right image as base layer and decoded right image as enhancement layer. This segmentation allows independent optimization of each encoding path to achieve both encoding efficiency and image quality symmetry.
Solution Approach 2:
The patent intentionally uses asymmetric encoding paths for left and right images by applying different base layer inputs (original left image vs. decoded left image) while maintaining the same enhancement layer target (original right image). This asymmetric approach compensates for the inherent asymmetry in SHVC encoding to achieve symmetric output quality.
2Manufacturing precision
If base layer image quality is improved, then enhancement layer image quality is improved, but bitrate allocation becomes less efficient
Solution Approach 1:
The patent applies encoding twice to the same enhancement layer target (original right image) instead of once. The first encoding produces a decoded right image that serves as the base layer for the second encoding. This partial/excessive action ensures the enhancement layer achieves optimal quality by benefiting from two separate base layer improvements without proportionally doubling the total bitrate cost.
3Manufacturing precision
If cross-view SHVC and VEI encoding are used, then image quality gap between binocular images is reduced, but symmetry is not achieved
Solution Approach 1:
The patent introduces the decoded left image (from first SHVC encoding) as an intermediary base layer for the second encoding process. This intermediary serves as a quality reference that helps bridge the gap between left and right image qualities, enabling the second encoding to compensate for any remaining asymmetry and achieve final symmetry.
Data Source
AI summary
Provided is an apparatus for image encoding, the apparatus including: a transmitter memory configured to store a program for encoding a stereoscopic 3D image; and an encoding processor configured to execute the program stored in the transmitter memory, wherein the encoding processor is configured to: generate a first stream and a second stream from a left image and a down-converted right image, decode the first stream and the second stream to generate a decoded left image and a first decoded right image; generate a third stream from the decoded left image, the first decoded right image, and an original right image, and decode the third stream to generate a second decoded right image; and generate a fourth stream from the second decoded right image and the original right image.