3D Video Encoding With Pre-Processing Geometric Transforms
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing stereoscopic video encoding and decoding methods using difference-based techniques often result in encoding artifacts and inefficient data compression due to minor differences between left and right eye images, leading to suboptimal quality and data efficiency.
Innovation Solution
The method involves interleaving and processing left and right eye images with scaling, transform operations, and cropping to reduce differences, using one image as a reference for difference encoding, and storing transformation metadata for efficient encoding and decoding, which includes motion compensated prediction and entropy encoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If difference encoding techniques are used to encode left and right eye images, then encoding efficiency is improved, but encoding artifacts increase and data compression becomes less effective due to minor differences between images
Solution Approach 1:
The patent applies preliminary action by performing geometric transforms (warping, scaling, cropping) on the left and right eye images before difference encoding. These pre-processing steps align the images to minimize geometric differences, allowing the subsequent difference encoder to work with more similar images and reduce encoding artifacts while maintaining compression efficiency
2Device complexity
If left and right eye images are processed separately, then processing simplicity is maintained, but encoding artifacts increase due to unaligned geometric differences
Solution Approach 1:
The patent merges the processing of left and right eye images by applying the same geometric transform operations to both images before difference encoding. This combined approach ensures both images are geometrically aligned to minimize differences, while the difference encoding still processes them as separate streams, maintaining overall processing simplicity while improving quality
Data Source
AI summary
Methods and apparatus relating to encoding and decoding stereoscopic (3D) image data, e.g., left and right eye images, are described. Various pre-encoding and post-decoding operations are described in conjunction with difference based encoding and decoding techniques. In some embodiments left and right eye image data is subject to scaling, transform operation(s) and cropping prior to encoding. In addition, in some embodiments decoded left and right eye image data is subject to scaling, transform operations(s) and cropping prior to being output to a display device. Transform information, scaling information and/or cropping information may be included in a bitstream communicating encoded left and right eye images. The amount of scaling can be the same for an entire scene and/or program.