Immersive Video Atlas Patch Offset Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current immersive video technologies struggle to provide natural and immersive 6DoF experiences due to limitations in supporting rotational and translational motions, with most omnidirectional videos only supporting rotation, leading to inefficiencies in pixel value distribution and encoding/decoding processes.
Innovation Solution
A method for processing immersive videos that involves pruning view images, generating an atlas by packing extracted patches, deriving and adjusting pixel value offsets, and encoding this information as metadata to achieve uniform pixel value distribution and improved encoding/decoding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If omnidirectional videos support only rotation, then device complexity is reduced, but 6DoF immersion experience deteriorates
Solution Approach 1:
The video content is segmented into multiple view images captured from different positions and orientations. Each view image is processed independently through pruning to extract relevant patches, which are then packed into an atlas structure. This segmentation enables selective rendering for 6DoF motion without requiring full 6DoF capture capability, resolving the contradiction between device complexity and immersion experience.
2Device complexity
If pixel value distribution is non-uniform in atlas patches, then encoding complexity is reduced, but reconstruction quality deteriorates
Solution Approach 1:
The patent applies parameter changes by adjusting pixel values through offset addition. For each patch in the atlas, an offset is calculated based on the difference between the maximum pixel value and the average pixel value. This offset is added to all pixel values in the patch, transforming the distribution from non-uniform to uniform. The uniform distribution improves reconstruction quality by ensuring consistent pixel value ranges across all patches, while the offset calculation method keeps encoding complexity manageable.
3Manufacturing precision
If offset adjustment is performed to maintain bit depth range, then pixel value uniformity is improved, but processing complexity increases
Solution Approach 1:
The patent performs preliminary action by calculating and applying offsets during the atlas generation phase, before the actual video rendering occurs. The offset for each patch is computed based on its pixel value statistics (maximum and average values), and this correction is applied upfront. This preliminary correction ensures that subsequent rendering operations work with uniformly distributed pixel values, improving quality without adding complexity to the time-critical rendering path.
Data Source
AI summary
A method for processing an immersive video includes: performing pruning for view images; generating an atlas by packing a patch that is extracted as a result of the pruning; deriving an offset for the patch that is comprised in the atlas; and correcting pixel values in the patch by using the derived offset.