Multi-atlas Volumetric Video Encapsulation for Immersive Media
Solution Overview
Problem
Current immersive media systems face challenges in flexible encapsulation of volumetric video data, leading to inefficiencies in bandwidth usage, processing power, and decoding complexity due to the single-track encapsulation of 3D scenes, which results in synchronization and memory utilization issues during decoding.
Innovation Solution
The proposed solution involves encoding and decoding 3D volumetric video data by organizing it into multiple media tracks based on atlases and component types, allowing for flexible encapsulation and reducing synchronization needs during decoding, thereby improving processing efficiency and reducing bandwidth consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If single-track encapsulation of 3D volumetric video data is used, then simplicity of encapsulation is maintained, but synchronization issues and decoding complexity increase
Solution Approach 1:
The patent divides the 3D volumetric video data into multiple independent media tracks, each representing a separate atlas. This segmentation allows each track to be decoded and processed independently, eliminating synchronization issues between different data components while maintaining organized encapsulation structure.
2Ease of manufacture
If all 3D volumetric video data is encoded in a single media track, then ease of encoding is maintained, but bandwidth usage and processing power efficiency deteriorate
Solution Approach 1:
The patent segments the volumetric video data into multiple atlas-based tracks, allowing selective encoding and transmission of only necessary atlas data. This reduces redundant bandwidth consumption while maintaining encoding simplicity through standardized track structures that can be processed efficiently.
Solution Approach 2:
The patent enables partial decoding where only specific atlas tracks required for the current viewing angle are decoded and rendered, rather than processing all 3D volumetric data. This partial action significantly reduces processing power requirements and bandwidth usage while maintaining complete functionality.
3Productivity
If multiple atlases are encapsulated in separate media tracks, then decoding flexibility and processing efficiency are improved, but encapsulation structure complexity increases
Solution Approach 1:
The patent employs a universal media track structure where each track follows the same standardized format with consistent metadata and data organization. This universality allows multiple atlas tracks to be handled by the same decoding logic, improving processing efficiency while preventing encapsulation complexity from increasing proportionally with the number of tracks.
Data Source
AI summary
Methods, apparatus, and systems that provide flexible encapsulation of volumetric video data in media files are disclosed. In one example aspect, a method for video processing includes receiving three-dimensional (3D) volumetric video data and encoding the three-dimensional volumetric video data into a media file. The 3D volumetric video data corresponds to one or more atlases, each comprising atlas data and one or more two-dimensional (2D) components. The atlas data and the one or more 2D components are stored in one or more media tracks in the media file.