Volumetric Media Processing Selective Track Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing methods for processing volumetric media result in wastage of transmission bandwidth and increased processing complexity due to the unnecessary access and processing of entire volumetric media data, especially in mobile terminals with limited capacity.
Innovation Solution
The method involves identifying and processing specific V3C tracks and component tracks corresponding to 3D spatial regions within the volumetric media, decapsulating and decoding atlas coding and video coding sub-bitstreams to generate the 3D spatial regions, thereby reducing unnecessary data processing and transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the entire volumetric media data is accessed and processed, then complete 3D scene reconstruction is achieved, but transmission bandwidth is wasted and processing complexity increases
Solution Approach 1:
The patent segments the volumetric media data into multiple V3C tracks, each corresponding to different 3D spatial regions. The play terminal can selectively access and process only the tracks relevant to the current viewing position and orientation, rather than processing the entire volumetric media data set. This segmentation enables partial processing while maintaining reconstruction quality for the visible region.
Solution Approach 2:
The patent extracts and processes only the necessary V3C tracks corresponding to the visible 3D spatial region based on the user's viewing position and orientation. By taking out only the required portion of the volumetric media data for processing, the system avoids the complexity of processing the complete data set while ensuring accurate reconstruction of the visible scene.
2Manufacturing precision
If all V3C components are synchronously decoded, then accurate volumetric media reconstruction is achieved, but processing complexity and resource consumption increase
Solution Approach 1:
The patent implements dynamic selection of V3C tracks for processing based on the real-time viewing position and orientation. The system dynamically determines which 3D spatial regions are visible and selectively processes only those corresponding V3C tracks, adapting the processing load to the actual rendering requirements rather than statically processing all components.
Solution Approach 2:
The patent applies local quality processing by ensuring high-accuracy decoding only for the V3C tracks corresponding to the currently visible 3D spatial region, while other tracks may be processed with lower priority or not at all. This approach maintains reconstruction accuracy where needed while reducing overall processing complexity.
3Adaptability or versatility
If complete volumetric media data is transmitted, then full 6-DoF immersive experience is supported, but transmission bandwidth is wasted
Solution Approach 1:
The patent segments the volumetric media bitstream into multiple V3C tracks that can be independently transmitted and processed. This segmentation allows the system to transmit only the necessary tracks corresponding to the visible 3D spatial region, reducing bandwidth consumption while maintaining the capability to support 6-DoF immersive experiences when needed.
Data Source
AI summary
Provided are a method and apparatus for processing volumetric media, a storage medium, and an electronic apparatus. The method includes: identifying a V3C track and a V3C component track from a container file of a V3C bitstream of the volumetric media; obtaining one or more atlas coding sub-bitstreams by decapsulating the V3C track, and obtaining one or more video coding sub-bitstreams that correspond to the one or more atlas coding sub-bitstreams by decapsulating the V3C component track; and generating V3C data of a 3D spatial region of the volumetric media based on the one or more atlas coding sub-bitstreams and the one or more video coding sub-bitstreams.