Adaptive V-PCC Point Cloud Streaming with MPEG-DASH Signaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current MPEG-DASH standards do not provide signaling mechanisms for streaming point cloud media, including those based on the MPEG V-PCC standard, necessitating the development of new signaling elements to enable adaptive streaming of point cloud data over networks.
Innovation Solution
Introduce new XML elements and descriptors within the MPEG-DASH MPD file to signal point cloud streams and their components, allowing streaming clients to identify and select the best versions of point cloud components based on network capacity and client capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If new XML elements and descriptors are introduced in the MPEG-DASH MPD file to signal point cloud streams, then adaptive streaming capability for point cloud data is enabled, but the complexity of the signaling mechanism increases
Solution Approach 1:
The signaling mechanism is segmented into multiple hierarchical levels: MPD-level descriptors for overall point cloud stream identification, AdaptationSet-level descriptors for component grouping, and Representation-level parameters for specific version characteristics. This segmentation allows complex point cloud streaming information to be organized in manageable, modular units that can be processed independently at different stages of the streaming pipeline.
Solution Approach 2:
The patent introduces a new dimensional layer of signaling by adding XML elements and descriptors that operate alongside the existing MPEG-DASH structure. This creates a multi-dimensional signaling space where traditional video/audio streaming parameters coexist with point cloud-specific parameters (such as occupancy map configurations, geometry precision levels, and attribute types), enabling comprehensive point cloud adaptation without disrupting existing streaming infrastructure.
2Adaptability or versatility
If multiple versions of point cloud components are signaled with different resolutions and qualities, then client selection flexibility is improved, but the quantity of signaling data increases
Solution Approach 1:
The signaling mechanism implements partial action by providing detailed version information only for point cloud components that have multiple representations. For components with a single version, minimal signaling is used. This selective approach reduces overall signaling data volume while maintaining full client selection flexibility where needed, avoiding the overhead of signaling unnecessary information for all components uniformly.
Solution Approach 2:
The signaling structure dynamically adapts to the actual content being streamed. When multiple versions of a point cloud component are available, the system activates detailed version signaling with multiple Representation elements. When only a single version exists, the signaling automatically simplifies. This dynamic behavior ensures that signaling data volume matches the actual adaptation needs, preventing unnecessary data transmission.
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
Methods, apparatus, and systems directed to adaptive streaming of V-PCC (Video-based Point Cloud Compression) data using an adaptive HTTP streaming protocol, such as MPEG DASH. A method includes signaling the point cloud data of the point cloud in a DASH MPD including: a main AdaptationSet for the point cloud, including at least (1) a @codecs attribute that is set to a unique value signifying that the corresponding AdaptationSet corresponds to V-PCC data and (2) an initialization segment containing at least one V-PCC sequence parameter set for a representation of the point cloud; and a plurality of component AdaptationSets, each corresponding to one of the V-PCC components and including at least (1) a VPCCComponent descriptor identifying a type of the corresponding V-PCC component and (2) at least one property of the V-PCC component; and transmitting the DASH bitstream over the network.