Adaptive V-PCC Point Cloud Streaming with MPEG-DASH Signaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current MPEG-DASH standards do not provide signaling mechanisms for streaming point cloud media, including those based on the MPEG V-PCC standard, necessitating the development of new signaling elements to enable adaptive streaming of point cloud data over networks.

Innovation Solution

Introduce new XML elements and descriptors within the MPEG-DASH MPD file to signal point cloud streams and their components, allowing streaming clients to identify and select the best versions of point cloud components based on network capacity and client capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If new XML elements and descriptors are introduced in the MPEG-DASH MPD file to signal point cloud streams, then adaptive streaming capability for point cloud data is enabled, but the complexity of the signaling mechanism increases

Engineering Contradiction:
Improveadaptive streaming capabilityVSAvoidsignaling mechanism complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The signaling mechanism is segmented into multiple hierarchical levels: MPD-level descriptors for overall point cloud stream identification, AdaptationSet-level descriptors for component grouping, and Representation-level parameters for specific version characteristics. This segmentation allows complex point cloud streaming information to be organized in manageable, modular units that can be processed independently at different stages of the streaming pipeline.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimensional layer of signaling by adding XML elements and descriptors that operate alongside the existing MPEG-DASH structure. This creates a multi-dimensional signaling space where traditional video/audio streaming parameters coexist with point cloud-specific parameters (such as occupancy map configurations, geometry precision levels, and attribute types), enabling comprehensive point cloud adaptation without disrupting existing streaming infrastructure.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If multiple versions of point cloud components are signaled with different resolutions and qualities, then client selection flexibility is improved, but the quantity of signaling data increases

Engineering Contradiction:
Improveclient selection flexibilityVSAvoidsignaling data volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The signaling mechanism implements partial action by providing detailed version information only for point cloud components that have multiple representations. For components with a single version, minimal signaling is used. This selective approach reduces overall signaling data volume while maintaining full client selection flexibility where needed, avoiding the overhead of signaling unnecessary information for all components uniformly.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The signaling structure dynamically adapts to the actual content being streamed. When multiple versions of a point cloud component are available, the system activates detailed version signaling with multiple Representation elements. When only a single version exists, the signaling automatically simplifies. This dynamic behavior ensures that signaling data volume matches the actual adaptation needs, preventing unnecessary data transmission.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3935857B1Methods and apparatus for adaptive streaming of point clouds
Publication Date: 2025.07.02 INTERDIGITAL VC HOLDINGS INC
  • EP3935857B1 patent drawingFigure 1A
  • EP3935857B1 patent drawingFigure 1B
  • EP3935857B1 patent drawingFigure 2

AI summary

Methods, apparatus, and systems directed to adaptive streaming of V-PCC (Video-based Point Cloud Compression) data using an adaptive HTTP streaming protocol, such as MPEG DASH. A method includes signaling the point cloud data of the point cloud in a DASH MPD including: a main AdaptationSet for the point cloud, including at least (1) a @codecs attribute that is set to a unique value signifying that the corresponding AdaptationSet corresponds to V-PCC data and (2) an initialization segment containing at least one V-PCC sequence parameter set for a representation of the point cloud; and a plurality of component AdaptationSets, each corresponding to one of the V-PCC components and including at least (1) a VPCCComponent descriptor identifying a type of the corresponding V-PCC component and (2) at least one property of the V-PCC component; and transmitting the DASH bitstream over the network.