Tree-Based Point Cloud Compression Using MPEG-DASH

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies lack effective methods for streaming high-quality, immersive 3D point cloud data due to volumetric size and network bandwidth limitations, with existing MPEG standards not adequately supporting real 3D space media streaming.

Innovation Solution

Implementing a tree-based point cloud compression (PCC) media stream using the MPEG-DASH standard, which includes a 3D descriptor and URI to facilitate adaptive streaming, allowing for efficient compression and delivery of 3D media content by utilizing octree-based, k-dimensional, or quadtree-based structures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If tree-based PCC media stream is implemented to compress 3D point cloud data, then compression efficiency is improved and bandwidth requirements are reduced, but device complexity increases due to octree/k-d tree/quadtree structures

Engineering Contradiction:
Improvebandwidth requirementsVSAvoiddevice complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent applies nested doll by organizing point cloud data into hierarchical tree structures (octrees, k-d trees, quadtrees) where parent nodes contain aggregate information and child nodes contain detailed information. This nested organization enables progressive transmission from coarse to fine details, reducing the total bandwidth required while maintaining compression efficiency through multi-resolution representation.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent segments the 3D point cloud space into discrete volumetric units organized in tree structures. Each node in the tree represents a segmented region, allowing independent compression and transmission of different spatial segments. This segmentation enables selective transmission of only necessary segments based on viewer position and interest, reducing overall bandwidth requirements.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If MPEG-DASH standard is extended to support 3D point cloud streaming with 3D descriptors and URIs, then adaptability to 3D content is improved, but device complexity increases due to additional processing requirements

Engineering Contradiction:
Improveadaptability to 3D contentVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extends the existing MPEG-DASH framework to serve multiple purposes: it maintains compatibility with traditional 2D video streaming while adding support for 3D point cloud data through enhanced descriptors and URIs. This universal approach allows the same base infrastructure to handle both 2D and 3D content, improving adaptability without proportionally increasing device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces 3D descriptors and PCC-specific URIs as intermediary elements between the media content and the MPEG-DASH processing pipeline. These intermediaries translate 3D point cloud characteristics into a format that can be processed by existing adaptive streaming mechanisms, enabling 3D content adaptation without requiring complete redesign of the streaming architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If current MPEG-DASH standard is used without modifications for 3D content, then ease of operation is maintained, but adaptability to real 3D space media streaming is insufficient

Engineering Contradiction:
Improveease of operationVSAvoidadaptability to 3D content
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent introduces dynamic 3D descriptors that can adapt to different viewing conditions, point cloud resolutions, and network states. These descriptors dynamically encode spatial relationships and enable the system to adjust 3D content delivery in real-time based on user position and device capabilities, providing adaptability while maintaining operational simplicity through automated adjustments.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11763493B2Method and apparatus for tree-based point cloud compression (PCC) media stream using moving picture experts group (MPEG)-dynamic adaptive streaming over HTTP (DASH)
Publication Date: 2023.09.19 TENCENT AMERICA LLC
  • US11763493B2 patent drawing
  • US11763493B2 patent drawing
  • US11763493B2 patent drawing

AI summary

A method of obtaining a tree-based point cloud compression (PCC) media stream using moving picture experts group (MPEG)-dynamic adaptive streaming over http (DASH), is performed by at least one processor and includes obtaining, from a server, a media representation description (MPD) comprising a PCC uniform resource indicator (URI) and a PCC three-dimensional (3D) descriptor, and determining whether the PCC URI comprised in the obtained MPD indicates that the tree-based PCC media stream is to be accessed. The method further includes, based on the PCC URI being determined to indicate that the tree-based PCC media stream is to be accessed, obtaining, from the server, the tree-based PCC media stream, using the PCC 3D descriptor comprised in the obtained MPD.