Point Cloud Multitrack Encapsulation With Slice Ordering Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing encapsulation methods for slice-based point cloud frames in media files are inefficient, particularly in terms of multitrack encapsulation, leading to challenges in generating properly ordered bit-streams for decoding and rendering.

Innovation Solution

A method and device for encapsulating slice-based point cloud data in a media file by selecting tracks based on data unit types and providing additional metadata to ensure proper ordering, allowing parsers to generate compliant bit-streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If slice-based point cloud frames are encapsulated in multiple tracks, then encoding efficiency and flexibility are improved, but the complexity of generating properly ordered bit-streams increases

Engineering Contradiction:
Improveencoding efficiencyVSAvoidbit-stream generation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the encapsulation process into separate tracks for different data unit types (e.g., geometry data units, attribute data units, defaulted attribute data units). Each track handles a specific subset of data units, which simplifies the encapsulation logic while enabling efficient parallel processing. The segmentation is further refined by creating separate tracks for different slice identifiers within the same frame, allowing independent management of spatial partitions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a preliminary sorting step where data units are organized and pre-sorted by slice identifier before encapsulation. This preliminary organization ensures that when bit-streams are generated from the encapsulated tracks, the data units are already in the correct order, eliminating the need for complex reordering operations during bit-stream generation and reducing overall system complexity.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If data units are distributed across multiple tracks, then decoding flexibility and parallel processing are improved, but the difficulty of ensuring proper data unit ordering increases

Engineering Contradiction:
Improvedecoding flexibilityVSAvoiddata unit ordering verification
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent incorporates feedback mechanisms through metadata structures that explicitly record the original ordering information of data units across slices. This metadata acts as a reference that feeds back to the decoding process, enabling the system to verify and restore proper ordering even when data units are distributed across multiple tracks. The feedback loop ensures that decoding flexibility does not compromise ordering integrity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces metadata as an intermediary element between the multi-track encapsulation and the final bit-stream generation. This metadata serves as a mediator that carries ordering information and enables the system to reconcile the distributed nature of multi-track storage with the sequential requirements of bit-stream output. The intermediary metadata layer simplifies the verification process by providing explicit ordering guidance without requiring complex real-time analysis.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If additional metadata is added to characterize relative order of data units, then bit-stream compliance with MPEG-I Part-9 is improved, but the size of the encapsulated data increases

Engineering Contradiction:
Improvebit-stream format complianceVSAvoidencapsulated data size
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by adding metadata only at specific critical points where ordering information is needed, rather than uniformly across all data. The metadata is selectively inserted to characterize the relative order of data units between different slices, particularly at slice boundaries and in metadata structures where ordering disambiguation is most important. This localized approach ensures bit-stream compliance while minimizing the overall data size increase.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20250343923A1Method, device, and computer program for improving multitrack encapsulation of point cloud data
Publication Date: 2025.11.06 CANON KK
  • US20250343923A1 patent drawing
  • US20250343923A1 patent drawing
  • US20250343923A1 patent drawing

AI summary

According to some embodiments of the disclosure, it is provided a method for encapsulating a bit-stream in a media file comprising different tracks, the bit-stream comprising point cloud data, the point cloud data comprising slice-based point cloud frames, the slices of the point cloud frames comprising data units of different types. After having obtained first data units of a first slice of one point cloud frame and second data units of a second slice of the point cloud frame, each of the obtained first and second data units is encapsulation encapsulated in a track of the media file, as a function of a type of the data unit. At least one item of information characterizing the relative position in the tracks of the media file of the first data units with regard to the second data units is obtained and encapsulated in the media file.