ISOBMFF V-PCC Tile Mapping for Partial Point Cloud Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video-based point cloud compression (V-PCC) signaling is inadequate for partial access to different parts of a coded point cloud sequence, limiting flexible access to specific regions or objects within point cloud data.
Innovation Solution
A video encoding device partitions a 3D space into spatial regions, maps them to sets of video-based point cloud compression (V-PCC) tiles, and sends mapping information in a timed-metadata V-PCC bitstream within an ISOBMFF container, enabling flexible partial access to different parts of the point cloud sequence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If current V-PCC signaling is used, then the bitstream structure is simple, but partial access to specific regions or objects is not enabled
Solution Approach 1:
The patent segments the point cloud data into multiple independent V-PCC tiles, each representing a specific spatial region. This segmentation enables selective access to individual tiles or groups of tiles corresponding to objects of interest, achieving partial access without requiring the entire point cloud data. The tile-based structure allows the system to provide flexible region-of-interest access while maintaining manageable complexity through standardized tile definitions.
Solution Approach 2:
The patent introduces a temporal dimension to the data structure by creating multiple versions of the point cloud at different times (first point cloud data at first time, second point cloud data at second time). This temporal dimensionality allows the system to provide historical context and enable access to specific regions across different time points, enhancing the adaptability for partial access applications such as change detection and temporal analysis.
2Loss of time
If the entire point cloud sequence is processed, then complete data is available, but processing time and computational resources increase
Solution Approach 1:
The patent extracts only the necessary portions of the point cloud data by allowing selective decoding of specific V-PCC tiles based on user needs or region of interest. Instead of processing the entire point cloud sequence, the system can extract and process only the tiles corresponding to objects or regions of interest, significantly reducing processing time and computational resources while maintaining data completeness for the accessed regions.
Solution Approach 2:
The patent enables partial action by allowing the system to process and decode only a subset of the available point cloud data (specific tiles) rather than the complete dataset. This partial processing approach reduces computational burden and processing time while providing sufficient information for the intended application, avoiding the excessive action of processing the entire point cloud when only portions are needed.
3Adaptability or versatility
If spatial regions are partitioned into multiple tiles, then flexible access is enabled, but the system complexity increases
Solution Approach 1:
The patent implements universality by creating a standardized tile-based mapping system that can serve multiple functions: spatial region partitioning, object identification, temporal data organization, and selective decoding. The same tile structure used for spatial partitioning also serves as the basis for temporal data organization and object-level access, reducing overall system complexity despite the increased functionality.
Solution Approach 2:
The patent applies nesting by organizing the point cloud data into hierarchical structures where V-PCC tiles are nested within spatial regions, which are nested within the complete point cloud sequence. This nested organization allows the system to manage complexity through levels of abstraction, where each level can be independently processed and accessed, reducing the perceived complexity while maintaining high adaptability for region-specific access.
Data Source
AI summary
Systems, devices, and methods are described herein for partial access support in ISOBMFF containers for video-based point cloud streams. A video encoding device may partition a 3D space into a first spatial region and a second spatial region. The video encoding device may map the first spatial region to a first set of V-PCC tiles and the second spatial region to a second set of V-PCC tiles. The video encoding device may determine a first track to carry first mapping information associated with the first spatial region that is mapped to the first set of V-PCC tiles. The video encoding device may determine a second track to carry second mapping information associated with the second spatial region that is mapped to the second set of V-PCC tiles. The video encoding device may send in a timed-metadata V-PCC bitstream the first track and the second track.