ISOBMFF V-PCC Tile Tracks for Partial Point Cloud Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video-based point cloud compression (V-PCC) signaling methods are inadequate for partial access to V-PCC sequences, particularly in International Organization for Standardization Base Media File Format (ISOBMFF) containers.
Innovation Solution
The proposed solution involves a video encoding device that partitions a 3D space into spatial regions, maps these regions to sets of V-PCC tiles, and associates each tile with an atlas frame. The device then sends timed-metadata V-PCC bitstreams containing track information and update flags to enable flexible partial access to different parts of the coded point cloud sequence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If current V-PCC signaling methods are used, then the bitstream structure is simple, but partial access to V-PCC sequences is inadequate
Solution Approach 1:
The patent segments the V-PCC bitstream into multiple independent tile groups, where each tile group can be independently decoded and accessed. This is achieved by dividing the point cloud data into multiple tiles organized in groups, with each group having its own syntax elements and data structures. The segmentation enables partial access to specific regions of interest without requiring decoding of the entire bitstream, thus improving adaptability while maintaining manageable complexity through structured organization.
Solution Approach 2:
The patent introduces a new dimension of organization by creating a hierarchical structure with tile groups at one level and individual tiles at another level. This multi-level hierarchy adds structural depth to the signaling, allowing access control and decoding operations to occur at different granularities. The dimensional expansion from flat bitstream structure to hierarchical tile group structure enables flexible partial access while organizing complexity in a manageable framework.
2Productivity
If the entire V-PCC sequence is decoded, then complete point cloud data is obtained, but computational resources and time are excessive for partial access needs
Solution Approach 1:
The patent extracts and isolates specific tile groups from the complete V-PCC sequence, allowing the decoder to process only the extracted portions that contain regions of interest. By separating desired data from the complete sequence and providing independent syntax elements for each tile group, the system enables selective decoding that eliminates unnecessary computational overhead associated with decoding entire sequences when only partial access is required.
Solution Approach 2:
The patent implements partial action by enabling decoders to perform only the necessary decoding operations for specific tile groups rather than processing the complete V-PCC sequence. The independent structure of tile groups with their own syntax elements allows the decoder to execute partial decoding operations, performing exactly the amount of work needed to access regions of interest without excessive processing of unrelated data, thus improving productivity and reducing time loss.
3Adaptability or versatility
If spatial regions are partitioned and mapped to multiple tile sets, then flexible partial access is enabled, but the mapping complexity increases
Solution Approach 1:
The patent applies local quality by assigning different properties and characteristics to different tile groups based on their spatial locations and importance. Each tile group can have independent syntax elements, data structures, and decoding parameters tailored to its specific requirements. This localized approach allows flexible access to different regions with appropriate processing characteristics while organizing the overall mapping structure in a systematic manner that manages complexity through consistent local patterns.
Solution Approach 2:
The patent utilizes parameter changes by allowing different syntax elements and configuration parameters to be applied to different tile groups. The mapping structure supports variable parameters for each tile group, enabling adaptive control over decoding behavior, precision, and resource allocation based on regional requirements. This parameter variability provides access flexibility while the structured parameter organization maintains manageable complexity through consistent rules and patterns.
Data Source
AI summary
Systems, devices, and methods are described herein for partial access support in SOBMFF containers for video-based point cloud streams. A video encoding device may partition a 3D space into a first spatial region and a second spatial region, The video encoding device may map the first spatial region to a first set of V-PCC tiles and the second spatial region to a second set of V-PCC tiles. The video encoding device may determine a first track to carry first mapping information associated with the first spatial region that is mapped to the first set of V-PCC tiles. The video encoding device may determine a second track to carry second mapping information associated with the second spatial region that is mapped to the second set of V-PCC files. The video encoding device may send In a timed-metadata V-PCC bitstream the first track and the second track,


