3D Point Cloud Bitstream Layering for Spatial Scalability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems, such as ISOBMFF, do not support spatial scalability for V3C bitstreams, requiring complex analysis to construct 3D data with desired levels of detail (LoD), making it difficult to efficiently reproduce 3D data using spatial scalability.
Innovation Solution
An information processing device and method that encodes 2D data from a point cloud with spatial scalability, generating a bitstream and spatial scalability information, and stores this information in a file format like ISOBMFF, allowing easy selection and decoding of desired layers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If spatial scalability information is not stored in the system layer, then the file format remains simple and compatible, but clients require complex analysis of the V3C bitstream to construct 3D data with desired LoD
Solution Approach 1:
The patent applies preliminary action by pre-processing the V3C bitstream during encoding to extract and store spatial scalability information in the system layer. This preliminary extraction of layer structure, resolution, and LoD information eliminates the need for complex runtime analysis by clients, allowing them to easily select and decode appropriate layers for desired LoD.
2Productivity
If spatial scalability information is stored in the system layer, then clients can easily select and decode desired layers, but the file format structure becomes more complex
Solution Approach 1:
The patent uses an intermediary approach by introducing a dedicated spatial scalability information structure that acts as a mediator between the complex V3C bitstream and the simple file format. This intermediate structure stores essential scalability parameters (layer IDs, resolutions, LoD information) in a standardized format, enabling efficient client processing without requiring direct parsing of the complex bitstream.
3Adaptability or versatility
If clients decode the entire V3C bitstream to access spatial scalability, then all 3D data is available, but bandwidth consumption increases and network efficiency decreases
Solution Approach 1:
The patent applies segmentation by dividing the V3C bitstream into distinct layers with different LoD levels and storing spatial scalability information that identifies these segments. Clients can selectively decode only the necessary layers based on network conditions and device capabilities, rather than decoding the entire bitstream. This segmentation enables adaptive streaming where lower LoD layers are used for bandwidth-constrained scenarios.
Data Source
AI summary
The present disclosure relates to an information processing device and a method capable of more easily reproducing 3D data using spatial scalability.2D data obtained by two-dimensionally converting a point cloud representing an object having a three-dimensional shape as a set of points and corresponding to spatial scalability is encoded, a bitstream including a sub-bitstream obtained by encoding the point cloud corresponding to a single or plurality of layers of the spatial scalability is generated, spatial scalability information regarding the spatial scalability of the sub-bitstream is generated, and a file that stores the bitstream generated and the spatial scalability information generated is generated. The present disclosure can be applied to, for example, an information processing device, an information processing method, or the like.