Point Cloud Encapsulation with Sub-Frame Timing for Partial Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for encoding and encapsulating point cloud data in ISOBMFF format lack efficiency in describing and accessing specific data items, hindering optimal access and partial rendering capabilities.
Innovation Solution
The method involves organizing point cloud data into sub-frames with distinct timing information, generating metadata that describes these sub-frames, and encapsulating them in ISOBMFF files, allowing precise identification and extraction of specific data without decoding unnecessary units.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If point cloud data is encapsulated in ISOBMFF format with detailed metadata for each sub-frame, then access efficiency to specific data units is improved, but device complexity and encoding overhead increase
Solution Approach 1:
The patent segments point cloud data into sub-frames with distinct timing information, allowing independent access to specific time portions. Each sub-frame is encapsulated as a separate sample with its own timing metadata, enabling selective decoding and rendering of individual sub-frames without processing the entire frame, thus improving access efficiency while managing complexity through structured organization.
Solution Approach 2:
The patent performs preliminary encapsulation of timing information for each sub-frame during the encoding phase. By pre-organizing sub-frames with their timing metadata in the ISOBMFF structure, the system enables fast random access to specific sub-frames during playback without requiring complex runtime analysis, thereby improving access efficiency while the encoding complexity is managed through standardized encapsulation procedures.
2Reliability
If all point cloud frames are decoded for complete rendering, then rendering completeness is improved, but processing time and energy consumption increase
Solution Approach 1:
The patent enables partial decoding by organizing point cloud frames into sub-frames with distinct timing information. The rendering system can selectively decode and render only the specific sub-frames required for a given time portion, rather than decoding all sub-frames. This partial action approach maintains rendering completeness for the requested time portion while significantly reducing processing time and energy consumption.
Solution Approach 2:
By segmenting frames into sub-frames with explicit timing metadata, the patent allows the rendering system to identify and process only the necessary sub-frames for the desired time portion. This segmentation enables the system to maintain rendering completeness for the requested portion while avoiding unnecessary processing of other sub-frames, thus reducing overall processing time.
3Speed
If sub-frames are identified and accessed efficiently, then data extraction speed is improved, but metadata structure complexity increases
Solution Approach 1:
The patent segments each point cloud frame into sub-frames with distinct timing information, and encapsulates each sub-frame as a separate sample in the ISOBMFF structure. This segmentation is accompanied by timing metadata that directly associates each sub-frame with its time portion, enabling efficient identification and extraction of specific sub-frames without requiring complex runtime analysis of the metadata structure.
Solution Approach 2:
The patent utilizes the existing ISOBMFF container format and its standard metadata structures to encapsulate point cloud sub-frames with timing information. By leveraging the universal ISOBMFF framework rather than creating a proprietary metadata structure, the patent achieves efficient data extraction through standard-compliant access methods while avoiding the complexity of designing and implementing a new metadata system.
Data Source
AI summary
A method for encapsulating point cloud data in a file compliant with the ISOBMFF standard. After having obtained point cloud data comprising 3D points, the obtained point cloud data being organized in at least one point cloud frame, at least two sub-frames of the at least one point cloud frame are determined, a timing information being associated with each of the at least two sub-frames, the timing information associated with one of the at least two sub-frames being different from the timing information associated with the other of the at least two sub-frames. Next, metadata describing the at least two sub-frames are generated, the generated metadata comprising or describing the timing information associated with each of the at least two sub-frames, and the obtained 3D points and the generated metadata are encapsulated in the file, each point cloud frame being encapsulated as one or more samples.