Base-Mesh Storage in ISOBMFF for Volumetric Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems are unable to store Video-based Dynamic Mesh Coding (V-DMC) compressed bitstreams in the International Organization for Standardization Base Media File Format (ISOBMFF) due to the lack of definition for storing the base-mesh component.
Innovation Solution
The method involves accessing a coded bitstream with video-based dynamic mesh coding, which includes attribute, geometry, atlas, and base-mesh information streams, and storing these streams in a file structure compliant with ISOBMFF. Specifically, the attribute information is stored in an attribute video media track, geometry information in a geometry video media track, atlas information in an atlas volumetric video media track, and base-mesh information in a base-mesh volumetric video media track.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If V-DMC coded bitstream is stored in ISOBMFF file structure, then storage and transmission capability is improved, but storage format compatibility is worsened due to lack of definition for base-mesh component
Solution Approach 1:
The patent segments the V-DMC bitstream into separate components (base-mesh bitstream, geometry bitstream, attribute bitstream, atlas bitstream) and stores each in dedicated tracks within the ISOBMFF file structure. This segmentation allows the base-mesh component to be properly encapsulated without compromising the overall format compatibility, resolving the contradiction between storage capability and format reliability.
Solution Approach 2:
The patent creates a universal storage framework by defining track types and box structures that can accommodate multiple media components (video, audio, subtitles, metadata) within the ISOBMFF format. This multi-functional approach enables V-DMC bitstream storage while maintaining compatibility with existing ISOBMFF-based systems, thereby improving both storage capability and format reliability.
2Adaptability or versatility
If base-mesh component is added to bitstream, then volumetric video coding capability is improved, but device complexity is worsened due to additional storage requirements
Solution Approach 1:
The patent implements a nested structure where the base-mesh bitstream is encapsulated within a TrackBox, which itself contains SampleBoxes with NAL units. This nested organization allows the base-mesh component to be integrated systematically into the existing ISOBMFF structure, improving volumetric video coding capability while managing storage structure complexity through hierarchical organization.
Solution Approach 2:
The patent employs dynamic track configuration where the base-mesh track can be selectively enabled or disabled based on coding requirements. The track contains dynamic elements such as variable NAL unit types and adaptive sample boxes, allowing the system to adjust complexity based on the specific volumetric video coding task while maintaining the enhanced capability.
Data Source
AI summary
An apparatus, performing an encapsulation process, accesses a coded bitstream having V-DMC, wherein the coded bitstream comprises an attribute information bitstream, a geometry information bitstream, an atlas bitstream, and a base-mesh bitstream. The apparatus stores, for later transmission, the coded bitstream having the V-DMC in a file structure compliant with an international organization for standardization base media file format (ISOBMFF). Another apparatus receives the file structure and parses, by the apparatus, the received file structure to extract the coded bitstream having the V-DMC, the coded bitstream comprising an attribute information bitstream, a geometry information bitstream, an atlas bitstream, and a base-mesh bitstream. The apparatus performs decoding with at least the base-mesh bitstream to recreate media, and stores or outputs for display the recreated media.