3D Volumetric Coding Syntax for Multi-Codec Bitstream Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional immersive video systems, such as 3DoF and current V3C frameworks, fail to optimize encoding and decoding for 6DoF experiences due to limitations in accommodating various codec types beyond V-PCC, leading to inefficiencies and increased data overhead.
Innovation Solution
A flexible syntax is introduced for encoding and decoding 3D volumetric data that supports multiple codec types, including point-cloud-based, mesh-based, and depth-image-based codecs, by tailoring syntax functions to relevant parameters, reducing unnecessary data inclusion, and using implicit decoding to enhance efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a standardized V3C framework is used for volumetric coding, then a unified coding structure is established, but optimization for non V-PCC codec types is insufficient
Solution Approach 1:
The syntax structure is made dynamic and adaptive by introducing codec-type-specific syntax functions that are selectively activated based on the identified codec type. The system transitions from a static, one-size-fits-all syntax to a dynamic structure that adapts its parameters and functions to match the specific requirements of V-PCC, V-DMC, or MIV codecs, thereby optimizing encoding efficiency for each type while maintaining framework unity.
Solution Approach 2:
The invention changes parameters by introducing conditional syntax elements that are enabled or disabled based on the codec type identification. Different sets of syntax parameters are activated for different codec types (e.g., V-DMC specific parameters for mesh-based coding), allowing the system to optimize its operational parameters according to the specific codec being used, thus resolving the contradiction between universality and optimization.
2Adaptability or versatility
If all syntax parameters are included in the bitstream for all codec types, then comprehensive coding support is provided, but bitstream size increases
Solution Approach 1:
The invention extracts and separates codec-specific syntax parameters from the universal syntax structure. By identifying the active codec type, the system extracts only the relevant syntax parameters needed for that specific codec type and excludes unnecessary parameters. This extraction process reduces bitstream size by eliminating redundant data while maintaining comprehensive codec support through the selective inclusion of appropriate parameters.
Solution Approach 2:
Instead of including all possible syntax parameters for all codec types (excessive action), the system applies partial action by including only the necessary subset of parameters required for the identified codec type. This partial inclusion strategy reduces bitstream overhead while still providing full functionality for the specific codec being used, effectively balancing comprehensiveness with efficiency.
3Productivity
If codec-specific syntax functions are added for different codec types, then coding optimization is improved, but syntax complexity increases
Solution Approach 1:
The syntax structure is segmented into modular components: a universal base syntax applicable to all codec types and codec-specific syntax extensions for V-PCC, V-DMC, and MIV. This segmentation allows the system to maintain a simple core structure while adding optimization capabilities through optional modules. The segmented approach reduces overall complexity by organizing syntax elements hierarchically and enabling only the necessary segments based on the identified codec type.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods are described for encoding and decoding of 3D volumetric data. Volumetric data is encoded and/or decoded using a syntax that allows for different codec types, such as a point-cloud-based codec type (e.g.. V-PCC), a mesh-based codec type (e.g. V-DMC), and a depth-image-based codec type (e.g. MIV). Example encoding and decoding techniques improve bitrates by allowing for syntax functions that are specific to different codec types, such as syntax functions related to atlas coding, to be tailored to signal only parameters that are relevant to the corresponding codec type that is is used for the volumetric coding.