3D Mesh Vertex Prediction Through Derived Triangulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing complexity and data volume of 3D models pose challenges in efficient compression and transmission, particularly in immersive experiences across different platforms and devices.
Innovation Solution
A method for mesh vertex prediction based on derived mesh triangulation, involving the projection of 3D mesh vertices onto 2D meshes and signaling connectivity information using a 2D occupancy map, where pixels are inferred or explicitly signaled, forming triangle and quad meshes to optimize data representation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If 3D mesh connectivity information is explicitly signaled for all pixels, then mesh reconstruction accuracy is improved, but data volume and compression efficiency deteriorate
Solution Approach 1:
The patent applies local quality by differentiating pixel treatment based on occupancy status. Occupied pixels (where 3D vertices project to 2D mesh) have their connectivity explicitly signaled to ensure accurate mesh reconstruction, while unoccupied pixels use inferred connectivity based on spatial relationships and mesh topology rules. This selective approach maintains high reconstruction accuracy for critical areas while reducing overall data volume.
Solution Approach 2:
The patent implements partial action by signaling connectivity information only for occupied pixels rather than all pixels. The decoder uses the signaled occupied pixel connectivity combined with spatial reasoning and mesh topology constraints to infer connectivity for unoccupied pixels. This partial signaling strategy reduces data transmission requirements while maintaining sufficient mesh reconstruction quality through the combination of explicit and inferred information.
2Quantity of substance
If all pixel connectivity is inferred without explicit signaling, then data compression efficiency is improved, but mesh reconstruction reliability deteriorates
Solution Approach 1:
The patent ensures reliability by applying explicit connectivity signaling specifically to occupied pixels where 3D vertices map to 2D mesh locations. This localized explicit signaling guarantees accurate mesh reconstruction in critical regions, while unoccupied pixels rely on inference based on spatial relationships and topological constraints that are validated against the explicitly signaled occupied pixel connectivity.
Solution Approach 2:
The patent implements feedback mechanisms where the decoder uses the explicitly signaled occupied pixel connectivity information to validate and constrain the inference process for unoccupied pixels. The inferred connectivity is checked for consistency with the signaled occupied pixel topology, allowing correction of inference errors and maintaining overall reconstruction reliability while minimizing data transmission.
3Shape
If 3D mesh data is compressed without projection to 2D, then original 3D geometry is preserved, but compression efficiency and transmission performance worsen
Solution Approach 1:
The patent applies dimensionality change by projecting 3D mesh vertices onto a 2D mesh representation. This projection transforms the high-dimensional 3D connectivity information into a lower-dimensional 2D occupancy map and connectivity graph. The 2D representation captures the essential topological and spatial relationships of the 3D mesh while significantly reducing data volume and improving compression efficiency for transmission and processing.
Data Source
AI summary
There is includes a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining volumetric data of at least one three-dimensional (3D) visual content, obtaining a plurality of 3D meshes from the volumetric data, projecting vertices of the plurality of 3D meshes onto a plurality of two-dimensional (2D) meshes, signaling connectivity information of the plurality of 3D meshes based on the plurality of 2D meshes, wherein the signaling the connectivity information comprises signaling whether ones of pixels of a 2D occupancy map is to be inferred or explicitly signaled.