3D Mesh Patch Stitching Using Curvature-Guided Border Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mesh coding techniques struggle with patch reconstruction, resulting in discontinuities and visible gaps between submeshes due to mismatched borders and ambiguous blending, which affects the quality of reconstructed mesh surfaces in volumetric video.
Innovation Solution
A method involving curvature-guided inter-patch stitching is employed to blend reconstructed submeshes based on curvature continuity, using parameters like inter-patch distance thresholds and patch indices to ensure smooth transitions and correct texture interpolation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If mesh representation is segmented into two-dimensional projections for compression, then data transmission efficiency is improved, but reconstruction quality deteriorates due to patch discontinuities and visible gaps
Solution Approach 1:
The patent performs preliminary actions by computing and storing curvature parameters and border fusion parameters during the encoding phase. These parameters are pre-calculated and transmitted to the decoder, enabling the reconstruction process to seamlessly blend patches without requiring complex real-time calculations, thus maintaining both transmission efficiency and reconstruction quality
Solution Approach 2:
The patent introduces curvature parameters and border fusion parameters as intermediary elements that mediate between the segmented patches and the final reconstructed mesh. These parameters act as guides to smoothly blend patch boundaries, eliminating visible gaps while preserving the compression benefits of segmentation
2Stability of the object's composition
If patches are stitched together for mesh reconstruction, then complete three-dimensional mesh is achieved, but visible gaps and discontinuities appear at patch borders
Solution Approach 1:
The patent applies local quality by using curvature parameters to guide border fusion at specific locations where patches meet. The blending operation is localized to patch boundaries while preserving the original patch interiors, ensuring surface continuity exactly where needed without affecting the overall mesh structure
Solution Approach 2:
The patent changes parameters by computing curvature values and border fusion parameters that quantify the geometric properties at patch boundaries. These parameters are used to adjust vertex positions and normals during blending, transforming discontinuous patch edges into smooth continuous surfaces
3Manufacturing precision
If border fusion is performed to blend patches, then surface smoothness is improved, but computational complexity increases
Solution Approach 1:
The patent performs preliminary action by pre-computing curvature parameters and border fusion parameters during encoding and transmitting them to the decoder. This shifts the computational burden to the encoding phase and enables the decoder to perform simple parameter-based blending operations, reducing real-time computational complexity while maintaining surface smoothness
Data Source
AI summary
An apparatus performs an encoding process including: obtaining a mesh representation of a 3D object; segmenting the mesh representation into 2D projections; reconstructing a 3D mesh from the segmented 2D projections by stitching reconstructed patches, the patches being submeshes of the reconstructed 3D mesh, the stitching performing border fusion based at least on curvature of the patches, to derive parameters for the stitching; and encoding the segmented 2D projections into a bitstream. The apparatus signals the parameters in or along with the bitstream and transmits. An apparatus performing decoding receives the bitstream and signaled parameters, reconstructs a 3D mesh from the segmented 2D projections, and stitches reconstructed submeshes created during the reconstruction together at least as patches, the stitching using the signaled parameters to fuse together pairs of vertices for borders of corresponding patches. The apparatus outputs a modified 3D mesh based at least on the stitching.