Dynamic Mesh Submesh Coding for Selective Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mesh encoding and decoding operations, particularly with large numbers of vertices and high frame rates, face challenges in achieving real-time encoding and decoding, and subdivision of meshes into submeshes does not support partial access and efficient delivery of mesh portions for rendering.
Innovation Solution
The proposed method involves subdividing meshes into submeshes with association information, allowing independent decoding and reconstruction based on scene objects and visibility cones, and encoding these submeshes into a compressed bitstream for efficient partial decoding and reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a mesh is subdivided into multiple submeshes based on semantic differences, then the mesh can be encoded and decoded independently in parallel, but partial access and efficient delivery of specific mesh portions for rendering is not supported
Solution Approach 1:
The mesh is divided into multiple submeshes based on semantic differences (e.g., different body parts in medical imaging), allowing each submesh to be independently encoded, decoded, and processed. This segmentation enables parallel processing while maintaining the ability to access and deliver only the required submeshes for specific rendering tasks, thus resolving the contradiction between improved processing speed and partial access capability.
2Reliability
If all submeshes are delivered and decoded to render a specific portion of an object, then complete reconstruction is achieved, but transmission time and processing overhead increase
Solution Approach 1:
The patent extracts and identifies only the specific submeshes required for rendering a particular portion of an object using association information and scene object indices. Instead of delivering and decoding all submeshes, the system selectively extracts and processes only the necessary submeshes, thereby maintaining reconstruction completeness for the required region while significantly reducing transmission time and processing overhead.
3Adaptability or versatility
If association information between scene objects and submeshes is encoded, then partial decoding and reconstruction can be enabled, but the compressed bitstream size increases
Solution Approach 1:
The association information is encoded in a targeted and efficient manner, providing detailed indexing and mapping data only where needed to enable partial decoding. The encoding scheme optimizes the representation of relationships between scene objects and submeshes, ensuring that the additional bitstream size is minimized while still providing sufficient information for selective submesh identification and reconstruction.
Data Source
AI summary
An apparatus comprises a communication interface and a processor operably coupled to the communication interface. The communication interface is configured to receive a compressed bitstream including association information between scene objects and submeshes. The processor is configured to determine an index of a scene object, decode the association information between scene objects and submeshes, determine an identifier of a submesh based on the association information and the index of the scene object, and reconstruct the submesh based on the identifier.