3D Mesh Vertex Prediction from Decoded Neighbors for Layered Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing complexity and data volume of 3D models pose challenges in efficient transmission and rendering across different platforms, necessitating improved compression techniques for immersive experiences.
Innovation Solution
A method involving mesh vertex prediction based on derived mesh triangulation for dynamic mesh compression, utilizing processors to derive displacement vectors and signal volumetric data, enabling efficient compression and transmission of 3D visual content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If mesh complexity and detail are increased to improve 3D model quality, then rendering quality and realism are improved, but data volume and transmission complexity increase
Solution Approach 1:
The mesh is divided into multiple layers with different levels of detail. The first layer contains coarse geometry with fewer vertices, while subsequent layers add finer details with more vertices. This segmentation allows progressive refinement of 3D model quality while managing data volume through selective transmission of layer details based on requirements.
Solution Approach 2:
The patent introduces a temporal dimension by organizing mesh data into multiple layers that can be progressively decoded and rendered. Instead of transmitting all detailed vertices at once, the system transmits layer information sequentially, allowing receivers to reconstruct 3D models at varying quality levels over time, thus reducing initial data volume while maintaining quality options.
2Manufacturing precision
If mesh detail and vertex quantity are increased to improve rendering quality, then immersive experience is improved, but transmission efficiency and processing load increase
Solution Approach 1:
The patent implements dynamic mesh compression by organizing vertices into multiple layers that can be selectively transmitted and decoded. The system dynamically adjusts which layers are transmitted based on bandwidth conditions and quality requirements. Coarse first layers are always transmitted, while finer detail layers are transmitted selectively, enabling adaptive transmission efficiency while maintaining rendering quality when needed.
Solution Approach 2:
The mesh is pre-processed into a hierarchical layer structure before transmission. The first layer with coarse geometry is prepared and transmitted first, establishing a base mesh. Subsequent layers with finer details are prepared as incremental updates. This preliminary organization allows receivers to quickly reconstruct a usable 3D model from the first layer while having the option to progressively add detail layers, improving transmission efficiency by sending only necessary data.
Data Source
AI summary
A method and apparatus comprising computer code configured to cause a processor or processors to obtain volumetric data of at least one three-dimensional (3D) visual content, derive a first layer of a mesh including a plurality of first vertices from at least one frame of the volumetric data, determine displacement vectors from ones of the plurality of vertices of the first layer to respective ones of a plurality of second vertices of a second layer of the mesh, a total quantity of the plurality of second vertices is greater than a total quantity of the plurality of first vertices, and signal the volumetric data based on the displacement vectors.