Dynamic 3D Mesh Inter-Prediction for Lower Data Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Three-dimensional meshes with associated textures or attributes captured by sensors or generated in software result in large data volumes that are costly and time-consuming to store and transmit, limiting their use in real-time applications.
Innovation Solution
Implement an encoder/decoder system that uses inter-prediction techniques to compress and decompress three-dimensional meshes by predicting mesh content from previously decoded frames, leveraging multi-hypothesis methods to exploit temporal redundancies and reduce data transmission requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If three-dimensional mesh data is captured by sensors or generated in software, then detailed spatial and attribute information is obtained, but the data volume becomes large and costly to store and transmit
Solution Approach 1:
The patent segments the three-dimensional mesh data into multiple frames representing different time points. Each frame is further divided into prediction units that can be independently processed. This segmentation allows the system to handle large data volumes by processing smaller units sequentially while maintaining overall reconstruction accuracy.
Solution Approach 2:
The patent applies preliminary action by performing inter-prediction on mesh frames before transmission or storage. Previously decoded frames are used to predict current frame content, and only the residuals (differences) are transmitted or stored. This preliminary compression significantly reduces data volume while preserving measurement precision through the prediction process.
2Quantity of substance
If inter-prediction is used to compress three-dimensional mesh data, then data transmission requirements are reduced, but reconstruction fidelity may be compromised
Solution Approach 1:
The patent implements feedback mechanisms where the decoder uses previously decoded frames to generate predictions and compares these with the received data. The residuals (differences between predicted and actual values) are transmitted back to the decoder, which then applies them to correct the predictions. This feedback loop ensures that reconstruction fidelity is maintained while still achieving compression of data transmission volume.
Solution Approach 2:
The patent uses composite prediction methods that combine multiple prediction hypotheses. Instead of relying on a single prediction source, the system evaluates multiple reference frames and prediction modes, selecting or combining the best predictions. This composite approach maintains high reconstruction fidelity while efficiently reducing data transmission requirements through selective transmission of only necessary residual information.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder predicts, for a current frame of a three-dimensional mesh, vertex values of the current frame using location information from one or more preceding frames or using multiple vertex values from a single frame. Predictors and residuals for determining the current frame may be signaled in a bitstream to a decoder to decompress the three-dimensional mesh.