Dynamic Mesh Compression for Low-Latency Point Cloud Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The generation and transmission of point cloud data is challenging due to its large volume and the high latency and encoding/decoding complexity involved.
Innovation Solution
A method for transmitting and receiving point cloud data using mesh data encoding and decoding, employing Video-based Dynamic Mesh (V-Mesh) compression techniques, including pre-processing, encoding, and decoding processes to efficiently manage and render dynamic mesh content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If point cloud data is transmitted using traditional methods, then data can be transmitted, but the data volume is large and requires high throughput
Solution Approach 1:
The patent segments point cloud data into multiple layers including depth maps, normal maps, and texture maps. Each layer represents different aspects of the 3D data, allowing selective transmission and processing. This segmentation reduces the amount of data that needs to be transmitted at once while maintaining the ability to reconstruct the complete point cloud representation.
Solution Approach 2:
The patent extracts essential features from point cloud data such as depth information, surface normals, and texture characteristics. By extracting only the most important geometric and visual features rather than transmitting all raw point cloud data, the system significantly reduces data volume while preserving the essential 3D structure and appearance needed for VR/AR applications.
2Loss of time
If traditional point cloud transmission methods are used, then data can be transmitted, but latency is high
Solution Approach 1:
The patent performs preliminary processing of point cloud data by pre-computing depth maps, normal maps, and texture maps before transmission. This preprocessing extracts the essential geometric and visual information in advance, so that during actual transmission, only the processed map data needs to be sent, significantly reducing transmission time and latency for real-time VR/AR applications.
3Device complexity
If traditional encoding/decoding methods are used, then point cloud data can be processed, but encoding/decoding complexity is high
Solution Approach 1:
The patent creates simplified 2D map representations (depth maps, normal maps, texture maps) that copy the essential information from complex 3D point cloud data. These 2D maps serve as efficient proxies that can be transmitted and processed much more easily than the original 3D data, while still containing all the necessary information to reconstruct the 3D scene on the client side.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A mesh data transmission method according to embodiments may comprise the steps of: encoding mesh data; and transmitting a bitstream including the mesh data. A mesh data reception method according to embodiments may comprise the steps of: receiving a bitstream including mesh data; and decoding the mesh data.