Bifurcated Octree Transmission for 3D Telepresence
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional octree transmission for 3D telepresence data requires reliable transport protocols like TCP, which can lead to delayed rendering of point clouds due to retransmissions of lost data, negatively impacting user experience.
Innovation Solution
The method involves transmitting higher-level octree data using a reliable transport mechanism for retransmissions, while lower-level data is sent using a less reliable transport mechanism that does not require retransmissions, allowing for strategic data discarding to improve user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a reliable transport mechanism like TCP is used to transmit octree data, then data transmission reliability is improved, but transmission latency increases due to retransmissions of lost data
Solution Approach 1:
The patent segments the octree data into two distinct parts: higher-level octree data and lower-level octree data. This segmentation allows different transmission strategies to be applied to each part, resolving the contradiction by making higher-level data (critical for decoding) transmitted reliably while lower-level data (less critical) transmitted with lower reliability to reduce latency.
Solution Approach 2:
The patent applies different quality levels of transmission to different parts of the octree data. Higher-level data receives high-quality reliable transmission to ensure decoding success, while lower-level data receives lower-quality transmission that tolerates losses. This local differentiation resolves the contradiction by optimizing reliability where needed and reducing latency where possible.
2Manufacturing precision
If all octree data is transmitted using a reliable transport mechanism, then decoding accuracy is improved, but user experience deteriorates due to delayed rendering
Solution Approach 1:
The patent divides octree data into higher-level and lower-level segments, transmitting the former reliably to maintain decoding accuracy while transmitting the latter with lower reliability to enable timely rendering and improve user experience.
Solution Approach 2:
The patent applies full reliability only to the extent necessary for successful decoding (higher-level data), and reduces reliability for lower-level data where perfect accuracy is not essential. This partial application of reliability maintains decoding accuracy while improving user experience through reduced latency.
3Speed
If lower-level octree data is transmitted using a less reliable transport mechanism, then transmission speed is improved, but data loss increases
Solution Approach 1:
The patent segments data into higher-level and lower-level octree data, allowing lower-level data to be transmitted faster with less reliable mechanisms while accepting some data loss, as this segment is less critical for overall decoding success.
Solution Approach 2:
The patent applies different reliability qualities to different data segments: high reliability for higher-level data and lower reliability for lower-level data. This allows faster transmission of lower-level data with acceptable loss rates while maintaining overall decoding accuracy through reliable higher-level data transmission.
Data Source
AI summary
In certain embodiments, higher-level octree telepresence data for a point cloud of a 3D object is transmitted using a reliable transport mechanism that ensures successful transmission, e.g., via re-transmission of dropped packets, and lower-level octree data for the point cloud is transmitted using a non-reliable transport mechanism that does not guarantee successful transmission. When the lower-level data is contained in one or more of the bottom-most layers in the octree representation, at least some of the point cloud might be able to be reconstructed using successfully received data even when some lower-level data is lost and not re-transmitted. Using non-reliable transmission can reduce latency by avoiding time-consuming re-transmissions. The resulting reconstructed point cloud will be incomplete, but it might be sufficiently complete to provide satisfactory user experience with lower latency that using reliable transport for the entire octree.