Shared Scene Mesh Synchronization Bandwidth Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In collaborative mixed reality applications, maintaining synchronization of objects within a shared scene is challenging due to the inefficient transfer of surface reconstruction data, which affects the rendering and interaction of objects across multiple user devices.
Innovation Solution
A communication architecture that includes an image capture device, surface reconstruction entity, video channel, surface reconstruction channel, and a bandwidth controller to encode, packetize, and transmit image and surface reconstruction data, with the bandwidth controller determining average short-term and long-term bandwidth requirements to control the level-of-detail parameter in surface reconstruction data encoding, ensuring efficient bandwidth allocation between video and surface reconstruction channels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If surface reconstruction data is transferred with high detail to maintain object synchronization accuracy, then object rendering precision is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent applies local quality by differentiating the level of detail (LOD) for surface reconstruction data based on object characteristics and scene importance. Critical objects maintain high detail for synchronization accuracy, while less important objects use lower detail representations, optimizing the balance between rendering precision and bandwidth consumption.
Solution Approach 2:
The system dynamically adjusts the level of detail for surface reconstruction data based on real-time conditions including object motion, viewer distance, and scene context. This dynamic adaptation allows the system to maintain high precision when needed while reducing bandwidth consumption during normal operation.
2Productivity
If surface reconstruction data is compressed to reduce bandwidth consumption, then network efficiency is improved, but data transfer time increases
Solution Approach 1:
The surface reconstruction data transmission is segmented into priority levels and batches. Critical synchronization data is transmitted with higher priority and less compression, while non-critical data uses higher compression ratios. This segmentation allows the system to maintain overall synchronization accuracy while improving network efficiency through selective compression.
Solution Approach 2:
The system performs preliminary processing of surface reconstruction data by pre-computing level of detail representations and identifying critical objects before transmission. This preliminary action enables more efficient real-time transmission by avoiding complex compression operations during data transfer.
3Measurement precision
If level of detail parameter is increased for surface reconstruction data, then object synchronization accuracy is improved, but processing complexity increases
Solution Approach 1:
The system applies partial action by computing level of detail representations only for objects that require high synchronization accuracy, rather than processing all objects at maximum detail. This selective approach maintains synchronization accuracy for critical objects while reducing overall processing complexity.
4Manufacturing precision
If bandwidth is allocated primarily to video channel for visual quality, then video rendering is improved, but surface reconstruction synchronization deteriorates
Solution Approach 1:
The system implements feedback mechanisms that monitor both video rendering quality and object synchronization status. Based on this feedback, the bandwidth controller dynamically adjusts the level of detail parameter for surface reconstruction data to maintain synchronization reliability while preserving video quality within available bandwidth constraints.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A user device within a communication architecture, the user device comprising: an image capture device configured to determine image data and intrinsic/extrinsic capture device data for the creation of a video channel defining a shared scene; a surface reconstruction entity configured to determine surface reconstruction data associated with the image data from the image capture device; a video channel configured to encode and packetize the image data and intrinsic/extrinsic capture device data; a surface reconstruction channel configured to encode and packetize the surface reconstruction data; a transmitter configured to transmit the video and surface reconstruction channel packets; and a bandwidth controller configured to control the bandwidth allocated to the video channel and the surface reconstruction channel.