Shared Scene Mesh Data Synchronization in Mixed Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In collaborative mixed reality applications, maintaining synchronization of objects within a shared scene is challenging due to the need for efficient transfer of surface recreation data, which is crucial for accurate representation and interaction among participants.
Innovation Solution
A communication architecture that includes an image capture device for creating a video channel, intrinsic/extrinsic data determiner, and video encoder to encode image and capture device data, along with a receiver and decoder to extract and decode this data, ensuring synchronized object representation across devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If surface recreation data is transferred efficiently to maintain synchronization, then object representation accuracy is improved, but data transfer complexity increases
Solution Approach 1:
The patent segments surface recreation data into distinct categories: video channel data (intrinsic/extrinsic capture device data) and mesh channel data (surface geometry data). This segmentation allows each type of data to be transmitted through optimized channels, improving representation accuracy while managing complexity through structured data organization.
Solution Approach 2:
The patent utilizes a dual-channel transmission approach, adding a mesh channel dimension alongside the traditional video channel. This dimensional expansion enables simultaneous transmission of both visual appearance data and surface geometry data, resolving the contradiction by providing multiple pathways for different data types.
2Reliability
If intrinsic/extrinsic capture device data is encoded within the video channel, then synchronization reliability is improved, but bandwidth consumption increases
Solution Approach 1:
The patent merges intrinsic/extrinsic capture device data with video channel data, encoding synchronization information within the existing video transmission framework. This combining approach ensures that synchronization data travels with visual data, improving reliability while avoiding the overhead of completely separate transmission channels.
Solution Approach 2:
The video channel is given multi-functionality by encoding both visual content and synchronization metadata within the same channel. This universal approach allows a single channel to serve dual purposes, reducing total bandwidth consumption while maintaining synchronization reliability.
Data Source
AI summary
A user device within a communication architecture, the user device comprising: an image capture device configured to determine image data for the creation of a video channel defining the shared scene; an intrinsic/extrinsic data determiner configured to determine intrinsic/extrinsic capture device data associated with the image capture device; and a video encoder configured to encode the image data and intrinsic/extrinsic capture device data within the video channel.