Mixed Reality Data Collaboration via Priority-Based Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Sharing mixed reality experiences among multiple users or game players is challenging due to the large data storage requirements and latency issues in data-rich environments, especially in low bandwidth conditions, where simultaneous location and mapping systems need to synchronize and share map data across moving sensor platforms.
Innovation Solution
A method for enabling two or more display devices to share mixed reality experiences by geo-locating data subtypes at keyframe locations, prioritizing data based on a hierarchy, and sequentially providing current versions of data subtypes to ensure efficient data transfer and reduce latency, using a synchronization program to update a world map data structure and provide identifiers and version indicators to connected devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all map data is shared among multiple platforms, then complete shared experience is achieved, but data storage capacity becomes extremely large and bandwidth consumption increases
Solution Approach 1:
The patent segments map data into different priority levels (first priority, second priority, third priority) and transmits them separately. High-priority data contains essential information for basic shared experience, while lower-priority data provides additional detail. This segmentation allows platforms to achieve functional shared experiences with reduced data storage requirements.
Solution Approach 2:
The patent extracts and transmits only the most essential data elements first (first priority data), then progressively adds less critical information (second and third priority data). This extraction approach ensures that platforms can operate with minimal data sets while still achieving core shared experience functionality.
2Loss of information
If excessive data is transmitted in low bandwidth environments, then complete information is shared, but latency increases and user experience deteriorates
Solution Approach 1:
The patent performs preliminary prioritization of data before transmission, identifying and sending critical information first (first priority data). This preliminary action ensures that essential shared experience data is transmitted quickly, reducing latency, while less critical data follows in subsequent transmissions.
Solution Approach 2:
The patent implements dynamic data transmission where the amount and type of data sent adapts based on network conditions and user needs. In low-bandwidth scenarios, only high-priority data is transmitted initially, allowing the system to dynamically adjust information completeness based on available bandwidth while minimizing latency.
3Productivity
If data is prioritized and transmitted sequentially, then bandwidth efficiency improves and latency reduces, but data transfer time for complete information increases
Solution Approach 1:
The patent applies partial action by transmitting only the necessary portion of data (first priority and selected second priority data) rather than waiting to transmit all data. This approach achieves sufficient shared experience functionality with reduced total transfer time, accepting that not all data will be transmitted in every scenario.
Data Source
AI summary
Embodiments that relate to sharing mixed reality experiences among multiple display devices are disclosed. In one embodiment, a method includes receiving current versions of a plurality of data subtypes geo-located at a keyframe location. A world map data structure is updated to include the current versions, and a neighborhood request including the keyframe location is received from a display device. Based on the keyframe location, an identifier and current version indicator for each data subtype is provided to the device. A data request from the device for two or more of the data subtypes is received, and the two or more data subtypes are prioritized based on a priority hierarchy. Based on the prioritization, current versions of the data subtypes are sequentially provided to the device for augmenting an appearance of a mixed reality environment.