Cross-Reality Localization for Bandwidth-Efficient Shared Virtual Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing cross reality (XR) systems face challenges in efficiently rendering shared location-based virtual content across multiple devices, particularly in terms of computational resources, network bandwidth, and maintaining persistent spatial information, which affects the immersive experience for users.
Innovation Solution
A cross reality system with a cloud-based localization service that provides shared location-based content, utilizing a networked resource with stored maps and data structures to manage virtual content rendering, including persistent coordinate frames (PCFs) and efficient localization techniques to reduce computational and network burden, enabling accurate and immersive experiences across devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the system renders shared location-based virtual content across multiple devices with high fidelity, then the immersive experience is improved, but the computational overhead and network bandwidth consumption increase
Solution Approach 1:
The patent segments the virtual content rendering process by dividing the 3D environment into multiple regions, each with its own data structure. Only the regions currently visible to each device are rendered and transmitted, significantly reducing computational overhead and network bandwidth consumption while maintaining high-fidelity immersive experience for active regions
Solution Approach 2:
The system applies local quality by providing high-resolution virtual content only in the specific regions where devices are currently located, rather than uniformly across the entire environment. This ensures immersive experience quality at the user's location while minimizing overall computational and network resources
2Stability of the object's composition
If the system maintains persistent spatial information across multiple devices, then the shared experience consistency is improved, but the network bandwidth consumption increases
Solution Approach 1:
The system performs preliminary action by pre-defining data structures for multiple regions in the 3D environment before devices arrive. Each data structure contains pre-configured information about virtual content for that region, allowing devices to quickly locate and render appropriate content without extensive real-time data transmission, thus maintaining spatial persistence with reduced network bandwidth
Solution Approach 2:
The patent uses copying by providing each device with a copy of the relevant data structure for its current region rather than transmitting the entire spatial information database. This allows devices to maintain persistent spatial information locally while minimizing network bandwidth consumption for data transmission
3Measurement precision
If the system provides detailed localization information to multiple devices, then the positioning accuracy is improved, but the computational resources required increase
Solution Approach 1:
The system applies local quality by providing detailed localization information and high-precision positioning data only for the specific region where each device is currently located, rather than calculating and transmitting positioning data for the entire 3D environment. This maintains positioning accuracy at the user's location while reducing overall computational resources
Solution Approach 2:
The patent segments the localization process by associating each region with its own data structure containing localized positioning information. Devices only process and render content for their current region, reducing computational complexity while maintaining high positioning accuracy through region-specific data structures
Data Source
AI summary
A cross reality system enables any of multiple devices to efficiently render shared location-based content. The cross reality system may include a cloud-based service that responds to requests from devices to localize with respect to a stored map. The service may return to the device information that localizes the device with respect to the stored map. In conjunction with localization information, the service may provide information about locations in the physical world proximate the device for which virtual content has been provided. Based on information received from the service, the device may render, or stop rendering, virtual content to each of multiple users based on the user's location and specified locations for the virtual content.