Mixed Reality Manager Spatial Tracking for Shared Experiences
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality systems fail to provide an accurate and synchronized experience for multiple users in group settings, particularly in smaller spaces, due to limitations in location tracking systems, leading to inaccuracies in interactivity, lighting, and occlusion effects.
Innovation Solution
A networked hierarchy of devices, including a mixed reality manager and clients, utilizing GPS, accelerometers, and dead-reckoning systems, along with a supplemental tracking system for more accurate location data, ensures that each user's perspective of a mixed reality event is unique and synchronized, with real and virtual cameras aligned to achieve accurate occlusion and lighting adjustments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a basic location tracking system is used in mixed reality devices, then the device complexity is reduced, but the measurement precision of user location and camera view is insufficient for accurate occlusion and lighting effects
Solution Approach 1:
The patent combines multiple tracking systems (GPS for global positioning, accelerometers for motion sensing, and a supplemental tracking system for precise spatial localization) into a unified location tracking architecture. This merging of complementary systems achieves high measurement precision for occlusion and lighting calculations while distributing the complexity across multiple specialized components rather than requiring a single complex system.
Solution Approach 2:
The patent introduces a supplemental tracking system as an intermediary between the basic tracking components and the mixed reality rendering pipeline. This intermediary layer processes and refines location data from GPS, accelerometers, and other sensors, providing accurate spatial information for occlusion and lighting effects without requiring all underlying tracking components to be directly integrated into the rendering system.
2Reliability
If each user has their own mixed reality device with independent reality mediation, then the ease of operation is improved, but the synchronized shared experience and interactive accuracy deteriorate
Solution Approach 1:
The patent implements a universal mixed reality manager that serves multiple functions: it manages location tracking for all users, processes camera view data, calculates occlusion relationships, adjusts lighting effects, and coordinates the shared experience. This multi-functional centralized manager enables reliable synchronized experience across multiple devices without requiring each device to independently implement all coordination functions.
Solution Approach 2:
The patent establishes a feedback loop where each user's device reports location and camera view data to the mixed reality manager, which then processes this information to determine occlusion and lighting effects. The manager uses feedback from all users' device states to dynamically adjust the shared experience, ensuring accurate interactive responses while maintaining synchronization across the distributed device architecture.
3Manufacturing precision
If virtual elements are overlaid on real world views without spatial alignment, then the ease of manufacture is improved, but the manufacturing precision of occlusion and lighting effects is insufficient
Solution Approach 1:
The patent performs preliminary spatial alignment by calculating the precise spatial relationship between real world camera views and virtual camera positions before rendering the mixed reality content. The mixed reality manager pre-computes occlusion relationships and lighting adjustments based on the tracked location and orientation data, so that when the content is displayed, the virtual elements are already correctly positioned and aligned with real world objects.
Solution Approach 2:
The patent dynamically changes rendering parameters such as camera position, viewing angle, occlusion depth, and lighting intensity based on the real-time location and orientation data from the tracking system. By adjusting these parameters according to the user's spatial position and the virtual camera's corresponding view, the system achieves precise occlusion and lighting alignment without requiring complex manual configuration or post-processing.
Data Source
AI summary
A method for sharing a mixed reality experience (mixed reality content, mixed reality event) between one or more computing devices is disclosed. The method includes: determining a spatial location and a spatial orientation (spatial data) of the one or more computing devices each having a camera; mapping the (spatial) location and/or the spatial orientation (spatial data) of each of the one or more computing devices into a mixed reality manager; and presenting an event that is shared among the one or more computing devices, and, the presenting of the event is experienced simultaneously and varies among each of the one or more computing devices depending on the location or the orientation or both.