Multi-User Mixed Reality Effect Synchronization via Segmented Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional mixed reality technologies face challenges in scaling to support multi-user experiences due to increased computational and rendering complexity, particularly when incorporating object-to-object interactions, leading to a less immersive user experience.
Innovation Solution
The implementation of systems and methods for synchronizing effects across multiple user experiences in mixed reality environments, utilizing a server computing platform, AR wearable devices, and actuating devices to distribute computational resources and manage sensor data, enabling efficient synchronization of AR virtual, haptic, and prop motion effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple participants utilize a shared mixed reality environment concurrently with object-to-object interactions, then the user experience becomes more immersive and interesting, but the computational and rendering complexity increases exponentially beyond conventional capabilities
Solution Approach 1:
The system segments the computational workload by separating effect calculation into individual user perspective spaces. Each user's device computes effects only for objects visible from their specific viewpoint, rather than computing all possible object interactions for all users simultaneously. This divides the exponential complexity into manageable per-user calculations.
Solution Approach 2:
The system applies local quality by rendering and computing effects only in the specific spatial region relevant to each user's current perspective. Virtual light from a virtual object suffuses only those physical objects that are adjacent and visible from that user's viewpoint, rather than computing global lighting interactions for the entire environment.
2Adaptability or versatility
If conventional mixed reality implementations compute and render from multiple points of view with object-to-object interactions, then the user experience improves, but the system becomes incapable of scaling
Solution Approach 1:
The patent segments the rendering task by computing effects independently for each user's perspective space. Each user experiences full multi-object interactions from their viewpoint without requiring the system to compute and transmit all possible interactions to all users, enabling linear rather than exponential scaling with user count.
Solution Approach 2:
The system adds the dimension of user-specific perspective space, where effects are computed and rendered separately for each user's viewpoint. This dimensional separation allows the system to handle multiple users concurrently by treating their experience spaces as independent computational domains that share the same physical environment data.
Data Source
AI summary
There are provided systems and methods for synchronizing effects for multi-user mixed reality experiences. In one implementation, such a system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to receive sensor data from multiple sensors within a venue, identify an activity in the venue based on the sensor data, and track a respective perspective and a respective location within the venue of each of multiple observers of the activity. The hardware processor also executes the software code to identify a first effect triggered by an action of one of the observers, conform the first effect to the respective perspective and the respective location of each of the observers to produce multiple second effects corresponding to the first effect, and output the second effects for operating multiple actuating devices within the venue during the activity.