XR Stream Blending for Multi-App Display Conflict Avoidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR streaming systems struggle to handle complex and diverse use cases, particularly in fields like mechanical and electrical engineering, where multiple XR applications with varying compatibility and user interactions are required, leading to display conflicts and errors.
Innovation Solution
A multi-user XR streaming method that blends XR images from multiple XR application instances on a single device, using techniques such as positional blending, priority-based merging, alpha data, depth data, and reprojecting, to ensure seamless integration of XR content from different sources, regardless of compatibility or synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple XR application instances stream XR images to the same XR device, then the system can handle diverse use cases and expand capabilities, but display conflicts and errors occur due to incompatible XR applications
Solution Approach 1:
The XR device acts as an intermediary between multiple XR application instances and the display. It receives XR images from different applications, processes them through blending operations (positional blending, priority-based merging, alpha compositing), and outputs unified display images. This intermediary processing layer resolves conflicts between incompatible applications by coordinating their rendering outputs before display.
Solution Approach 2:
The system dynamically adjusts blending parameters and rendering priorities based on real-time conditions. When multiple XR applications are active, the system determines which applications should be blended and applies dynamic blending operations to resolve conflicts. The blending strategy adapts to the specific combination of applications and their rendering requirements, enabling flexible handling of diverse use cases without fixed conflicts.
2Ease of operation
If XR images from multiple applications are displayed simultaneously, then user experience is enhanced through multi-user scenarios, but computational resources are increased
Solution Approach 1:
The system merges multiple XR image streams into a unified display output by performing blending operations on the images. Instead of processing each application's XR images completely independently and then displaying them separately, the system combines them through merging operations (positional blending, priority-based merging, alpha compositing) that integrate multiple sources into a single coordinated output, reducing redundant processing.
Solution Approach 2:
The system applies partial blending operations only where necessary. Rather than uniformly processing all XR images from all applications with the same computational intensity, it selectively applies blending only to images that need coordination. Applications with compatible rendering requirements may not require full blending processing, allowing the system to reduce computational resources by applying minimal necessary processing.
3Adaptability or versatility
If XR applications are streamed without synchronization, then system complexity is reduced and compatibility is improved, but display conflicts arise from unsynchronized rendering
Solution Approach 1:
The XR device serves as an intermediary that receives unsynchronized XR images from multiple applications and coordinates their timing through blending operations. The blending process inherently manages synchronization by processing images in a coordinated sequence, ensuring that virtual objects from different applications are properly positioned and timed relative to each other, even when the source applications render independently.
Solution Approach 2:
The system performs preliminary processing of XR images before display, including reprojecting images to account for device orientation and position changes. This preliminary action prepares images for coordinated blending by establishing a common reference frame, allowing unsynchronized input from multiple applications to be reconciled into synchronized output without requiring the applications themselves to synchronize.
Data Source
AI summary
A multi-user extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and at least one XR device is described. First XR images received from a first XR application instance are blended with second XR images received from a second XR application instance.