XR Image Reprojection for Scalable Multi-Viewer Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR applications require a dedicated XR application instance for each user with different fields of view, leading to high computational resource demands and costs, especially when serving hundreds or thousands of users.
Innovation Solution
A multi-viewer XR streaming method that reduces the number of XR image streams by providing a reduced number of XR image streams associated with predefined spectator positions, allowing XR devices to reproject images based on their relative positions, thereby reducing the number of necessary XR application instances.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a dedicated XR application instance is provided for each user, then the virtual content is correctly displayed for each user's field of view, but the computational resources and costs increase significantly
Solution Approach 1:
Multiple XR application instances are merged into a single shared XR application instance that serves multiple users simultaneously. The system streams a common XR image from this single instance to multiple XR devices, eliminating the need for separate instances per user while maintaining display accuracy through device-side reprojection.
Solution Approach 2:
Instead of creating multiple independent XR application instances, the system creates a single master XR image that is then copied and distributed to multiple XR devices. Each device receives the same base XR image and independently reprojects it according to its own field of view parameters, reducing computational overhead while preserving individualized display quality.
2Adaptability or versatility
If multiple XR application instances are used to serve different fields of view, then each user receives accurate virtual content, but the system complexity and cost increase
Solution Approach 1:
Instead of adapting multiple XR application instances to different fields of view, the system inverts the approach by providing a single undifferentiated XR image to multiple users and enabling each user's device to adapt the image locally according to their specific field of view. This shifts the adaptation complexity from the application instance level to the device level.
Solution Approach 2:
A single XR application instance is designed to serve multiple users with different fields of view simultaneously. The XR image streamed by this universal instance can be used by any number of XR devices, each of which independently adjusts the content to match its own viewing parameters, making the system more versatile and scalable.
Data Source
AI summary
A multi-viewer extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and a plurality of XR devices is described. The multi-viewer XR streaming method comprises the steps ofstreaming, by means of a first XR application instance of the plurality of XR application instances, first XR images to at least one XR device, wherein the first XR images correspond to virtual content viewed from a first spectator position;determining a position of the at least one XR device relative to the first spectator position; andreprojecting, by means of the at least one XR device, the first XR images based on the determined position of the at least one XR device.Further, an XR streaming system is described.