Split Rendering Architecture for Lightweight XR Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR devices, particularly lightweight devices, face challenges in delivering high-quality XR content due to performance limitations, hardware constraints, and inefficient network communication, leading to suboptimal user experiences.
Innovation Solution
An XR streaming system utilizing an expandable split rendering server and mediation server architecture, employing QUIC communication protocol for efficient data transmission and rendering, allowing lightweight devices to interact with high-quality content by processing data in 2D format.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If lightweight XR devices are used, then device portability and ease of operation are improved, but rendering performance and content quality deteriorate
Solution Approach 1:
The system segments the rendering workload between the lightweight XR device and the server. The device handles only lightweight tasks such as capturing video data and sensor data, while the server performs the computationally intensive 3D rendering and generates high-quality 2D video output. This segmentation allows the lightweight device to deliver high-quality content without requiring powerful local rendering hardware.
Solution Approach 2:
The system introduces a server as an intermediary between the lightweight XR device and the final content delivery. The device communicates with the server, which then communicates with the rendering environment. This intermediary handles the complex rendering operations, allowing the lightweight device to access high-quality content through simplified communication protocols.
2Manufacturing precision
If high-quality XR content is delivered, then content quality is improved, but network traffic and response delay increase
Solution Approach 1:
The system changes the format parameter of transmitted data from raw 3D rendering data to optimized 2D video format. By converting the rendered content into a compact 2D video format before transmission, the system maintains high content quality while significantly reducing network traffic and transmission overhead.
3Manufacturing precision
If complex 3D rendering is performed locally, then rendering quality is improved, but device hardware requirements and complexity increase
Solution Approach 1:
The system extracts the complex 3D rendering function from the lightweight XR device and relocates it to the server. The device retains only the essential functions of capturing sensor data and receiving rendered output, while the server handles all computationally intensive rendering operations. This extraction allows high rendering quality without increasing device hardware complexity.
4Productivity
If multiple users are served simultaneously, then service scalability is improved, but rendering server resource allocation becomes more complex
Solution Approach 1:
The system implements automatic server allocation and management where the server infrastructure automatically handles resource allocation, load balancing, and user session management. This self-service approach to server management enables scalable multi-user support without requiring complex manual intervention for resource allocation and server coordination.
Data Source
AI summary
Proposed are a mediation server operation method for an XR streaming service and XR streaming system supporting same, the mediation server operation method comprising the steps of: if a mediation server receives an XR content playback request from a connected user device, searching for an idle split rendering server; allocating the found idle split rendering server to the user device; receiving image data and sensor data from the user device; generating a rotation matrix on the basis of the received image data and sensor data; and transmitting the rotation matrix to the allocated split rendering server.