XR Rendering Partitioning and Image Blending for Complex Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR streaming systems struggle to handle highly complex virtual content, such as three-dimensional assets, efficiently and in real time, particularly in industrial applications.
Innovation Solution
The XR streaming method involves partitioning virtual content into multiple rendering jobs, which are processed in parallel by at least two rendering instances, and then blending the resulting XR images using predefined rules based on device orientation, priority, alpha data, depth data, and position, ensuring conflict-free and timely rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If virtual content is rendered using a single rendering instance, then the system implementation is simple, but the rendering speed is insufficient for highly complex virtual content
Solution Approach 1:
The patent divides the virtual content into multiple partitions, each assigned to a separate rendering instance for parallel processing. This segmentation enables faster rendering of complex content by distributing the computational load across multiple instances, directly resolving the contradiction between rendering speed and system complexity.
2Productivity
If multiple rendering instances process virtual content in parallel, then the rendering efficiency increases, but the coordination and blending of results becomes complex
Solution Approach 1:
The patent introduces a merging instance as an intermediary that receives rendered images from multiple rendering instances and blends them according to predefined rules. This mediator simplifies the coordination complexity by centralizing the integration logic, allowing multiple rendering instances to work in parallel without direct communication between them.
3Reliability
If complex virtual content is rendered in real-time, then the user experience is enhanced, but the computational resources required exceed the capabilities of the XR device
Solution Approach 1:
The patent extracts the heavy rendering computations from the XR device and performs them on remote rendering instances. Only the final blended images are transmitted to the XR device, significantly reducing the computational power requirements at the device while maintaining real-time rendering capability for complex content.
Data Source
AI summary
An extended reality (XR) streaming method of streaming XR images to an XR device is described. The XR streaming method comprising,generating, virtual content to be rendered with an XR application instance;partitioning the virtual content to be rendered into a plurality of rendering jobs with the XR application instance;forwarding the plurality of rendering jobs to at least a first and second rendering instance of a plurality of rendering instances;generating first XR images based on the corresponding rendering job received by the first render instance from the XR application instance;generating second XR images based on the corresponding rendering job received by the second render instance from the XR application instance; andblending the first XR images with the second XR images, with a merging instance to obtain blended XR images to be displayed on the XR device.