XR Image Streaming With On-Device Upscaling for Lower Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing resolution and image quality in XR devices lead to higher computational demands and increased streaming bandwidth requirements for XR images, which can be computationally expensive and energy-intensive, especially for battery-powered devices.
Innovation Solution
An XR streaming method that involves rendering XR images at a lower resolution on an external computer device and up-converting them to the native resolution of the XR device, using resolution upscaling techniques to reduce bandwidth requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If XR images are streamed at native resolution to meet image quality standards, then image quality is improved, but streaming bandwidth requirements increase
Solution Approach 1:
The patent creates a lower-resolution copy of the XR image for transmission instead of sending the full native resolution image. The external computer device renders the XR image at reduced resolution, and the XR device's processing unit up-scales this copy to native resolution for display, thereby reducing streaming bandwidth while maintaining final image quality
Solution Approach 2:
The patent changes the resolution dimension of the XR image during transmission. By rendering and transmitting at a lower resolution than the device's native resolution, the system reduces bandwidth requirements while the device's processing unit restores the full resolution dimension locally through up-scaling operations
2Manufacturing precision
If XR images are rendered at high resolution to meet display requirements, then image quality is improved, but computational cost increases
Solution Approach 1:
The external computer device creates a lower-resolution copy of the XR image for transmission. This copy requires significantly less computational resources to render and process, while the XR device's processing unit performs up-scaling to restore native resolution, distributing the computational workload efficiently
Solution Approach 2:
The patent introduces a lower-resolution intermediate version of the XR image as a mediator between the external rendering device and the XR display device. This intermediate copy reduces computational demands during transmission while the processing unit reconstructs the full-resolution image for display
Data Source
Figure 1~2
Figure 3
AI summary
An extended reality, XR, streaming method of streaming XR images from an XR application instance (26) to an XR device (12) is described. The XR application instance (26) is integrated into a computer device (14) that is provided separately from the XR device (12). The XR streaming method comprises the steps of - obtaining, by the XR application instance (26), an XR image to be transmitted to the XR device (12), wherein the XR image is obtained with respect to a predetermined reference position, wherein the predetermined reference position has a predetermined relation to a momentary position of the XR device (12), wherein the XR image has a first resolution; - streaming, by the XR application instance (26), the XR image to the XR device (12); and - up-converting, by the XR device (12), the XR image received from the XR application instance (26) in resolution, thereby obtaining an up-converted XR image to be displayed on the XR device (12), wherein the up-converted XR image has a second resolution that is higher than the first resolution. Further, an XR projection system (10) is described.