XR Deferred Rendering Using Server Pre-Rendered Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
XR devices face challenges in optimizing rendering resources and hardware resources due to design restrictions on weight, bulkiness, and overheating, which affect battery life and processing capabilities, especially for glasses-type wearable devices.
Innovation Solution
Implementing deferred rendering techniques on XR devices through establishing a transport session with a server, performing loop configuration, providing pose information, and receiving pre-rendered content for optimized resource management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If frame-based rendering is used for XR applications, then real-time visual output is achieved, but power consumption increases and thermal generation occurs
Solution Approach 1:
The system performs preliminary actions by pre-computing and storing rendering data for multiple future frames before the actual display moment. The rendering device generates and stores frame data for a plurality of frames in advance, allowing the display device to retrieve and present pre-computed frames without real-time processing, thus reducing power consumption during actual display while maintaining high frame rates.
Solution Approach 2:
The system implements periodic action through the rendering device generating frame data for multiple frames in periodic intervals rather than continuously. The rendering device generates frame data for a plurality of frames at periodic intervals, and the display device presents these pre-generated frames at the required display rate, decoupling the rendering frequency from the display frequency to reduce energy consumption.
2Speed
If frame-based rendering is used for XR applications, then real-time visual output is achieved, but thermal generation increases
Solution Approach 1:
The system performs preliminary actions by pre-computing and storing rendering data for multiple future frames before the actual display moment. The rendering device generates and stores frame data for a plurality of frames in advance, allowing the display device to retrieve and present pre-computed frames without real-time processing, thus reducing power consumption during actual display while maintaining high frame rates.
Solution Approach 2:
The system implements periodic action through the rendering device generating frame data for multiple frames in periodic intervals rather than continuously. The rendering device generates frame data for a plurality of frames at periodic intervals, and the display device presents these pre-generated frames at the required display rate, decoupling the rendering frequency from the display frequency to reduce energy consumption.
3Productivity
If frame-based rendering is used for XR applications, then visual output is produced, but processing time is consumed
Solution Approach 1:
The system performs preliminary actions by pre-computing and storing rendering data for multiple future frames before the actual display moment. The rendering device generates and stores frame data for a plurality of frames in advance, allowing the display device to retrieve and present pre-computed frames without real-time processing, thus reducing power consumption during actual display while maintaining high frame rates.
Solution Approach 2:
The system implements periodic action through the rendering device generating frame data for multiple frames in periodic intervals rather than continuously. The rendering device generates frame data for a plurality of frames at periodic intervals, and the display device presents these pre-generated frames at the required display rate, decoupling the rendering frequency from the display frequency to reduce energy consumption.
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
The disclosure relates to a 5G or 6G communication system for supporting a higher data transmission rate. A method for deferred rendering on an extended reality (XR) device includes establishing a transport session for content on the XR device with a server. The method also includes performing a loop configuration for the content based on the transport session between the XR device and the server. The method further includes providing pose information based on parameters of the loop configuration to the server. The method also includes receiving pre-rendered content based on the pose information from the server. In addition, the method includes processing and displaying the pre-rendered content on the XR device.