3D Content Rendering Instructions for Low-Latency XR Multitasking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In extended-reality (XR) systems with multitasking capabilities, the high-resolution rendering of 3D content leads to significant transmission bandwidth pressure, transmission latency, and inefficient use of rendering resources, degrading display quality and user experience.
Innovation Solution
Applications generate rendering instructions based on application logic and send these instructions to the system, which then renders the objects, reducing data transmission size and latency, while maintaining application logic and ensuring stability even if one application crashes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If each application renders high-resolution 3D content independently and transmits rendered images to the system, then the rendering quality and user experience are improved, but the transmission bandwidth pressure and latency increase significantly
Solution Approach 1:
The patent extracts the rendering function from individual applications and relocates it to the system level. Applications no longer render high-resolution 3D content independently but instead send rendering instructions to the system, which performs the rendering operation. This extraction eliminates the need to transmit large rendered images between applications and the system, significantly reducing transmission bandwidth pressure while maintaining rendering quality.
Solution Approach 2:
The system acts as an intermediary between applications and the display output. Instead of applications directly generating and transmitting rendered images, the system receives rendering instructions from applications, performs the rendering operation, and outputs the final images. This intermediary role allows the system to centralize the resource-intensive rendering task, reducing the data transmission burden on the communication interface between applications and the display system.
2Manufacturing precision
If each application renders high-resolution images for 3D content, then the display quality is improved, but the transmission latency increases
Solution Approach 1:
The rendering operation is extracted from applications and performed by the system. Applications send compact rendering instructions rather than large rendered images, dramatically reducing transmission time. The system performs the rendering locally using its computational resources, eliminating the latency bottleneck caused by transmitting high-resolution images between applications and the display system.
3Manufacturing precision
If applications render 3D content at user resolution requirements, then the binocular picture quality is improved, but the rendering resources are wasted due to unnecessary transmission and processing
Solution Approach 1:
The system serves as an intermediary that receives rendering instructions from applications and performs the actual rendering operation. This allows the system to optimize rendering resource allocation by processing only the necessary visual information required for the final display, rather than having each application independently render complete high-resolution images. The system can efficiently manage rendering resources by centralizing the computation and only processing content that will actually be displayed.
Data Source
Figure 1~2
Figure 3~5
Figure 6~7
AI summary
The present disclosure relates to the technical field of computer systems, computer graphics, and human-computer interactions, and particularly to a method for rendering three-dimensional content in a multitasking system, and a device. An application is responsible for processing an application logic, generating a rendering instruction for a rendering object, and sending the rendering instruction to a system, such that the system renders the rendering object according to the rendering instruction. The method can reduce the pressure of data transmission between the application and the system, reduce the transmission delay, and save the rendering resources, thereby improving the display quality and the user experience of an XR system, and reducing the power consumption of an XR device.