Cloud-Based AR/VR Rendering to Offload Client Computation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for rendering interactive augmented and virtual reality experiences are limited by the computational capabilities of local devices, leading to suboptimal performance and user experience, particularly in stereo displays.
Innovation Solution
A cloud-based rendering system where client devices initiate content applications on a server, providing local system information, and the server processes and transmits rendered AR/VR scenes to the client, optimizing computational demands and enhancing user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If rendering is performed locally on client devices, then device autonomy and responsiveness are maintained, but computational performance and rendering quality are limited by device capabilities
Solution Approach 1:
The patent extracts the complex rendering computations from the client device and relocates them to a cloud-based rendering server. The client device retains only lightweight functions for capturing user input, transmitting data to the server, and displaying rendered output. This extraction resolves the contradiction by achieving high computational performance through cloud infrastructure while keeping the client device relatively simple.
Solution Approach 2:
The patent introduces a cloud-based rendering server as an intermediary between the client device and the final rendered output. This intermediary handles all computationally intensive rendering tasks, acting as a mediator that bridges the gap between simple client devices and high-quality rendering requirements. The server receives raw input data from clients, performs complex rendering computations, and returns finished rendered content to clients for display.
2Manufacturing precision
If cloud-based rendering is implemented, then rendering quality and performance are improved, but network dependency and latency are introduced
Solution Approach 1:
The patent implements preliminary action by having client devices capture and buffer user input data locally before transmission. Additionally, the rendering server maintains ready-state rendering pipelines and pre-loads assets when possible. This preliminary preparation reduces the effective latency by ensuring data is ready for immediate processing and rendering operations can begin without delay once data arrives.
Solution Approach 2:
The patent ensures continuity of useful action by implementing persistent network connections and continuous data streaming between client devices and the rendering server. Rather than establishing new connections for each rendering task, the system maintains ongoing communication channels, allowing rendering operations to proceed continuously without interruption. This continuous action minimizes idle time and maintains smooth rendering performance.
Data Source
AI summary
Systems and methods for implementing methods for cloud-based rendering of interactive augmented reality (AR) and/or virtual reality (VR) experiences. A client device may initiate execution of a content application on a server and provide information associated with the content application to the server. The client device may initialize, while awaiting a notification from the server, local systems associated with the content application and, upon receipt of the notification, provide, to the server, information associated with the local systems. Further, the client device may receive, from the server, data associated with the content application and render an AR/VR scene based on the received data. The data may be based, at least in part, on the information associated with the local system. The providing and receiving may be performed periodically, e.g., at a rate to sustain a comfortable viewing environment of the AR/VR scene by a user of the client device.