Server-Side Reflection Rendering for XR Client Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The graphical quality of extended reality (XR) environments, such as virtual, augmented, and mixed reality, is often limited by the processing capabilities of client devices, leading to low-quality displays on mobile devices and high costs for standalone personal computer-driven setups with powerful video cards and additional hardware.
Innovation Solution
Implementing server-side rendering of reflections in XR environments, where a server receives images of the physical environment from a client device, renders virtual objects with reflective surfaces, and sends the graphics back to the client for display, thereby offloading processing and reducing storage requirements on client devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If rendering is performed on mobile client devices, then device autonomy and portability are maintained, but graphical quality and frame rate are limited due to processing capabilities
Solution Approach 1:
A server acts as an intermediary between the client device and the rendering process. The server receives images from the client device, performs the computationally intensive rendering of reflections and lighting effects, and sends the rendered images back to the client for display. This mediates the contradiction by moving processing demands from the mobile device to the server, enabling high graphical quality without requiring powerful local processing capabilities.
2Reliability
If powerful video cards and standalone personal computers are used, then high-quality realistic high frame rate XR environments are achieved, but cost increases significantly
Solution Approach 1:
The rendering functionality is extracted from the client device and relocated to a server. This extraction allows the expensive processing requirements to be集中 on the server side, while the client device can use simpler, less expensive hardware. The server handles the computationally intensive tasks of rendering reflections and lighting effects, enabling high graphical quality without requiring each client to have expensive video cards and robust hardware.
3Reliability
If reflections and lighting effects are simulated locally, then realistic visual quality is achieved, but processing power and energy consumption increase
Solution Approach 1:
The server acts as an intermediary that handles the energy-intensive rendering tasks. By offloading the simulation of reflections and lighting effects to the server, the mobile device's energy consumption is significantly reduced while maintaining realistic visual quality. The server performs the computationally intensive work of processing images and generating rendered outputs with proper lighting and reflection effects.
Data Source
AI summary
Methods and systems for remote rendering of extended reality (XR) objects are described herein. A server may receive an image of a physical environment. The image may include different views of the physical environment around a client device. The server may render at least one surface of a virtual object based on the different views of the physical environment. The at least one surface may include a reflection of another object of the physical environment from a view point of the client device at the time the image was taken. The server may generate graphics including the rendered at least one surface. The server may send the generated graphics to the client device to enable display of a computer generated environment on the client device. The computer generated environment may include the at least one virtual object with an appearance of a reflective surface.