Remote VR/AR Engine for Virtual Desktop Infrastructure
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR and AR technologies face limitations due to resource constraints in devices, restricting their use in applications that do not natively support these features, and users often resort to expanding display areas with multiple monitors, which is costly and inconvenient.
Innovation Solution
Implementing a VR/AR engine that processes and augments content remotely, allowing detection of contexts on client devices and overlaying application content onto real-world scenes without burdening the client device with resource-intensive processing, enabling VR/AR experiences on applications that do not natively support these technologies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If VR/AR functionality is implemented on client devices, then user interaction and display capabilities are improved, but device resource consumption increases
Solution Approach 1:
The patent extracts the resource-intensive VR/AR processing functions from the client device and relocates them to a remote server. The client device only handles lightweight tasks such as capturing images, detecting contexts, and displaying augmented content, while the server performs heavy-duty 3D rendering, scene composition, and content generation. This extraction resolves the contradiction by maintaining improved user interaction through VR/AR capabilities while dramatically reducing device resource consumption.
Solution Approach 2:
The patent introduces a remote server as an intermediary between the client device and the VR/AR content generation process. The server acts as a mediator that receives context detection data from the client, generates appropriate VR/AR content, and returns it to the client for display. This intermediary architecture allows the client device to benefit from advanced VR/AR functionality without bearing the full resource burden, as the server handles the computationally intensive operations.
2Area of stationary object
If multiple computer monitors are used to expand display area, then output capabilities are improved, but cost and convenience deteriorate
Solution Approach 1:
The patent transitions from the traditional two-dimensional flat monitor display to three-dimensional immersive VR/AR display environments. Instead of expanding display area horizontally by adding more monitors, the system creates virtual three-dimensional spaces where content can be displayed at various depths, angles, and positions around the user. This dimensional transformation provides vastly expanded display capabilities while maintaining convenience, as users experience the expanded display area through a single wearable device rather than multiple physical monitors.
3Speed
If VR/AR processing is performed locally on client devices, then response time is improved, but device complexity and resource requirements increase
Solution Approach 1:
The patent segments the VR/AR processing pipeline into distinct functional components distributed between client and server. The client device handles segmentation of tasks including image capture, context detection, and result display, while the server handles 3D rendering, scene composition, and content generation. This segmentation allows response time to be optimized for critical path operations on the client while complex processing is distributed to the server, reducing overall device complexity without sacrificing responsiveness.
Data Source
AI summary
Embodiments of the present disclosure relate to techniques for providing an augmented reality experience. Certain embodiments involve receiving a request from an application to register a context for detection, wherein the context for detection comprises an artifact and a context identifier. Some embodiments involve sending the context for detection to a registration component. The registration component may register the context for detection. Certain embodiments involve receiving context detection information from a client device. Some embodiments involve sending a notification to the application that the context detection information was received. Certain embodiments involve receiving application content and a relative pose of the application content from the application. Some embodiments involve composing a scene based on the application content and the relative pose of the application content and transporting, by the computing device, the scene to the client device.