VR AR Engine for Virtual Desktop Augmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR and AR technologies face limitations due to resource constraints in individual devices, restricting the support for resource-intensive applications and requiring users to purchase additional monitors for expanded display, which is costly and inconvenient.

Innovation Solution

Implementing a VR/AR engine that processes and renders content remotely on servers, allowing for efficient use of client device resources and enabling VR/AR functionality in applications without native support by capturing real-time images and input from client devices, performing pre-processing, feature detection, and augmentation, and rendering the augmented content in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If VR/AR functionality is implemented on individual client devices, then users can access VR/AR experiences, but device resources are overwhelmed and cannot support resource-intensive applications

Engineering Contradiction:
ImproveVR/AR functionality supportVSAvoiddevice resource consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent extracts the resource-intensive VR/AR processing functions from the client device and relocates them to a remote server. The server performs the computationally demanding tasks of rendering virtual or augmented reality content, while the client device only handles lightweight tasks such as capturing images and displaying the received VR/AR content. This extraction resolves the contradiction by maintaining VR/AR functionality support while dramatically reducing device resource consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary server system that acts as a mediator between the user's client device and the resource-intensive application processing. The server receives image data from the client device, processes it to generate VR/AR content, and sends the processed content back to the client for display. This intermediary architecture allows the client device to access VR/AR functionality without directly handling the heavy computational load, thus resolving the resource consumption issue.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If users purchase additional monitors to expand display area, then display capabilities are improved, but cost and convenience deteriorate

Engineering Contradiction:
Improvedisplay areaVSAvoidhardware cost and complexity
Core Design Contradiction:
Area of stationary objectVSEase of manufacture

Solution Approach 1:

The patent transitions from a two-dimensional flat monitor display to a three-dimensional immersive VR/AR display environment. Instead of expanding the physical area of traditional monitors, the system creates a virtual three-dimensional space that can be viewed through VR headsets or AR devices. This dimensional transformation provides vastly expanded display capabilities without requiring additional physical hardware, thus resolving the contradiction between display area and hardware cost/complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11475636B2Augmented reality and virtual reality engine for virtual desktop infrastucture
Publication Date: 2022.10.18 VMWARE INC
  • US11475636B2 patent drawing
  • US11475636B2 patent drawing
  • US11475636B2 patent drawing

AI summary

Embodiments of the present disclosure relate to techniques for providing an augmented reality experience for virtual desktops. In particular, certain embodiments relate to acquiring, by a computing device one or more images from a client device and determining, by the computing device, that the one or more images contain an artifact to be augmented. Further, certain embodiments involve acquiring, by the computing device, a screen buffer from a virtual desktop or application running on it and applying, by the computing device, a geometric transformation to the screen buffer. Further, certain embodiments relate to augmenting, by the computing device, the one or more images by inserting the screen buffer onto the artifact, resulting in one or more augmented images. Further, certain embodiments relate to providing, by the computing device, the one or more augmented images to the client device in order to provide a user of the client device with the augmented reality experience.