Adaptive OpenGL Rendering in Virtual Desktop Infrastructure

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtual desktop infrastructure (VDI) environments, virtual machines (VMs) without direct access to a graphics processing unit (GPU) are limited to software-based rendering, which reduces performance due to shared and limited GPU resources, leading to suboptimal processing speed and memory usage for OpenGL 3D graphics rendering.

Innovation Solution

A method and system for adaptive graphics rendering that intercepts rendering commands in VMs without GPU access and redirects them to VMs with GPU access, allowing hardware-based rendering based on workload and resource availability, switching to software-based rendering when GPUs are busy or unavailable.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If VMs without direct GPU access use software-based rendering, then they can render graphics without GPU hardware, but processing speed and memory performance are reduced

Engineering Contradiction:
Improvegraphics rendering capabilityVSAvoidprocessing speed
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent introduces a GPU access intermediary system where a VM with direct GPU access acts as a mediator for VMs without GPU access. The intermediary VM receives OpenGL rendering commands from remote VMs, processes them through the physical GPU, and returns the rendered output. This mediator approach allows VMs without direct GPU access to utilize hardware acceleration while maintaining system versatility.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If multiple VMs share limited GPUs, then resource utilization improves, but access availability and rendering performance may be reduced when GPUs are busy

Engineering Contradiction:
Improveresource utilizationVSAvoidrendering availability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements dynamic rendering mode selection that adapts based on GPU availability and workload conditions. The system monitors GPU status and dynamically switches between hardware-based rendering (when GPU is available) and software-based rendering (when GPU is busy or unavailable). This dynamic adaptation ensures reliable rendering availability while maximizing resource utilization through shared GPU access.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the rendering parameter (hardware vs. software mode) based on GPU workload conditions. When GPU availability parameters indicate sufficient capacity, the system switches to hardware-based rendering mode. When parameters indicate overload or unavailability, it transitions to software-based rendering. This parameter-based adaptation resolves the contradiction between resource utilization and rendering availability.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If VMs without GPU access are allocated GPU resources, then rendering performance improves, but system complexity and resource management difficulty increase

Engineering Contradiction:
Improverendering performanceVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent makes the VM with direct GPU access serve multiple functions: it acts as both a regular virtual machine for its own rendering needs and as a shared GPU service provider for other VMs. This multi-functionality allows the system to improve rendering performance for multiple VMs without adding dedicated GPU resources to each VM, thereby avoiding increased system complexity while maintaining universality of the GPU resource.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9665921B2Adaptive OpenGL 3D graphics in virtual desktop infrastructure
Publication Date: 2017.05.30 FUTUREWEI TECHNOLOGIES INC
  • US9665921B2 patent drawing
  • US9665921B2 patent drawing
  • US9665921B2 patent drawing

AI summary

System and method embodiments are provided for enabling OpenGL graphics rendering on VM architecture. In an embodiment, a method implemented in a system comprising multiple virtual machines (VMs) includes intercepting, at a first VM that does not have direct access to a graphics processing unit (GPU), a command from an application to render graphics. The method further includes processing the command using hardware based GPU rendering at a second VM that has direct access to a GPU upon determining that the GPU is free or has capacity to handle workload of the command or processing the command using CPU based software rendering at the first VM upon determining that the GPU of the second VM is busy or does not have capacity to handle workload of the command and the graphics data.