Graphics Session Coordinator for Auto-Scaled Virtualized Graphics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Managing dynamic graphics workloads in distributed systems is challenging due to unpredictable resource requirements, making it difficult to predict and allocate the necessary virtualized graphics processing capabilities effectively.

Innovation Solution

Implementing a virtualized graphics and computing service (VGCS) with programmatic interfaces that enable auto-scaling of remote virtualized graphics devices, allowing for dynamic deployment and termination of resources based on scaling policies, and using graphics session coordinators to manage sessions and resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtualized graphics resources are manually provisioned and managed, then resource allocation can be controlled, but the system cannot adapt to unpredictable workload changes and requires significant manual intervention

Engineering Contradiction:
Improveadaptability to workload changesVSAvoidmanual management complexity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system implements self-service through automated resource provisioning and management. The virtualized graphics environment automatically detects workload changes and adjusts resource allocation without manual intervention, enabling the system to adapt to unpredictable demands while reducing operational complexity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent applies dynamics by creating a flexible, adaptable resource allocation system. Virtual machine instances can be dynamically created, scaled, and terminated based on real-time workload conditions, allowing the system to transition from static manual provisioning to dynamic automated management

Inventive Principle:
Principle #15Dynamics

2Productivity

If graphics processing resources are allocated statically, then system configuration is simple, but the system cannot efficiently handle varying graphics workload demands

Engineering Contradiction:
Improvegraphics processing efficiencyVSAvoidresource management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments graphics processing resources into virtual machine instances that can be independently managed and scaled. This segmentation allows efficient allocation of graphics processing units to multiple virtual machines, improving productivity while the automated management system handles the complexity of coordinating these segmented resources

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The virtualized graphics platform provides multi-functionality by serving multiple graphics workloads through a single physical infrastructure. The system can simultaneously support different graphics applications, rendering tasks, and computational workloads, improving resource utilization efficiency without proportionally increasing physical device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Speed

If virtual machine instances are manually created and terminated, then resource control is precise, but response time to workload changes is delayed

Engineering Contradiction:
Improveresponse speed to workload changesVSAvoidautomated resource provisioning
Core Design Contradiction:
SpeedVSExtent of automation

Solution Approach 1:

The system implements feedback mechanisms that continuously monitor workload conditions and automatically trigger resource provisioning or termination decisions. This closed-loop control enables rapid response to workload changes by detecting conditions and executing appropriate actions without manual intervention, achieving both speed and controlled automation

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies preliminary action by pre-configuring virtual machine templates and resource allocation policies in advance. When workload changes occur, the system can rapidly instantiate pre-defined virtual machine instances rather than creating them from scratch, significantly reducing response time while maintaining automated control

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11710206B2Session coordination for auto-scaled virtualized graphics processing
Publication Date: 2023.07.25 AMAZON TECH INC
  • US11710206B2 patent drawing
  • US11710206B2 patent drawing
  • US11710206B2 patent drawing

AI summary

A graphic session coordinator is established to enable remote virtualized graphics operations on behalf of a set of graphics request generators. A request generator submits a graphics session request to the session coordinator. A configuration operation is performed at one or more routing devices to enable graphics operation request packets from the request generator to be delivered to a first remote virtualized graphics device and to enable graphics operation response packets to be transmitted to a destination.