Platform architecture supporting multi-GPU (Graphics Processing Unit) virtualization and work method of platform architecture

Abstract

The invention provides a platform architecture supporting multi-GPU (Graphics Processing Unit) virtualization and a work method of the platform architecture. The platform architecture is used as a transmission medium by deploying middleware at a GPU server end and the end part of a virtual machine and using modes such as socket or infiniband to make up the defect that an original virtual machine platform cannot accelerate by using the GPU. The platform architecture can be used for managing the GPU resources through one or more centrally-controlled management nodes, carrying out fine grit division on the GPU resources and providing the function multitasking and execution. The virtual machine requests the GPU resources for the management nodes through the middleware and accelerates by using the GPU resources. The GPU server is used for registering the GPU resources for the management nodes through the middleware and providing service by using the GPU resources. According to the platform architecture disclosed by the invention, the parallel processing capability of the GPU is introduced into the virtual machine; and the utilization rate of the GPU is increased to the maximum extent by combining a management mechanism. According to the platform architecture, energy consumption can be effectively reduced and the calculation efficiency is increased.

Description

technical field [0001] The invention relates to a platform architecture and a working method for a virtual machine in a virtualized environment to accelerate computing by using multiple GPUs in a redirection manner, and belongs to the technical field of virtualization. Background technique [0002] Virtualization is the core technical basis of cloud computing, and its advantages such as cost saving and security enhancement have gradually been recognized by people, and it is a research hotspot in the field of computer science. Through the virtualization of hardware resources, virtualization technology can simulate multiple identical computer hardware platforms on one computer, so that multiple operating systems can run simultaneously and be isolated from each other, which improves the utilization efficiency of servers. There are numerous applications in areas such as network security, computational data protection, high-performance computing, and trustworthiness. [0003] Th...

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem that the virtualization environment cannot utilize GPU acceleration, the present invention proposes a multi-GPU virtualization platform architecture and its working method suitable for clusters. Through the cooperative work of management components, client components, and server components, virtual machines can Obtain the powerful parallel computing capability of GPU, which can realize the acquisition of GPU resources and fine-grained resource allocation, and through load balancing of GPU, improve GPU utilization and reduce energy consumption

Images