GPU virtualization implementation system and method based on API redirection technology

Abstract

The invention provides a GPU virtualization implementation system based on an API redirection technology, and the system comprises an instruction agent module located at a client intercepts an API call instruction related to OpenGL in an image application program of the client, carries out the processing of the instruction, and transmits the instruction to a remote server for execution of a rendering task; the task scheduling module performs corresponding processing on the instruction data sent by the client to obtain an instruction stream, and allocates the instruction stream to each micro GPU module; and the micro GPU module completes a rendering task of the instruction stream and returns the rendering task to the client. Meanwhile, the invention provides a GPU virtualization implementation method based on the API redirection technology. The invention provides a universal acceleration service platform which has better universality, does not need to modify source program codes and issimple and convenient to use.

Description

technical field [0001] The present invention relates to the technical field of GPU virtualization, in particular to a GPU virtualization implementation system and method based on API redirection technology. Background technique [0002] As the interest in the field of machine learning research continues to rise, the demand for data computing in academia and industry is also rising. With the advantages of high computing power and data parallelism in floating-point arithmetic, GPU has become the new favorite in the fields of high-performance computing and cloud computing. However, with the continuous improvement of GPU performance, the high hardware cost caused by its large size and high power consumption has become a major problem affecting its use. For this reason, more and more users choose cloud computing platforms that provide GPU cloud solutions for data computing. [0003] One of the cores of cloud computing technology is virtualization technology. Virtualization tec...

AI Technical Summary

Problems solved by technology

[0005] Cloud vendors usually provide coarse-grained remote GPU services on the basis of a single GPU device, which brings high cost and usage threshold, and the utilization rate of device resources is not high.

In addition, when multiple clients make rendering requests at the same time, bandwidth resources will also become the bottleneck of the system

[0006] At present, there is no description or report of the similar technology of the present invention, and no similar data at home and abroad have been collected yet.

Images