The invention provides a
deep learning training and reasoning task dynamic cooperation
system based on GPU space-time resource sharing, and the
system comprises a GPU resource state
perceptron which is used for monitoring a GPU kernel function call sequence and a
video memory distribution state of a distributed training task in real time, dynamically capturing a calculation gap and
video memory fragments generated by the training task, and transmitting the calculation gap and the
video memory fragments to the GPU resource state
perceptron; generating a two-dimensional resource spatial-temporal characteristic spectrum, and predicting a GPU calculation idle period caused by communication synchronization based on an LSTM model; the kernel function dynamic scheduling
decision maker is used for performing priority division and
dynamic resource quota allocation on an online reasoning task and an offline reasoning task by adopting a self-adaptive allocation strategy on the basis of a resource spatial-temporal characteristic spectrum so as to realize spatial-temporal resource decoupling of the training task and the reasoning task; and the kernel function execution
arbiter is used for dynamically controlling submission and blockage of the reasoning task kernel function according to the scheduling decision through video memory space
multiplexing and a calculation instruction arbitration mechanism. According to the method, the GPU
resource utilization rate is remarkably improved, on the premise that stable training task performance is guaranteed, fragmented resources are effectively utilized to support parallel execution of multiple types of reasoning tasks, and efficient resource
collaboration of a
deep learning task cluster is achieved.