GPU management device and method based on detection adjustment module and GPU server

A technology for adjusting modules and management devices, applied in the field of GPU management design, can solve problems such as adjusting interconnection topology, and achieve the effects of increasing bandwidth, improving utilization, task processing efficiency, and improving communication efficiency

Active Publication Date: 2020-11-27
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problems existing in the prior art, the present invention innovatively proposes a GPU management device, method and GPU server based on the detection and adjustment module, which effectively solves the problems caused by The existing technology makes it impossible to adjust the appropriate interconnection topology between the CPU and GPU according to different application scenarios to achieve a reasonable allocation of floating-point operations and integer operations, effectively improving the CPU and GPU utilization and task processing efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • GPU management device and method based on detection adjustment module and GPU server
  • GPU management device and method based on detection adjustment module and GPU server
  • GPU management device and method based on detection adjustment module and GPU server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Such as figure 1 As shown, the present invention provides 1. A GPU management device based on a detection and adjustment module, comprising: a CPU module 1, a CPU management module 2, a conversion module 3, a GPU module 4, a GPU management module 5, and a detection and adjustment module 6 , the adjustment control end of the detection adjustment module 6 is connected to the control end of the GPU management module 5 and the CPU management module 2 respectively, and is used to detect the data type to be processed, and select the corresponding GPU module 1 and 2 according to the data type to be processed. / or the CPU module 4 is processed; the CPU management module 2 communicates with the CPU module 1 for realizing the management of the CPU module 1; the GPU management module 5 communicates with the GPU module 4 for realizing the management of the GPU module 4 and Balanced distribution of tasks to be processed; the CPU module 1 communicates with the GPU module 4 through th...

Embodiment 2

[0048] Such as figure 2 As shown, the technical solution of the present invention also provides a GPU management method based on the detection and adjustment module, which is implemented on the basis of Embodiment 1 of the present invention, including:

[0049] S1, dividing the tasks to be processed into integer operations and floating-point operations;

[0050] S2, detection and adjustment module detection task type;

[0051] S3, if it is a floating-point calculation task, the GPU management module is given priority to call the GPU module to realize the calculation and processing of data;

[0052] S4, if it is an integer calculation task, the CPU management module is given priority to calling the CPU module to realize the calculation and processing of data;

[0053] S5, if the types of tasks to be processed include integer calculation tasks and floating point calculation tasks, the floating point calculation tasks are prioritized through the GPU management module to call t...

Embodiment 3

[0056] Such as image 3 As shown, the technical solution of the present invention also provides a GPU management method based on the detection and adjustment module, which is implemented on the basis of Embodiment 1 of the present invention, including:

[0057] S1, dividing the tasks to be processed into integer operations and floating-point operations;

[0058] S2, detection and adjustment module detection task type;

[0059] S3, if it is a floating-point calculation task, the GPU management module is given priority to call the GPU module to realize the calculation and processing of data;

[0060] S4, if it is an integer calculation task, the CPU management module is given priority to calling the CPU module to realize the calculation and processing of data;

[0061] S5, if the types of tasks to be processed include integer calculation tasks and floating point calculation tasks, the floating point calculation tasks are prioritized through the GPU management module to call th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a GPU management device based on a detection adjustment module. The system comprises a CPU module, a CPU management module, a conversion module, a GPU module, a GPU management module and a detection adjustment module. An adjustment control end of the detection adjustment module is in communication connection with control ends of the GPU management module and the CPU management module, and the detection adjustment module is used for detecting a to-be-processed data type and selecting a corresponding GPU module and/or CPU module for processing according to the to-be-processed data type; the GPU management module is in communication connection with the GPU module and is used for realizing management of the GPU module and balanced distribution of to-be-processed tasks; the invention further provides a GPU management method based on the detection adjustment module and a GPU server, and the utilization rate and the task processing efficiency of the CPU and the GPU areeffectively improved.

Description

technical field [0001] The present invention relates to the field of GPU management design, in particular to a GPU management device, method and GPU server based on a detection and adjustment module. Background technique [0002] With the rapid development of GPU (graphics processing unit) server technology, more and more machine learning and AI (artificial intelligence) applications have been promoted and used; GPU servers have been widely used as deep learning, training and other services. [0003] In the prior art, a lot of GPU processors are required for applications in graphic design, artificial intelligence, scientific research and other fields, and a server often includes GPU processors and CPU processors. While CPU processors are better at integer calculations, GPU processors are better at floating point calculations. [0004] However, when processing existing tasks, it is impossible to adjust the appropriate interconnection topology between the CPU and GPU accordin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06F11/30G06F1/20
CPCG06F9/5038G06F11/3062G06F1/20G06F2209/5021G06F2209/508Y02D10/00
Inventor 滕学军
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap