The invention discloses an
intelligent computing power
resource management system and method, and the
system comprises a
virtual computing power card HAL, a computing
power management unit, and a computing power resource application and release unit, the
virtual computing power card HAL is used for carrying out the computing power abstraction of all GPU / FPGA / NPU
physical computing power cards, and forming a plurality of computing power resource pools with the computing power aggregation of the plurality of computing power cards; the computing
power management unit is used for performing data
resource management on a computing power
resource pool by taking 1TFLOPS as a unit; the computing power resource application and release unit provides API interfaces for different applications, and dynamic application, dynamic release and dynamic migration of computing power resources are achieved, so that the
switching frequency of application contexts is reduced. According to the invention,
cooperative work and computing power aggregation of a plurality of computing power cards such as GPU / NPU / FPGA are realized, so that a larger computing power
resource pool is formed. And 1TFLOPS is taken as the minimum unit of computing
power management, so that fragmentation of computing power resources is reduced, dynamic application and release of the computing power resources are realized, and the efficiency of the computing power card is improved.