The present application relates to the technical field of
hardware acceleration and
artificial intelligence inference deployment, and discloses a method and
system for deploying a
convolutional neural network after training, comprising S1 environment initialization; S2 model training and freezing; S3 frozen graph precision evaluation; S4 quantization and quantization precision evaluation; S5 compilation to generate a deployment model; S6 deployment
package generation and DPU activation; S7
inference verification and performance statistics. The method for deploying the
convolutional neural network after training can decompose the CNN deployment process after training into a series of ordered steps such as environment initialization, model training,
computation graph freezing, frozen graph precision evaluation, quantization calibration, quantization graph precision evaluation, DPU model compilation for target FPGA platform, deployment
package generation, DPU activation and
inference verification, by constructing a standardized and scriptable full-
process deployment link, and each link is executed in series through a scriptable way, and the link effectively reduces the probability of human operation errors.