The invention relates to the technical field of neural
network model construction, in particular to a lightweight neural
network model construction method, which comprises the following steps: based on a target task
data set, in a lightweight basic operator
library comprising a depth separable
convolution, an inverted residual structure and an attention mechanism module, constructing a lightweight neural
network model; and searching and jointly optimizing
network structure parameters and weight parameters through the differentiable neural architecture to obtain an initial lightweight network model. And deploying the initial model in a target hardware
simulation environment, and generating a
Pareto optimal model cluster through structural re-parameterization and hardware-aware progressive channel
pruning iterative optimization by taking model precision, reasoning
delay and memory occupancy as collaborative optimization targets. And selecting a reference student model from the clusters according to deployment constraints, constructing a
distillation framework taking the initial model as a teacher model, and performing fine adjustment by adopting a mixed strategy fusing multi-dimensional
distillation loss to obtain a final model. The model gives consideration to precision and efficiency, and the detection efficiency and the
quality control level are improved.