The invention discloses a bird identification method and
system based on dynamic multi-
modal fusion and a self-evolution lightweight model, and belongs to the technical field of bird identification. The method comprises the steps of collecting multi-
modal data, preprocessing the multi-
modal data to obtain a voiceprint feature map and an image
tensor, extracting a voiceprint high-level
semantic feature vector and an image high-level
semantic feature vector from the voiceprint feature map and the image
tensor respectively based on a lightweight
convolutional neural network, and fusing the voiceprint high-level
semantic feature vector and the image high-level semantic
feature vector through a dynamic fusion module to obtain a voiceprint high-level semantic
feature vector and an image high-level semantic
feature vector; the method comprises the steps of obtaining a fusion feature vector, constructing a lightweight recognition model, training the lightweight recognition model through a self-evolution module by adopting a
hybrid evolution strategy, deploying the trained lightweight recognition model to an application terminal, and carrying out bird recognition and result output through the trained lightweight recognition model at the application terminal. According to the invention, by dynamically fusing the multi-modal information and the self-evolution lightweight model, the accuracy, robustness and adaptive ability of bird recognition in a complex environment are improved.