A method for rapid identification and classification of veterinary parasites based on multi-modal image fusion

Abstract

The present invention discloses a method for the rapid identification and classification of veterinary parasites based on multi-modal image fusion, comprising the following steps: collecting multi-modal data of parasites, the multi-modal data including static image data, text inspection data and dynamic data of parasites; processing the multi-modal data by using an MLP and a multi-modal data fusion model to construct a first fusion feature and a second fusion feature; constructing a multi-level classification framework, inputting the first fusion feature, the second fusion feature and their corresponding preset category labels into the multi-level classification framework for training, optimizing a loss function by using an adaptive gating mechanism to obtain a parasite classification model; collecting multi-modal data of parasites online, performing the classification of parasites by using the parasite classification model. The present invention can effectively improve the accuracy and computational efficiency of parasite classification. (Fig.1)