The invention provides a self-supervised mulberry
disease and
insect pest recognition method and
system fused with a multi-mode YOLO
algorithm, and the method comprises the steps: providing a Multi-Modan-YOLO
algorithm fused with a multi-mode
information processing technology, namely, the multi-mode YOLO
algorithm, and carrying out the self-supervised mulberry
disease and
insect pest recognition method fused with the multi-mode YOLO algorithm; and audio information and thermal imaging information are combined to further improve the accuracy of the identification result of the pest and
disease damage types. A self-
supervised learning framework driven by a multi-
modal large model is introduced, when the identification deviation risk exceeds a preset threshold value, the multi-
modal large model is called to generate a category
label, and the model is endowed with the ability of dynamically generating a new
label for a new type of pest and
disease damage. Therefore, misrecognition caused by non-uniform distribution of training data or missing of a certain category of data is effectively prevented; according to the method, targets such as disease spots and
insect pests on mulberry leaves are accurately identified, so that the efficiency and accuracy of mulberry disease and
insect pest prevention and control are improved, the influence on silkworm production is reduced, and yield increase is promoted.