The invention relates to the technical field of intelligent agricultural equipment, in particular to a tomato
disease diagnosis method based on multi-
modal data analysis, which comprises the following steps of: 1, synchronously acquiring and preprocessing multi-
modal data, synchronously triggering a
hyperspectral imaging device and a microscopic camera, respectively acquiring a
plant canopy hyperspectral image and a stem
microscopic image, and acquiring a
plant canopy hyperspectral image and a stem
microscopic image; meanwhile, temperature,
conductivity and dissolved
oxygen environment parameters are continuously collected in the root zone; 2, self-adaptive
feature extraction and fusion in the growth stage are carried out,
reflectivity correction and leaf segmentation are carried out on the hyperspectral image, and leaf surface spectrum curve features are extracted; step 3,
hybrid model construction and space-time analysis: constructing a
hybrid model comprising spectrum,
microscopy and
environment analysis networks, and dynamically adjusting each network weight through a gating network; and 4, generating a
disease decision. The method can realize accurate, efficient and real-time tomato
disease diagnosis, has high practical value, and can effectively improve the
disease prevention and control capability in agricultural production.