The invention discloses a
hydrogen leakage diagnosis method and device based on multi-
modal information combination, and relates to the technical field of industrial
safety monitoring and fault diagnosis, and the method comprises the steps: determining whether
hydrogen concentration data exceeds a set concentration threshold value or not; if the
hydrogen concentration data exceeds a set concentration threshold value, acquiring multi-
modal information data in real time; if the
hydrogen concentration data does not exceed the set concentration threshold value,
processing is not carried out; determining an acoustic
confidence map, an optical
confidence map and an
infrared confidence map; determining a fusion weight parameter based on the environment
information data and the
memory cell bank, and further obtaining a fusion confidence map and a weighted fusion
feature vector; determining a hydrogen leakage position based on the fusion confidence map; adopting a multi-output
neural network regression model to obtain hydrogen leakage quantitative parameters based on the weighted fusion feature vectors; and updating the
memory cell bank based on the environmental
information data, the hydrogen leakage position and the hydrogen leakage quantitative parameter. The accuracy, reliability and long-term stability of hydrogen leakage diagnosis can be improved.