A multi-modal state perception and fault diagnosis method based on device identification guidance

Abstract

This invention discloses a multimodal state perception and fault diagnosis method based on equipment identification guidance. The method includes: acquiring multimodal information of the power equipment under test to obtain multimodal perception data; performing time synchronization, spatial alignment, and data normalization processing on the multimodal perception data; automatically identifying the power equipment based on visible light imaging information to obtain equipment type information and / or key structural location information; selecting a multimodal fusion and diagnosis strategy matching the corresponding power equipment according to the equipment type information, and jointly analyzing the multimodal perception data; and outputting the state assessment result and / or fault diagnosis result of the power equipment based on the joint analysis result. By using equipment identification results as a priori constraints to guide the multimodal information fusion and diagnosis process, this invention achieves differentiated state perception and fault diagnosis for different types of power equipment, improving detection accuracy and engineering applicability.

Images