The invention provides a conveyor state monitoring device and method based on
machine vision, and the device comprises a monitoring cabin which can autonomously reciprocate along a rigid guide rail at one side of a conveyor, automatic charging piles are arranged at the two ends of the guide rail, and the monitoring cabin is integrated with an
infrared thermal imager, a visual camera and a sound sensor. A
vibration sensor and an incremental photoelectric
encoder are arranged along the line. A processor is arranged in the monitoring cabin, and
time alignment,
feature extraction, fusion of a multi-scale
feature fusion model and three-level decision judgment are carried out on
infrared signals, visual signals, sound signals and vibration signals on the basis of
encoder timestamps. According to the method, fault diagnosis and
false alarm filtering are achieved by controlling inspection of a monitoring cabin, multi-
source data preprocessing, confrontation
feature fusion network processing and three-level progressive judgment, and accurate positioning is achieved based on the mapping relation between
encoder pulses and support numbers. According to the invention, the monitoring coverage range is expanded, the endurance continuity is improved, the
data transmission stability is improved, and the
false alarm rate is reduced.