The invention discloses a
thunder-vision fusion multi-sensor collaborative
sensing system along a railway and an installation and calibration method, and belongs to the technical field of intelligent traffic and environment sensing. Aiming at the problems of low target detection precision, poor multi-
source data fusion timeliness, dependence on manpower on sensor installation and calibration and the like in a complex scene along a railway, the
system provides an innovative architecture of'layered sensing-dynamic fusion-autonomous calibration '. The multi-
modal sensor array of a
laser radar, a
millimeter-
wave radar, a visible light camera and a
thermal infrared imager is deployed; autonomous optimization of sensor
pose parameters is realized by using track geometric constraint and a
deep learning model; an
edge computing node and a cloud
collaboration platform are integrated, and real-time target tracking, intrusion early warning and
equipment state diagnosis are supported. Experiments show that the target detection accuracy rate of the
system is greater than or equal to 98.5%, the
false alarm rate is less than or equal to 0.3% and the self-
calibration error of sensor installation parameters is less than 0.05 degree in the scenes of rain and
fog, night, high-speed movement and the like, which are improved by more than 40% compared with the traditional scheme.