The present application relates to the field of
agricultural machinery safety
perception and intelligent early warning technology, and particularly relates to a
silage harvester
living body detection and early warning method fusing
thermal infrared and visible light, wherein a
thermal infrared camera and a visible light camera are installed on the roof of the harvester, calibration parameters and
spatial mapping relationships are obtained in advance, dual-mode images of the front work area are collected in real time, pre-stored parameters are called to perform synchronous matching and
spatial registration, the dual-mode
image pair is input into an RGBT-YOLO network based on the improvement of YOLOv11, temperature features are extracted through the
thermal infrared branch, texture features are extracted through the visible light
branch, and the class, position and confidence of the
living body target are output after cross-
modal fusion and lightweight detection, when a person or an animal enters a preset dangerous area in front of the header and continuously meets the alarm conditions, an audible and visual
alarm device is driven to send an early warning
signal, and the problems of insufficient consideration of dual-mode
image registration, feature-
level fusion detection and early warning control
closed loop in the working scene of the dangerous area in front of the
silage harvester at the present stage are solved.