The invention discloses an
emergency rescue real-time
human body detection method and device based on
time sequence motion feature enhancement, and the method comprises the steps: obtaining visible light and
infrared image sequences of a rescue region and environment parameters (including
smoke concentration and illumination intensity) in real time, and carrying out the
spatial registration preprocessing; respectively carrying out
frame difference processing on the two types of image sequences, generating a binary motion
mask, calculating an
optical flow amplitude, and carrying out adaptive fusion according to
smoke concentration to obtain a multi-scale motion energy field;
human body micro-motion
frequency band energy is extracted through time-frequency transformation, a
frequency domain dynamic attention
mask is generated, and a saliency motion target area is extracted in combination with a multi-scale motion energy field; constructing a double-
branch neural network, extracting
time sequence motion features and multi-
modal appearance features, dynamically distributing weights and fusing the weights, and outputting a
human body bounding box and detection confidence; and calculating environment complexity according to the environment parameters, determining a dynamic
confidence threshold, verifying a detection result by combining the average temperature of the human body bounding box region, and generating alarm information if a condition is met. The method aims at solving the problems that a traditional method is high in omission ratio and unstable in recognition in a complex environment.