The invention discloses a hanging object tracking and falling detection method and device based on multi-
sensor fusion. The method comprises the following steps: monitoring revolutions of a main
winch and an auxiliary
winch through an
encoder to adjust a vertical rotation angle of a camera to ensure that a
view angle covers a lifting hook and a lifted object; a six-axis sensor on the lifting hook is used for judging the motion state of the lifting hook, if the lifting hook is in motion, image SIFT feature point displacement is analyzed to calculate background displacement, a
mean square error is used for dividing a background area and a motion area, and the positions of the lifting hook and a lifted object are determined in combination with
encoder data; based on a visual judgment result and six-axis sensor information, PID
control logic is applied to adjust the speed and angle of a camera in real time, so that the hanging object is kept at the center of a
visual angle; when the
tower crane moves and the hung object stops, the rotating speed of the camera is predicted and adjusted according to the movement law of the
tower crane, continuous tracking of the hung object is achieved, and whether the hung object falls off or not is determined according to the multiple hung object positions. By implementing the method provided by the invention, accurate real-time tracking of the hung object can be realized, and the
system can effectively work even in a dynamic environment or under an abnormal condition.