The invention belongs to the technical field of automatic driving and
environmental perception, and particularly relates to a 4D
millimeter-
wave radar-camera omnidirectional speed
estimation method based on a
CAN bus, and the method specifically comprises the steps: S1, data collection and coordinate
system unification; s2, vehicle motion information provided by a vehicle
CAN bus is utilized to carry out pre-compensation on motion of the vehicle, and the absolute radial speed is obtained; s3, constructing a speed constraint condition by using
optical flow and depth information, simplifying an inter-frame
transformation matrix into a unit matrix in combination with motion compensation, and greatly simplifying an inter-frame motion transformation relationship; and S4, establishing three constraint conditions by combining the
optical flow, the depth and the radial speed of the
radar, constructing a linear equation set about the omnidirectional speed of the target, and directly solving the linear equation set to obtain a closed
form solution of the three-dimensional omnidirectional speed of the target. According to the method, the accurate target depth and radial speed provided by the 4D
millimeter wave radar and the
optical flow information provided by the camera are fused, the
CAN bus is innovatively introduced to carry out pre-compensation on the motion of the vehicle, a linear constraint model of multi-source
information fusion is constructed, and complete
estimation of the three-dimensional omnidirectional speed of the target is achieved. The method effectively overcomes the limitation of a single sensor in speed
estimation, and improves the accuracy and robustness of speed estimation.