The invention discloses a multi-
sensor fusion-based obstacle detection and recognition method for a
wharf unmanned vehicle, and relates to the technical field of intelligent driving, and the method comprises the steps: setting a maximum threshold value and a minimum threshold value, comparing a sensor coverage rate with the maximum threshold value and the minimum threshold value, executing a sensor increase and decrease strategy, and carrying out the
time synchronization of sensor data; obtaining an internal parameter matrix, a
distortion coefficient and an external parameter matrix, projecting three-dimensional point coordinates of the
point cloud data into two-dimensional coordinates of an
image plane, and converting the two-dimensional coordinates in the image data into three-dimensional coordinates in a
global coordinate system; labeling the sensor data to obtain a two-dimensional bounding box and a three-dimensional bounding box, and obtaining the category and
pose label of an obstacle; building a multi-
modal fusion
perception model, and training the multi-
modal fusion
perception model by taking the sensor data and the categories and
pose labels of the obstacles as training data; and deploying the optimized multi-
modal fusion
perception model, and outputting the category and
pose information of the obstacle, so that the method is suitable for a complex driving environment.