The invention relates to a
wharf sensing method and
system based on data fusion of a
laser radar and a camera, and the method comprises the steps: firstly employing a fisheye camera to
shoot a
checkerboard calibration plate at multiple angles, employing a Zhang's calibration method to calculate an internal reference matrix and a
distortion coefficient of the fisheye camera, and synchronously collecting the data of the
laser radar and the camera in real time; the method comprises the following steps: performing
distortion removal
processing on a
camera image, calculating an external parameter matrix between a
laser radar and a camera through a
feature extraction algorithm, a
feature point matching algorithm and a nonlinear optimization
algorithm, and performing data fusion through an internal parameter matrix, the external parameter matrix and a bilinear interpolation method to generate fusion
point cloud data with color information; and finally, identifying a key target of the
wharf by marking and training a CNN model, and calculating three-dimensional parameters of the key target by adopting a specific calculation method, so that a sailor can quickly distinguish the target in the fused
point cloud data, the accuracy and efficiency of
wharf environment
perception are remarkably improved, and accurate environment
perception and decision support are provided for ship berthing and departing operation.