The invention relates to the technical field of object recognition based on image and
point cloud fusion, and discloses a
machine vision-based obstacle detection method and
system in a container moving process, and the method comprises the steps: obtaining three-dimensional
point cloud data through a
laser radar installed on container carrying equipment, and obtaining a two-dimensional image through an industrial camera; performing
terrain reference correction on the three-dimensional
point cloud data, and establishing an inclined coordinate
system matched with the ground gradient; performing
perspective distortion correction on the two-dimensional
image based on the inclined coordinate
system to obtain a corrected two-dimensional image; extracting edge features,
angular point features and semantic features from the corrected two-dimensional image; extracting geometric features and reflection intensity features of the three-dimensional point
cloud data under the inclined coordinate system; performing cross-
modal fusion on the edge features, the
angular point features, the semantic features, the geometric features and the reflection intensity features to generate fusion features; and the obstacle type is identified based on the fusion feature, and the obstacle sensing reliability in the complex industrial environment is improved.