The invention discloses a three-dimensional color modeling method and
system based on multi-
sensor fusion, and the method comprises the steps: obtaining
monocular vision
pose information, an
RGB image and
radar three-dimensional
point cloud information, enabling the
monocular vision
pose information to be used for correcting a
radar pose, and generating corrected
point cloud information; the corrected
point cloud information is screened and then projected to a specific plane; proper feature points are extracted from the
projection image and the
RGB image, and according to the corresponding relation between the feature points of the
projection image and the
RGB image, the plane point cloud of the
projection image and the pixel coordinate plane of the RGB image are registered; performing fusion modeling on the point cloud and the image data by using an MRF model; according to the method, the
radar pose is corrected by using visual pose information, the accumulated error influence of a
system is reduced, the corrected point cloud is projected to a plane, and feature points of a projection image and a
color image are extracted to establish an MRF model for describing the relationship between a pixel plane and the corresponding point cloud, so that a point cloud image which is uniformly distributed in space and contains color information is obtained.