The invention discloses a weld ROI segmentation method based on active and passive vision fusion. The method comprises the following steps: synchronously acquiring a two-dimensional image and a three-dimensional
point cloud of the surface of a welded workpiece; inputting the trained
deep learning network, and outputting a weld joint candidate region and a pixel-level
mask graph thereof; establishing a cross-
modal mapping relation through geometric calibration, and projecting the three-dimensional
point cloud to a two-dimensional image to complete registration and fusion;
cutting from the three-dimensional
point cloud by using a cross-
modal mapping relation to obtain a candidate point cloud region; generating a gray matrix for
ray odd-even discrimination according to the pixel-level
mask pattern; and each point of the candidate point cloud is projected to a pixel coordinate point by point,
ray odd-even discrimination is carried out on the projection points according to the gray matrix, the points conforming to an odd-even rule are determined as
welding line points and are aggregated into a
welding line ROI point cloud, and the
welding line ROI point cloud is output as a segmentation result. According to the method, the
adaptive capacity to the unstructured welding seam is effectively improved, the
point cloud processing complexity is reduced, and good real-time performance and robustness are achieved.