The invention relates to the technical field of
industrial robot visual control, and discloses a
welding seam
visual detection and
robot coordinate
conversion method and
system based on multi-
modal feature fusion, which can realize high-precision automatic detection and positioning of a
welding seam in a complex industrial environment and accurately convert a detection result into a space coordinate which can be executed by a
robot. According to the scheme, during modeling, images and teaching coordinates are collected, template blocks are
cut, multi-
modal features are pre-calculated, relevant data are stored after the physical distance is calculated, and indexes are updated; when the
welding seam is detected, teaching coordinates are called to
cut the reasoning block for detection, offset
cutting and a model size backspacing mechanism are supplemented, then the welding seam is determined through multi-
modal fusion similarity screening, and pixel coordinates are calculated; and finally, obtaining a depth value, carrying out
distortion removal on the pixel coordinates to recover the three-dimensional coordinates of the camera, and carrying out
homogeneous transformation to obtain the coordinates of the
robot base and outputting the coordinates. The method is suitable for complex industrial environments with multiple welding seams, multiple interferences, high
light reflection and the like, and the
automation level and the welding precision of the welding robot can be remarkably improved.