Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mechanical arm hand-eye calibration method based on spatial distance and epipolar line constraint

A technology of spatial distance and hand-eye calibration, applied in the field of visual calibration, which can solve the problems of lack of constraint information, constraint information fusion, etc.

Active Publication Date: 2019-03-19
ZHEJIANG UNIV
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the existing hand-eye calibration algorithm lacks the constraint information at the actual 3D level, and does not integrate the spatial dimension information and the constraint information that the spatial projection geometry should satisfy into the process of parameter optimization.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mechanical arm hand-eye calibration method based on spatial distance and epipolar line constraint
  • Mechanical arm hand-eye calibration method based on spatial distance and epipolar line constraint
  • Mechanical arm hand-eye calibration method based on spatial distance and epipolar line constraint

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0072] The present invention will be further described below in conjunction with drawings and embodiments.

[0073] Embodiments of the present invention and its implementation process are as follows:

[0074] (1) figure 1 is a flow chart of the method of the present invention. The model of the robotic arm in this experiment is ABB-IRB-120, the model of the industrial camera is Basler-acA2440-20gm, and the model of the lens is Computar-M1224-MPW2.

[0075] Such as figure 2 As shown, the manipulator includes the base of the manipulator and the end effector. The end effector is installed on the base of the manipulator. The end effector is equipped with a camera. The manipulator is located above the calibration plate. The surface of the calibration plate has a black and white chessboard pattern. The end effector moves the camera to take a complete image of the calibration plate;

[0076] The camera fixed on the end effector of the manipulator is calibrated using the Zhang Zhe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a mechanical arm hand-eye calibration method based on the spatial distance and epipolar line constraint. The mechanical arm hand-eye calibration method comprises the steps thatan initial value of a hand-eye conversion matrix is solved, a conversion relationship of a camera fixed to a mechanical arm when the mechanical arm is at the two different positions is obtained, epipolar line errors of feature points in images are calculated through internal parameters of the camera, the feature points are subjected to three-dimensional reconstruction, the spatial distance between the reconstructed feature points is calculated, spatial distance errors are calculated according to the actual spatial distance, the cumulative sum of all the epipolar line errors and the spatial distance errors of all the feature points serve as an optimized objective function, iterative optimization is conducted through a Levenberg-Marquardt algorithm, and the hand-eye conversion matrix with higher precision is obtained. According to the mechanical arm hand-eye calibration method, the optimized objective function which better meets the actual demands can be constructed, thus the spatial size calculated by the hand-eye conversion matrix is more consistent to the actual size, the convergence rate of iterative optimization is increased, it is ensured that the optimized parameters meet theepipolar geometry constraint, and the precision is higher.

Description

technical field [0001] The present invention relates to a visual calibration method, relates to a mechanical arm hand-eye calibration method based on spatial distance and epipolar constraints, is suitable for a robot visual guidance system for fusion of a mechanical arm and a camera, and relates to visual assembly of a mechanical arm and assisted surgery with a mechanical arm And technical fields such as robotic arm visual inspection. Background technique [0002] The vision-guided manipulator control system based on the fusion of camera and manipulator can improve the flexibility, automation and intelligence of production. increasingly important role. The camera fixed on the end effector of the manipulator can be used to complete the target detection task, and most of the detection results are in the camera coordinate system. Therefore, it is necessary to obtain a high-precision hand-eye transformation matrix, so that the detection results are converted from the camera co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): B25J9/00B25J9/10B25J19/00
CPCB25J9/00B25J9/0009B25J9/10B25J19/00
Inventor 段桂芳刘夏刘振宇谭建荣
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products