A mechanical arm calibration method and a mechanical arm calibration device

By integrating a smart mobile terminal and a vision scanner into the calibration method of the robotic arm, the problems of space occupation and stability caused by the separation of the scanner and the robotic arm are solved, and the calibration accuracy and positioning accuracy are improved.

CN115781676BActive Publication Date: 2024-11-26NANTONG ROBERT MEDICAL TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202211503403.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-28
Publication Date
2024-11-26
Estimated Expiration
2042-11-28

AI Technical Summary

Technical Problem

In existing robotic arm calibration methods, separating the scanner from the robotic arm results in a large space occupation, high stability requirements, and difficulty in ensuring calibration accuracy.

Method used

A smart mobile terminal is used to replace the registration system. It utilizes the flat touch screen and magnetic connection of the spherical cylinder, and is integrated with a vision scanner at the end of the robotic arm. The transformation matrix is ​​solved by the SVD decomposition method to achieve registration between the robot's base coordinate system and the scanner's coordinate system.

Benefits of technology

It improves calibration accuracy, reduces hardware space occupation, ensures the stability of the relative position of the vision scanner and the robotic arm, and achieves precise positioning with an error of less than 1mm.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115781676B_ABST
    Figure CN115781676B_ABST
Patent Text Reader

Abstract

The present invention discloses a robot arm calibration method, comprising the following steps: 1. placing a smart mobile terminal flat within the reach of the robot arm; 2. placing a spherical cylinder at the end of the robot arm, and slowly placing the spherical cylinder on the flat touch screen of the smart mobile terminal through the robot arm; 3. when the flat touch screen is touched by the spherical cylinder, the robot arm stops moving, and obtains the position coordinates of the end of the robot arm in the robot base coordinate system; 4. repeating steps 2 and 3, placing at least four spherical cylinders of different heights at different positions on the flat touch screen; 5. fixing a visual scanner on the robot arm, controlling the visual scanner to move through the robot arm, and calculating the vertex coordinates of each spherical cylinder in the scanner coordinate system; 6. solving the transformation matrix between the robot base coordinate system and the scanner coordinate system. A calibration device for implementing the above robot arm calibration method is also disclosed. The present invention improves the calibration accuracy.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of robot arm calibration, and in particular to a robot arm calibration method and a calibration device thereof. Background Art

[0002] With the development of artificial intelligence technology, computer technology and other related technologies, robotic arms have been widely used in many industries. In the field of industrial applications, robotic arms usually need to rely on hand-eye systems to perform tasks such as machining and installation. Among them, the hand-eye system is a robotic arm vision system composed of a camera and a manipulator. In the robotic arm vision system, the camera is equivalent to the human eye, and the robot end effector is equivalent to the human hand.

[0003] The camera captures the spatial position of the spatial object in the visual coordinate system, and the end effector needs to grasp the spatial object in the robot base coordinate system. The spatial position of the spatial object in the visual coordinate system needs to be converted to the robot base coordinate system. The determination of the relationship between the camera's visual coordinate system and the robot base coordinate system is the robot's hand-eye calibration process.

[0004] The existing robot arm calibration method mainly adopts the method of separating the hand and the eye, which requires the cooperation of two robot arms or one robot arm and a bracket for operation. The calibration process is as follows:

[0005] Step 1, fix the scanner at a fixed position outside the robotic arm;

[0006] Step 2, using a robotic arm to clamp a standard ball with a known radius;

[0007] Step 3, control the robot arm to move to any position within the visible range of the scanner, and record the position coordinates of the robot arm at this time. The position coordinates can be read by the robot arm, which is the reference coordinates of the center of the standard ball relative to the robot, that is, the base coordinates of the robot arm;

[0008] Step 4, start the scanner to scan, obtain a hemispherical surface, and obtain the coordinates of the center of the sphere by a surface point fitting method, which are the scanner coordinates of the standard sphere in the scanner;

[0009] Step 5, repeat the above steps 3 and 4, generally repeat four times, to ensure that the standard ball is in a different position each time, and each time the standard ball cannot be in the same plane, so that two sets of coordinates are obtained, one set of coordinates contains four different robot arm coordinates, and the other set of coordinates contains four different scanner coordinates;

[0010] Step 6, decompose the two sets of coordinates using the SVD decomposition method to obtain the transformation matrix from the scanner coordinates to the robot arm coordinates;

[0011] Step 7, when the position of the scanner remains fixed, use the scanner to scan the target object, obtain the coordinates of the target object under the scanner, select a certain coordinate through the computer, and then use the solved transformation matrix to calculate the coordinates of the target object under the robot's reference coordinates, which can guide the robotic arm to work.

[0012] However, since the scanner is separated from the robotic arm and cannot be fixed together, it not only takes up space but also limits its application. At the same time, due to the separation of hands and eyes, it is necessary to ensure that the relative positions of the two are completely fixed during work, and the stability of both must be ensured at all times, which places high requirements on relative stability.

[0013] Therefore, the applicant has found a solution to the above-mentioned problem through beneficial exploration and research, and the technical solution to be introduced below is produced in this context. Summary of the invention

[0014] One of the technical problems to be solved by the present invention is to provide a robot arm calibration method with improved calibration accuracy in view of the deficiencies in the prior art.

[0015] The second technical problem to be solved by the present invention is to provide a calibration device for implementing the above-mentioned robot arm calibration method.

[0016] A robot arm calibration method as a first aspect of the present invention comprises the following steps:

[0017] Step S10, placing the smart mobile terminal flat within the reach of the robotic arm, and sending a stop movement instruction to the robotic arm when the flat touch screen of the smart mobile terminal is touched;

[0018] Step S20, placing the spherical cylinder at the end of the mechanical arm, and slowly placing the spherical cylinder on the flat touch screen of the smart mobile terminal through the mechanical arm;

[0019] Step S30, when the flat touch screen is touched by the spherical cylinder, the intelligent mobile terminal sends a stop movement instruction to the robotic arm, so that the robotic arm stops moving, and obtains the position coordinates of the end of the robotic arm in the robot base coordinate system at this time;

[0020] Step S40, repeatedly executing step S20 and step S30, placing at least four spherical cylinders of different heights at different positions on the flat touch screen of the smart mobile terminal;

[0021] Step S50, fixing the visual scanner on the mechanical arm, and controlling the visual scanner to move by the mechanical arm, so that the visual scanner scans each spherical cylinder, and calculates the vertex coordinates of each spherical cylinder in the scanner coordinate system according to the scanning results;

[0022] Step S60, registering the position coordinates of the end points of the robot arms in the robot base coordinate system and the vertex coordinates of the spherical cylinders in the scanner coordinate system, and solving the transformation matrix between the robot base coordinate system and the scanner coordinate system.

[0023] In a preferred embodiment of the present invention, the intelligent mobile terminal is a smart phone or a tablet computer.

[0024] In a preferred embodiment of the present invention, each spherical cylinder is connected to the end of the robot arm by magnetic attraction, and when the spherical cylinder is put in place, the spherical cylinder is separated from the end of the robot arm.

[0025] In a preferred embodiment of the present invention, the visual scanner is fixedly mounted on the end of the robotic arm via a dedicated fixing bracket.

[0026] In a preferred embodiment of the present invention, in step S50, the scanning result of the visual scanner is modeled by 3DMax software or Solidworks software, and the obtained three-dimensional model is point-finding processed by the gradient ascent method to obtain the vertex coordinates of each spherical cylinder in the scanner coordinate system.

[0027] In a preferred embodiment of the present invention, in step S60, the position coordinates of several robot arm ends in the robot base coordinate system and the vertex coordinates of several spherical cylinders in the scanner coordinate system are aligned through the SVD decomposition method to solve the transformation matrix between the robot base coordinate system and the scanner coordinate system.

[0028] As a second aspect of the present invention, a calibration device for implementing the above-mentioned robot arm calibration method comprises:

[0029] An intelligent mobile terminal, the intelligent mobile terminal is connected to the robot system wirelessly or wiredly, the intelligent mobile terminal has a flat touch screen, and when the flat touch screen is touched, the intelligent mobile terminal sends a stop motion instruction to the robot system, so that the robot arm of the robot system stops moving;

[0030] At least four spherical cylinders of different heights, each of which can be arranged at the end of the mechanical arm and can be placed on the flat touch screen of the smart mobile terminal under the drive of the mechanical arm;

[0031] A position coordinate acquisition module, which is used for the position coordinates of the end of the manipulator in the robot base coordinate system;

[0032] A visual scanner, wherein the visual scanner is fixedly mounted on the mechanical arm and is controlled by the mechanical arm to move, so that the visual scanner scans each spherical cylinder located on the flat touch screen of the smart mobile terminal, and calculates the vertex coordinates of each spherical cylinder in the scanner coordinate system according to the scanning results; and

[0033] The transformation matrix solving module is used to obtain the position coordinates of several robot arm ends in the robot base coordinate system and the vertex coordinates of several spherical cylinders in the scanner coordinate system, and to align the obtained coordinate information to solve the transformation matrix between the robot base coordinate system and the scanner coordinate system.

[0034] Due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0035] 1. The present invention uses an intelligent mobile terminal to replace the registration tooling in other registration systems, and utilizes the sensitivity and surface flatness of the flat touch screen of the intelligent mobile terminal, as well as the convenience of programming, to improve the calibration accuracy and avoid errors caused by naked eye observation;

[0036] 2. The present invention can effectively reduce the error caused by the installation of the calibration tooling, improve the calibration accuracy of the system, effectively control the robot arm to work at the corresponding physical position, and achieve precise positioning;

[0037] 3. The visual scanner of the present invention is integrated into the end of the robot arm, and does not need to be set separately, which saves the use space of the hardware part, and at the same time ensures the stability of the relative position relationship between the visual scanner and the robot arm, and solves the calibration problem of the scanner and the robot arm in the robot hand-eye integrated work;

[0038] 4. After completing the alignment of the coordinate system relationship between the visual scanner and the robotic arm, the present invention uses a high-precision model to verify the accuracy. When the end of the robotic arm reaches the specified spatial position, the actual error is less than 1 mm, which can achieve commercial accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0040] Figure 1 It is a flow chart of the robot arm calibration method of the present invention. DETAILED DESCRIPTION

[0041] In order to make the technical means, creative features, objectives and effects achieved by the present invention easy to understand, the present invention is further described below with reference to specific diagrams.

[0042] See also Figure 1 , the figure shows a robot arm calibration method, which includes the following steps:

[0043] Step S10: Place the smart mobile terminal flat within the reach of the robot arm. The smart mobile terminal has a flat touch screen. When the flat touch screen is touched, the smart mobile terminal sends a stop movement instruction to the robot arm.

[0044] Step S20: placing the spherical cylinder at the end of the robotic arm, and slowly placing the spherical cylinder on the flat touch screen of the smart mobile terminal through the robotic arm.

[0045] Step S30, when the flat touch screen is touched by the spherical cylinder, the intelligent mobile terminal sends a stop movement instruction to the robotic arm, so that the robotic arm stops moving, and obtains the position coordinates of the end of the robotic arm in the robot base coordinate system at this time.

[0046] Step S40, repeating step S20 and step S30, placing a total of four spherical cylinders of different heights at different positions on the flat touch screen of the smart mobile terminal.

[0047] Step S50, fix the visual scanner to the robot arm, and control the visual scanner to move through the robot arm, so that the visual scanner scans each spherical cylinder, and calculates the vertex coordinates of each spherical cylinder in the scanner coordinate system according to the scanning results.

[0048] Step S60 , registering the position coordinates of the four robot arm ends in the robot base coordinate system and the vertex coordinates of the four spherical cylinders in the scanner coordinate system, and solving the transformation matrix between the robot base coordinate system and the scanner coordinate system.

[0049] In step S10, the intelligent mobile terminal is directly or indirectly connected to the robot system by wired or wireless means, and can send control instructions to the robot system. Specifically, the intelligent mobile terminal transmits the control instructions to the computer host program through the network, and then the computer host program sends the control instructions to the robot system. In this embodiment, the intelligent mobile terminal is preferably a smart phone or a tablet computer. Utilizing the sensitivity and surface flatness of the flat touch screen of the intelligent mobile terminal, as well as the convenience of programming, when the ball cylinder slowly descends and touches the flat touch screen, the intelligent mobile terminal generates a stop motion instruction and sends it to the robot system. After the robot system receives the stop motion instruction, it controls the robot arm to stop the action. When the ball cylinder is separated from the robot arm, it is necessary to ensure that the position of the ball cylinder does not change. The present invention uses an intelligent mobile terminal to replace the alignment tooling in other alignment systems, and utilizes the sensitivity and surface flatness of the flat touch screen of the intelligent mobile terminal, as well as the convenience of programming, to improve the calibration accuracy and avoid errors caused by naked eye observation.

[0050] In step S20, each spherical cylinder is connected to the end of the robot arm by magnetic attraction. When the spherical cylinder is in place, the spherical cylinder is separated from the end of the robot arm. Of course, other methods can also be used for connection. It is only necessary to ensure that the position of the spherical cylinder on the flat touch screen does not change when the spherical cylinder and the end of the robot arm are separated. In addition, during the entire calibration process, in order to avoid the spherical cylinder from swaying, it is necessary to ensure that the environment is as closed as possible without interference from air flow, and at the same time, the robot arm descends as slowly as possible to ensure that the spherical cylinder falls smoothly on the flat touch screen.

[0051] In this embodiment, the spherical cylinder is composed of a cylinder and a sphere arranged on the cylinder. The sphere can better calculate the coordinates of the center of the sphere. The cylinder can ensure that when it touches the flat touch screen, it triggers the response of the smart phone, and at the same time ensures that the spherical cylinder can stand on the flat touch screen. The present invention needs to accurately find the position of the spherical center coordinates in the robot arm coordinate system and the scanner coordinate system. The position of the spherical center coordinates in the robot arm can be obtained in the robot system through the spherical radius and the physical length of the holding device; the position of the spherical center coordinates in the visual scanner can be fitted by the points on the surface of the object scanned by the visual scanner. If other objects are used, the requirements will not be met. In addition, it is necessary to ensure that when the robot arm holds the spherical object to land, it lands vertically, and the gravity of the spherical cylinder can be used to make it fall slowly, ensuring the stability of the vertical landing.

[0052] In step S40, the number of spherical cylinders is not limited to that in the present embodiment, and should be determined according to actual accuracy requirements. However, it is necessary to ensure that there are at least four spherical cylinders, and the heights of each spherical cylinder are not equal, that is, to ensure that the sphere centers of each spherical cylinder are not on the same horizontal plane, because at least four coordinates are required to achieve registration when aligning the coordinate system.

[0053] In step S50, the visual scanner is fixedly mounted on the end of the robotic arm by a special fixing bracket, and the special fixing bracket can be manufactured by 3D printing. Since the visual scanner is integrated into the end of the robotic arm, there is no need to separate it, which saves the use space of the hardware part, and at the same time ensures the stability of the relative position relationship between the visual scanner and the robotic arm, solving the calibration problem of the scanner and the robotic arm in the robot hand-eye integrated work. The visual scanner selects a suitable height for scanning. The lower the height of the visual scanner is, the better without touching the flat touch screen. The lower the height, the less it will be affected by external interference. You can choose to scan at a height of 1cm to 10cm from the flat touch screen.

[0054] In step S50, the scanning result of the visual scanner is modeled by 3DMax software or Solidworks software, and the obtained three-dimensional model is point-finding processed by using the gradient ascent method to obtain the vertex coordinates of each spherical cylinder in the scanner coordinate system.

[0055] In step S60, the position coordinates of the ends of several manipulators in the robot base coordinate system and the vertex coordinates of several spherical cylinders in the scanner coordinate system are registered by the SVD decomposition method to solve the transformation matrix between the robot base coordinate system and the scanner coordinate system. Among them, the SVD decomposition method is referred to as the singular value decomposition method, which is a conventional algorithm in this field and will not be elaborated here. The role of the transformation matrix is ​​to match the manipulator coordinate system with the scanner coordinate system. When the coordinates in one coordinate system are known, the coordinates in another coordinate system can be obtained by matrix multiplication with the transformation matrix. In this way, by selecting a point in the scanner model, the manipulator can be controlled to accurately reach the point and complete the corresponding operation.

[0056] After completing the coordinate system alignment of the visual scanner and the robotic arm, the present invention uses a high-precision model to verify the accuracy. When the end of the robotic arm reaches the specified spatial position, the actual error is less than 1 mm, which is able to achieve commercial accuracy.

[0057] The calibration device of the present invention comprises an intelligent mobile terminal, four spherical cylinders with different heights, a position coordinate acquisition module, a visual scanner and a transformation matrix solving module.

[0058] The intelligent mobile terminal is connected to the robot system wirelessly or wiredly. The intelligent mobile terminal has a flat touch screen. When the flat touch screen is touched, the intelligent mobile terminal sends a stop motion instruction to the robot system, causing the robot arm of the robot system to stop moving.

[0059] Each ball column can be arranged at the end of the mechanical arm, and can be placed on the flat touch screen of the smart mobile terminal under the drive of the mechanical arm.

[0060] The position coordinate acquisition module is used for the position coordinates of the end of the robotic arm in the robot base coordinate system.

[0061] The visual scanner is fixedly mounted on the robotic arm and is controlled to move by the robotic arm, so that the visual scanner scans each spherical cylinder on the flat touch screen of the smart mobile terminal and calculates the vertex coordinates of each spherical cylinder in the scanner coordinate system based on the scanning results.

[0062] The transformation matrix solving module is used to obtain the position coordinates of several robot arm ends in the robot base coordinate system and the vertex coordinates of several spherical cylinders in the scanner coordinate system, and to align the obtained coordinate information to solve the transformation matrix between the robot base coordinate system and the scanner coordinate system.

[0063] Each module in the calibration device of the present invention can be implemented in whole or in part by software, hardware, or a combination thereof. The above modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to the above modules.

[0064] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage or other media used in the embodiments provided in the present application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0065] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. A robot arm calibration method, characterized in that: The following steps are involved: Step S10, placing the smart mobile terminal flat within the reach of the robotic arm, and sending a stop movement instruction to the robotic arm when the flat touch screen of the smart mobile terminal is touched; Step S20, placing the spherical cylinder at the end of the mechanical arm, and slowly placing the spherical cylinder on the flat touch screen of the smart mobile terminal through the mechanical arm; Step S30, when the flat touch screen is touched by the spherical cylinder, the intelligent mobile terminal sends a stop movement instruction to the robotic arm, so that the robotic arm stops moving, and obtains the position coordinates of the end of the robotic arm in the robot base coordinate system at this time; Step S40, repeatedly executing step S20 and step S30, placing at least four spherical cylinders of different heights at different positions on the flat touch screen of the smart mobile terminal; Step S50, fixing the visual scanner on the mechanical arm, and controlling the visual scanner to move by the mechanical arm, so that the visual scanner scans each spherical cylinder, and calculates the vertex coordinates of each spherical cylinder in the scanner coordinate system according to the scanning results; Step S60 , registering the position coordinates of the end points of the robot arms in the robot base coordinate system and the vertex coordinates of the spherical cylinders in the scanner coordinate system, and solving the transformation matrix between the robot base coordinate system and the scanner coordinate system.

2. The robot arm calibration method according to claim 1, characterized in that: The intelligent mobile terminal is a smart phone or a tablet computer.

3. The robot arm calibration method according to claim 1, characterized in that: Each spherical column is connected to the end of the robot arm by magnetic attraction. When the spherical column is placed in place, the spherical column is separated from the end of the robot arm.

4. The robot arm calibration method according to claim 1, characterized in that: The visual scanner is fixedly mounted on the end of the robotic arm via a dedicated fixing bracket.

5. The robot arm calibration method according to claim 1, characterized in that: In step S50, the scanning result of the visual scanner is modeled by 3DMax software or Solidworks software, and the obtained three-dimensional model is point-finding processed by using the gradient ascent method to obtain the vertex coordinates of each spherical cylinder in the scanner coordinate system.

6. The robot arm calibration method according to claim 1, characterized in that: In step S60, the position coordinates of several robot arm ends in the robot base coordinate system and the vertex coordinates of several spherical cylinders in the scanner coordinate system are registered by SVD decomposition method to solve the transformation matrix between the robot base coordinate system and the scanner coordinate system.

7. A calibration device for implementing the robot arm calibration method according to any one of claims 1 to 6, characterized in that: include: An intelligent mobile terminal, the intelligent mobile terminal is connected to the robot system wirelessly or wiredly, the intelligent mobile terminal has a flat touch screen, and when the flat touch screen is touched, the intelligent mobile terminal sends a stop motion instruction to the robot system, so that the robot arm of the robot system stops moving; At least four spherical cylinders of different heights, each of which can be arranged at the end of the mechanical arm and can be placed on the flat touch screen of the smart mobile terminal under the drive of the mechanical arm; A position coordinate acquisition module, which is used for the position coordinates of the end of the manipulator in the robot base coordinate system; A visual scanner, wherein the visual scanner is fixedly mounted on the mechanical arm and is controlled by the mechanical arm to move, so that the visual scanner scans each spherical cylinder located on the flat touch screen of the smart mobile terminal, and calculates the vertex coordinates of each spherical cylinder in the scanner coordinate system according to the scanning results; and The transformation matrix solving module is used to obtain the position coordinates of several robot arm ends in the robot base coordinate system and the vertex coordinates of several spherical cylinders in the scanner coordinate system, and to align the obtained coordinate information to solve the transformation matrix between the robot base coordinate system and the scanner coordinate system.