Method and apparatus for calibrating the tool center point of an industrial robot system
By installing an interactive adapter on the end effector of an industrial robot and performing 5D calibration, combined with time calibration using photoelectric sensors, the calibration problem of the six degrees of freedom of the tool center point was solved, achieving high-precision automatic calibration suitable for automated production.
Patent Information
- Application Number
- CN202110369708.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-06
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2041-04-06
AI Technical Summary
Existing technologies struggle to calibrate the six degrees of freedom of the center point of industrial robot tools, especially the pose calibration of grippers or parts, resulting in insufficient positioning accuracy and affecting production quality and task completion.
By installing two interactive adapters on the end effector of an industrial robot system, calibrating five degrees of freedom in their respective coordinate systems, and calculating the sixth degree of freedom which is not included, and using photoelectric sensors for time-based calibration, the six degrees of freedom of the tool center point can be calibrated.
It achieves automatic calibration of the six degrees of freedom of the tool center point of industrial robots, reduces development and hardware costs, is suitable for automated production, and improves positioning accuracy and product quality on the production line.
Smart Images

Figure CN115185230B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of industrial robot calibration, and more specifically, to a method and apparatus for calibrating the tool center point of an industrial robot system, a computer storage medium, and an industrial robot system. Background Technology
[0002] With the rapid development of industrial robot technology, it has been increasingly widely used in manufacturing. For example, industrial robots are gradually entering the 3C industry (mainly referring to the technology industry based on computers, communications, and consumer electronics), where robots are needed to perform repetitive and tedious operations such as sorting and assembly. Depending on the specific task, different tools need to be installed at the end effector of the industrial robot.
[0003] However, the TCP (Tool Center Point) may deviate or deform after the gripper collides or wears, or after slight deformation of the robot's base coordinate system (e.g., ground subsidence due to prolonged load on the base). If the TCP deviates, the industrial robot may be unable to grip parts or products, or other processing may fail. In other words, the positioning accuracy of the TCP at the end effector of an industrial robot directly affects the quality of products on the production line; poor accuracy can even lead to the inability to complete the corresponding task.
[0004] The tool's center point typically has 6 degrees of freedom that need to be calibrated, including 3 translational degrees of freedom (x, y, z) and 3 rotational degrees of freedom. The simplest and most common method currently is the four-point calibration method. However, this method can only calibrate the three translational degrees of freedom (x, y, z) of the TCP. Furthermore, this calibration method often struggles to obtain the pose of the gripper or part, i.e., the three rotational degrees of freedom. Furthermore, this method can only be operated by humans and is not suitable for automated production.
[0005] In addition, there are currently five-degree-of-freedom calibration methods (e.g., ...). It cannot calibrate rotational deviations about the axis of the adapter located on the end effector (e.g., (θ)). If it is also necessary to calibrate rotational deviations about the axis of the adapter (i.e., to achieve 6 degrees of freedom)... If the TCP specification is not clear, then using a computer vision-based solution might be an option, but this would lead to a significant increase in development and hardware costs.
[0006] Therefore, it is desirable to provide an improved TCP calibration scheme for industrial robots. Summary of the Invention
[0007] According to one aspect of the present invention, a method for calibrating the tool center point of an industrial robot system is provided, the method comprising: performing five degrees of freedom on the first interaction adapter in a coordinate system AE0 of the first interaction adapter. The calibration; the second interaction adapter is subjected to the same 5 degrees of freedom in the coordinate system AE1 of the second interaction adapter. The calibration; and in the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom, or in the coordinate system dAE1_5D of the second interactive adapter after calibration of 5 degrees of freedom, the first degree of freedom (θ) not included in the 5 degrees of freedom is calculated, thereby realizing 6 degrees of freedom of the tool center point. The calibration, wherein the first degree of freedom (θ) is the angle of rotation about the axis of the first or second interactive adapter, and the first and second interactive adapters are mounted on the end effector of the industrial robot system.
[0008] As a supplement or replacement to the above scheme, in the above method, the first interaction adapter and the second interaction adapter can have arbitrary relative poses.
[0009] As a supplement or replacement to the above solution, in the above method, by calibrating the first interactive adapter in the coordinate system AE0 of the first interactive adapter with 5 degrees of freedom, the transformation matrix from the flange coordinate system of the industrial robot system to the coordinate system dAE0_5D of the first interactive adapter after calibrating with 5 degrees of freedom is obtained. Furthermore, by calibrating the second interactive adapter in the same five degrees of freedom within the second interactive adapter's coordinate system AE1, the transformation matrix from the flange coordinate system to the second interactive adapter's coordinate system dAE1_5D after the five-degree-of-freedom calibration is obtained.
[0010] As a supplement or replacement to the above scheme, in the above method, in the coordinate system dAE0_5D of the first interactive adapter after calibrating 5 degrees of freedom, or in the coordinate system dAE1_5D of the second interactive adapter after calibrating 5 degrees of freedom, calculating the first degree of freedom not included in the 5 degrees of freedom includes: using the following equations to calculate the rotation angle θ1 around the axis of the first interactive adapter and the rotation angle θ2 around the axis of the second interactive adapter respectively:
[0011]
[0012] in, R represents the transformation matrix from the coordinate system AE0 of the first interactive adapter to the coordinate system AE1 of the second interactive adapter. y (θ1) represents the rotation matrix obtained by rotating about the y-axis of the first interactive adapter, R y (θ2) represents the rotation matrix obtained by rotating about the y-axis of the second interactive adapter, and The matrix represents the transformation from the flange coordinate system of the industrial robot system to the coordinate system dAE1_6D of the second interactive adapter after calibration with 6 degrees of freedom.
[0013] As a supplement or replacement to the above scheme, in the above method, the calibration of the first interactive adapter in the coordinate system AE0 of the first interactive adapter with 5 degrees of freedom includes: calculating the offset of the coordinate system dAE0_2D of the first interactive adapter after calibration of 2 degrees of freedom in the flange coordinate system F-xyz of the industrial robot system. In the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_4D of the first interactive adapter after calibration of 4 degrees of freedom. And in the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom.
[0014] As a supplement or replacement to the above scheme, in the above method, the calibration of the second interactive adapter in the coordinate system AE1 of the second interactive adapter also includes: in the flange coordinate system F-xyz of the industrial robot system, calculating the offset of the coordinate system dAE1_2D of the second interactive adapter after calibration of 2 degrees of freedom. In the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_4D after calibration of 4 degrees of freedom. And in the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_5D after calibration with 5 degrees of freedom.
[0015] As a supplement or replacement to the above scheme, in the above method, photoelectric sensors are used to perform time-based calibration of the movement of the first interactive adapter and the second interactive adapter. The time-based calibration is achieved by converting the obtained digital signal into an operable time step, and then into the offset of the tool center point.
[0016] As a supplement or replacement to the above solution, in the above method, the actions of the industrial robot system when calibrating the first interaction adapter and the second interaction adapter with 5 degrees of freedom respectively satisfy the following equation:
[0017]
[0018] According to another aspect of the present invention, an apparatus for calibrating the tool center point of an industrial robot system is provided, characterized in that the apparatus comprises: a first calibration device for calibrating the first interactive adapter in a coordinate system AE0 of the first interactive adapter with 5 degrees of freedom; a second calibration device for calibrating the second interactive adapter in a coordinate system AE1 of the second interactive adapter with the same 5 degrees of freedom; and a calculation device for calculating a first degree of freedom not included in the 5 degrees of freedom in the coordinate system dAE0_5D of the first interactive adapter after calibrating 5 degrees of freedom or in the coordinate system dAE1_5D of the second interactive adapter after calibrating 5 degrees of freedom, thereby achieving calibration of the tool center point with 6 degrees of freedom, wherein the first degree of freedom is the angle of rotation about the axis of the first interactive adapter or the second interactive adapter, and the first interactive adapter and the second interactive adapter are mounted on the end effector of the industrial robot system.
[0019] As a supplement or replacement to the above solution, in the above device, the first interactive adapter and the second interactive adapter can have arbitrary relative poses.
[0020] As a supplement or replacement to the above solution, in the above equipment, the transformation matrix from the flange coordinate system of the industrial robot system to the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom is... The results are obtained by calibrating the first interactive adapter in the coordinate system AE0 of the first interactive adapter using the first calibration device, and the transformation matrix from the flange coordinate system to the coordinate system dAE1_5D of the second interactive adapter after the five-degree-of-freedom calibration. The calibration is obtained by using the second calibration device to calibrate the second interactive adapter in the same five degrees of freedom in the coordinate system AE1 of the second interactive adapter.
[0021] As a supplement or alternative to the above solution, in the above device, the computing device is configured to calculate the angle θ1 of rotation about the axis of the first interactive adapter and the angle θ2 of rotation about the axis of the second interactive adapter using the following equations:
[0022]
[0023] in, R represents the transformation matrix from the coordinate system AE0 of the first interactive adapter to the coordinate system AE1 of the second interactive adapter. y (θ1) represents the rotation matrix obtained by rotating about the y-axis of the first interactive adapter, R y (θ2) represents the rotation matrix obtained by rotating about the y-axis of the second interactive adapter, and The matrix represents the transformation from the flange coordinate system of the industrial robot system to the coordinate system dAE1_6D of the second interactive adapter after calibration with 6 degrees of freedom.
[0024] As a supplement or replacement to the above solution, in the above equipment, the first calibration device is configured to: calculate the offset of the coordinate system dAE0_2D of the first interactive adapter after calibration of two degrees of freedom in the flange coordinate system F-xyz of the industrial robot system. In the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_4D of the first interactive adapter after calibration of 4 degrees of freedom. And in the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom.
[0025] As a supplement or replacement to the above solution, in the above equipment, the second calibration device is configured to: calculate the offset of the coordinate system dAE1_2D of the second interactive adapter after calibration of two degrees of freedom in the flange coordinate system F-xyz of the industrial robot system. In the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_4D after calibration of 4 degrees of freedom. And in the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_5D after calibration with 5 degrees of freedom.
[0026] As a supplement or replacement to the above solution, in the above device, the first calibration device and the second calibration device respectively use photoelectric sensors to perform time-based calibration on the movement of the first interactive adapter and the second interactive adapter. The time-based calibration is achieved by converting the obtained digital signal into an operable time step, and then into the offset of the tool center point.
[0027] As a supplement or replacement to the above solution, in the above equipment, the actions of the industrial robot system when the first calibration device calibrates the first interactive adapter with 5 degrees of freedom and when the second calibration device calibrates the second interactive adapter with the same 5 degrees of freedom satisfy the following equation:
[0028]
[0029] According to another aspect of the present invention, a computer storage medium is provided, the medium including instructions that, when executed, perform the method described above.
[0030] According to another aspect of the present invention, an industrial robot system is provided, the industrial robot system comprising the device as described above.
[0031] By mounting two interactive adapters (which can have arbitrary relative poses) on the end effector, one or more embodiments of the present invention provide a six-degree-of-freedom tool center point TCP. A feasible calibration method, namely the 6D calibration algorithm, is proposed. This solution can be executed automatically and is suitable for automated production. Moreover, compared with existing computer vision solutions, one or more embodiments of this application have lower development and hardware costs and are easier to implement.
[0032] In addition, the 6-DOF TCP calibration process of one or more embodiments of this application can also be used to detect the correctness of the geometric parameters of the gripped part (e.g., the relationship between two cylindrical rods on the part). Attached Figure Description
[0033] The above and other objects and advantages of the present invention will become more fully clear from the following detailed description taken in conjunction with the accompanying drawings, wherein the same or similar elements are indicated by the same reference numerals.
[0034] Figure 1 A flowchart illustrating a method for calibrating the tool center point of an industrial robot system according to an embodiment of the present invention is shown.
[0035] Figure 2 A schematic diagram of a device for calibrating the tool center point of an industrial robot system according to an embodiment of the present invention is shown.
[0036] Figure 3 A schematic diagram illustrating a scenario of calibration of an industrial robot system according to an embodiment of the present invention is shown;
[0037] Figure 4 and Figure 5The diagrams show the coordinate system changes of an industrial robot system before and after the end effector of an industrial robot system deviates according to an embodiment of the present invention.
[0038] Figure 6 and Figure 7 This is a schematic diagram of a time-based calibration method according to an embodiment of the present invention;
[0039] Figure 8 A schematic diagram is shown of an end effector of an industrial robot system according to an embodiment of the present invention performing square motions at two different heights;
[0040] Figure 9 A geometrical schematic diagram illustrating the orientation change in the coordinate system of a photoelectric sensor according to an embodiment of the present invention is shown;
[0041] Figure 10 A schematic diagram of the coordinate systems of the end effector of an industrial robot system in a simplified scenario, according to an embodiment of the present invention, is shown; and
[0042] Figure 11 It shows in Figure 10 The diagram shows the position of the end effector before and after the offset in the embodiment. Detailed Implementation
[0043] To make the objectives, technical solutions, and advantages of the present invention clearer, specific embodiments of the present invention will be described in further detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it.
[0044] It should also be noted that, for ease of description, the accompanying drawings show only the parts relevant to the invention and not all of them. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as sequential processes, many of the operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but it may also have additional steps not included in the drawings. The process may correspond to a method, function, procedure, subroutine, subprogram, etc.
[0045] Although exemplary embodiments are described as using multiple units to perform exemplary processes, it should be understood that these exemplary processes may also be performed by one or more modules.
[0046] Furthermore, the control logic of the present invention can be included as executable program instructions on a computer-readable medium, which are implemented by a processor or the like. Examples of computer-readable media include, but are not limited to, ROM, RAM, optical discs, magnetic tapes, floppy disks, flash drives, smart cards, and optical data storage devices. The computer-readable recording medium can also be distributed across a networked computer system, enabling distributed storage and implementation of the computer-readable medium, for example, via in-vehicle telecommunications services or a Controller Area Network (CAN).
[0047] Unless specifically mentioned or obvious from the context, the term “approximately” as used herein shall be understood as being within the range of normal tolerances in the art, such as within 2 standard deviations of the mean.
[0048] In the following, a six-degree-of-freedom TCP calibration scheme for an industrial robot system according to various exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0049] Figure 1 A flowchart illustrating a method 1000 for calibrating the tool center point of an industrial robot system according to an embodiment of the present invention is shown. Figure 1 As shown, the method 1000 includes the following steps:
[0050] In step S110, the first interactive adapter is subjected to 5 degrees of freedom in the coordinate system AE0 of the first interactive adapter. The calibration; the second interaction adapter is subjected to the same 5 degrees of freedom in the coordinate system AE1 of the second interaction adapter. The calibration; and in the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom, or in the coordinate system dAE1_5D of the second interactive adapter after calibration of 5 degrees of freedom, the first degree of freedom (θ) not included in the 5 degrees of freedom is calculated, thereby realizing 6 degrees of freedom of the tool center point. The calibration, wherein the first degree of freedom (θ) is the angle of rotation about the axis of the first or second interactive adapter, and the first and second interactive adapters are mounted on the end effector of the industrial robot system.
[0051] In the context of this invention, the term "5D calibration" or "calibration of 5 degrees of freedom" refers to obtaining the calibration in the endpoint coordinate system of the interactive adapter. The deviations are then converted to the flange coordinate system. Since rotation along the y-axis of the interface adapter endpoint coordinate system (i.e., the axial direction of the interface adapter) has no effect on the 5D calibration process, θ cannot be obtained through 5D calibration alone.
[0052] The term "6D calibration" or "calibration with 6 degrees of freedom" refers to obtaining the coordinates of the endpoints of the interaction adapter. The deviations are then converted to the flange coordinate system. It should be noted that... These are the rotation angles about the z-axis, y-axis, and x-axis, respectively. In one or more embodiments, the rotational relationship between the two coordinate systems can be represented using roll angle, pitch angle, and yaw angle.
[0053] Furthermore, in the context of this invention, the symbol "F-xyz" or "F" represents the flange coordinate system. The symbol "AE0-xyz" or "AE0" represents the endpoint coordinate system of the first interactive adapter that has not shifted. The symbol "AE1-xyz" or "AE1" represents the endpoint coordinate system of the second interactive adapter that has not shifted.
[0054] The symbol “dAE0_2D-xyz” or “dAE0_2D” indicates that the time interval is 10 ... The calibrated coordinate system of the endpoint of the first interactive adapter that experienced offset. The symbol "dAE0_4D-xyz" or "dAE0_4D" indicates the coordinate system after calibration. The endpoint coordinate system of the first interactive adapter that has experienced offset after calibration. The symbol "dAE0_5D-xyz" or "dAE0_5D" represents the endpoint coordinate system of the first interactive adapter that has experienced offset after calibration with 5 degrees of freedom. The symbol "dAE0_6D-xyz" or "dAE0_6D" represents the endpoint coordinate system of the first interactive adapter that has experienced offset after calibration with 6 degrees of freedom.
[0055] Similarly, the symbols “dAE1_5D-xyz” or “dAE1_5D” represent the endpoint coordinate system of the second interactive adapter that has shifted after being calibrated with 5 degrees of freedom. The symbols “dAE1_6D-xyz” or “dAE1_6D” represent the endpoint coordinate system of the second interactive adapter that has shifted after being calibrated with 6 degrees of freedom.
[0056] The symbol "RB-xyz" or "RB" represents the base coordinate system of the industrial robot (system). The symbol "PS-xyz" or "PS" represents the photoelectric sensor coordinate system. In one or more embodiments of the present invention, the pose of the PS-xyz system is known.
[0057] See Figure 3 It illustrates a scenario of calibration of an industrial robot system according to an embodiment of the present invention. Figure 3 As shown, the industrial robot system includes a robotic arm 310, a first interaction adapter 322 mounted on an end effector, and a second interaction adapter 324. In one or more embodiments, the industrial robot system may further include a photoelectric sensor 330 for calibrating the industrial robot.
[0058] Figure 4 and Figure 5 Schematic diagrams illustrating the coordinate system changes of an industrial robot system before and after the end effector of an offset occurs, according to an embodiment of the present invention. Figure 4 As shown, the coordinate system 410 of the flange, the coordinate system 420 of the endpoint of the first interactive adapter that has not shifted, and the coordinate system 430 of the endpoint of the second interactive adapter that has not shifted are indicated. Figure 5 As shown, the coordinate system includes the flange coordinate system 510, the endpoint coordinate system 522 of the first interactive adapter after 5-DOF calibration, the endpoint coordinate system 524 of the first interactive adapter after 6-DOF calibration, the endpoint coordinate system 532 of the second interactive adapter after 5-DOF calibration, and the endpoint coordinate system 534 of the second interactive adapter after 6-DOF calibration. It is understood that θ cannot be obtained from dAE0_5D-xyz or dAE1_5D-xyz after 5D calibration. Only after 6D calibration can all poses in dAE0_6D-xyz be fully calibrated.
[0059] In one or more embodiments, the z-axis of PS-xyz is parallel to the y-axis of AE0-xyz, therefore 5D calibration is performed in AE0-xyz. Or, in PS-xyz, (x, y, z, ...)
[0060] In one or more embodiments of the method 1000 described above, the first interaction adapter and the second interaction adapter can have arbitrary relative poses. That is, by utilizing two interaction adapters with arbitrary relative poses mounted on the end effector, the six degrees of freedom of TCP can be realized. Calibration scheme. This calibration method is relatively simple to implement and avoids manual intervention in the calibration process, making it suitable for automated production.
[0061] In one or more embodiments, by calibrating the first interactive adapter in its coordinate system AE0 with five degrees of freedom, a transformation matrix is obtained from the flange coordinate system of the industrial robot system to the coordinate system dAE0_5D of the first interactive adapter after five-degree-of-freedom calibration. Furthermore, by calibrating the second interactive adapter in the same five degrees of freedom within the second interactive adapter's coordinate system AE1, the transformation matrix from the flange coordinate system to the second interactive adapter's coordinate system dAE1_5D after the five-degree-of-freedom calibration is obtained.
[0062] It should be noted that, in the context of this invention, the symbols... This represents the coordinate system transformation matrix from coordinate system A to coordinate system B. For example, the symbol... This represents the coordinate system transformation matrix from AE0-xyz to dAE0_5D-xyz. Generally speaking, It has 6 independent variables
[0063] symbol This represents the coordinate system rotation matrix from coordinate system A to coordinate system B. For example, the symbol... This represents the coordinate system rotation matrix from AE0-xyz to dAE0_5D-xyz. Generally speaking, It has three independent variables
[0064] symbol This represents the coordinate system translation matrix from coordinate system A to coordinate system B. For example, the symbol... This represents the coordinate system translation vector from AE0-xyz to dAE0_5D-xyz. Generally speaking, It has three independent variables (x, y, z).
[0065] In addition, symbols “R y (θ)” and “R” z (ψ)” represents the rotation matrix generated by rotating around the x-axis, y-axis and z-axis respectively.
[0066] In one embodiment, step S110 includes: calculating the offset of the coordinate system dAE0_2D of the first interactive adapter after two degrees of freedom calibration in the flange coordinate system F-xyz of the industrial robot system. In the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_4D of the first interactive adapter after calibration of 4 degrees of freedom. And in the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom.
[0067] Specifically, in one embodiment, 5D calibration is performed on the endpoints of the first interactive adapter to obtain... It may include:
[0068] (1) Calculation
[0069] First, based on The industrial robot performs two square movements at a constant speed at different heights. (See also...) Figure 8 In this process, the endpoints of the interactive adapter 810 undergo two square movements 820 and 840 at different heights, and the center points of the two square movements are connected to form a line 830.
[0070] In other words, the first interactive adapter is positioned perpendicular to the XOY plane of the PS-xyz plane and moves accordingly. This is achieved using sensors (e.g.,...). Figure 3 The photoelectric sensor shown records the time of sensor triggering. Next, a time-based calibration method is used to obtain the deviation of the first interactive adapter endpoint in PS-xyz. Then, since the deviation of the two motion centers, the sensor position, and the height difference between the two motions are known, the actual posture of the first interactive adapter (ψ in the endpoint coordinate system of the first interactive adapter) can be calculated. ),Right now
[0071] In one or more embodiments of the present invention, the "time-based calibration method" refers to a calibration method that converts the obtained digital signal into an operable time step, and then into an offset of the tool center point. (See reference...) Figure 6 The interaction adapter can be divided into three stages by the sensor light (e.g., radium): before the interaction adapter 62 touches the sensor light 64, the interaction adapter is in position 1_1 (i.e., stage 610); the interaction adapter 62 blocks the sensor light 64, the interaction adapter is in position 1 (i.e., stage 620); and after the interaction adapter 62 passes through the sensor light 64, the interaction adapter is in position 1_2 (i.e., stage 630).
[0072] In the time-based calibration method, the time for the interactive adapter to block the sensor light is the time for recording the digital signal. This time is denoted as Δt1. Timing continues after the interactive adapter passes through the sensor light until the next sensor digital signal is received. See also... Figure 7 Let 2_1 be the position where the touch sensor light of the interactive adapter 720 touches the y-axis 760 and the sensor begins to output a digital signal. The time between the two digital signals is Δt. 1_2-2_1 Repeating this timing operation will yield Δt1 and Δt in sequence. 1_2-2_1 , Δt2, Δt 2_2-3_1 , Δt3, Δt 3_2-4_1 , Δt4.
[0073] It should be noted that, in Figure 7 In the diagram, 750 represents the x-axis of the sensor ray, 760 represents the y-axis of the sensor ray, 740 is the center point of the sensor ray, and the interactive adapter 720 moves along the trajectory 710, the center point of which is 730.
[0074] Additionally, in the context of this invention, the symbol "Δt" i "Δt" represents the time taken to travel through position i, i.e., the time of the digital signal. i_2-j_1 "Δt" represents the time from position i, where the interactive adapter just leaves the sensor light source, to position j, where the interactive adapter just touches / contacts the sensor light source. i-j " represents the time from center position i to center position j. If the robot moves at a constant speed, then Δt..." i-j =Δt i_2-j_1 +1 / 2(Δt i +Δt j ).
[0075] Furthermore, the symbol Δx represents the offset from the center of motion to the sensor along the y-axis, and the symbol Δy represents the offset from the center of motion to the sensor along the x-axis. See, for example... Figure 7 Δx is the offset from the motion center 730 to the y-axis 760 of the sensor, and Δy is the offset from the motion center 730 to the x-axis 750 of the sensor.
[0076] symbol Δx up This represents the offset from the first center of motion to the sensor's y-axis, denoted by Δy. up This represents the offset from the first center of motion to the sensor's x-axis, denoted by Δx. down This represents the offset from the second center of motion to the sensor's y-axis, denoted by Δy. down This indicates the offset from the second center of motion to the x-axis.
[0077] In one embodiment, by making the robot move at a constant speed in the PS, the time it takes for the interactive adapter to move from the center of one sensor ray to the center of another sensor ray can be easily obtained, wherein:
[0078] Δt 1-2 =Δt 1_2-2_1 +1 / 2(Δt1+Δt2);
[0079] Δt 2-3 =Δt 2_2-3_1 +1 / 2(Δt2+Δt3);
[0080] Δt 3-4 =Δt 3_2-4_1 +1 / 2(Δt3+Δt4).
[0081] If the trajectory of motion is known, the time offset of the center of motion can be calculated based on these equations. Clearly, this time-based calibration method is applicable to different trajectories, including but not limited to circular motion, square motion, and square motion with rounded corners.
[0082] In one embodiment, when the robot is moving at a constant speed (v), Δt is taken into account the possible acceleration and deceleration processes at corners. i-j and Δt j-k The difference between them is described as the basis of the calculation, as shown in the equation below:
[0083] Δx=v*(Δt 1-2 -Δt 2-3 );
[0084] Δy=v*(Δt 2-3 -Δt 3-4 ).
[0085] In one embodiment, calculation This may include: i) obtaining (Δx) using a time-based calibration method. up Δy up ) and (Δx down Δy down ) ;ii) Calculate dAE0_2D-xyz in PS-xyz It corresponds to AE0-xyz Where the z-axis of PS-xyz is parallel to the y-axis of AE0-xyz; iii) Calculated It is the z-axis of dAE0_2D-xyz. Let AE0-xyz be the y-axis, by... and Overlapping can be solved by using the axis-angle method to obtain the rotation matrix. The offset of dAE0_2D-xyz in F-xyz can be calculated as follows:
[0086]
[0087] In step ii) above, refer to Figure 9 In one embodiment, The calculation can be performed using the following formula:
[0088] If (Δx) up -Δx down )*(Δy up -Δy down )>=0,
[0089] Then: α=-atan2(Δy) up -Δy down ,Δz); β=atan2(Δx) up -Δx down , Δz)
[0090] Otherwise, α = atan2(Δy) up-Δy down ,Δz); β=-atan2(Δx) up -Δx down ,Δz).
[0091] Based on this, the Euler angle ψ = atan2(cos(β)tan(α), 1), and
[0092] In the above formula, the atan2 function returns the azimuth angle from the origin to the point (x, y). A positive result indicates the angle of counterclockwise rotation from the X-axis, and a negative result indicates the angle of clockwise rotation from the X-axis.
[0093] (2) Based on The robot again performs a square motion at a constant speed. The offset of the first interactive adapter endpoint in the PS-xyz region is obtained using the previously described "time-based calibration method". Then, based on the sensor positions, the x and y offsets of the first interactive adapter endpoint in the PS-xyz region can be calculated, i.e.
[0094] In one embodiment, a time-based calibration method is used to obtain (Δx, Δy), and then ΔP is... PS = (Δx, Δy, 0, 1) represents the offset in PS-xyz, then the offset of dAE0_4D-xyz in F-xyz can be obtained, that is:
[0095] (3) Based on The robot moves to find the position where the sensor was just triggered or performs linear motion to obtain the z offset in PS-xyz. ΔP PS = (0, 0, Δz, 1) represents the offset in PS-xyz, and the offset of dAE0_5D-xyz in F-xyz can be obtained as shown in the following formula:
[0096]
[0097] The above outlines the entire process of 5D calibration. Here, R not included in dAE1_5D-xyz y (θ).
[0098] In one embodiment, step S120 may include: calculating the offset of the coordinate system dAE1_2D of the second interactive adapter after two degrees of freedom calibration in the flange coordinate system F-xyz of the industrial robot system. In the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_4D after calibration of 4 degrees of freedom. And in the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_5D after calibration with 5 degrees of freedom.
[0099] In one embodiment, step S120 includes updating AE1-xyz and ensuring that the actions of the industrial robot system during the calibration of the first and second interaction adapters with 5 degrees of freedom satisfy the following equation:
[0100]
[0101] In one embodiment, step S130 includes: calculating θ1 in dAE0_5D-xyz and calculating θ2 in dAE1_5D-xyz. Specifically, to obtain 6D calibration values, the dAE0_5D-xyz of the industrial robot system can be rotated along the y-axis of dAE0_5D-xyz, and the dAE1_5D-xyz can be rotated along the y-axis of dAE1_5D-xyz, wherein... It is a constant matrix, and
[0102]
[0103] In the matrix equation shown as well as It was obtained through 5D calibration and is accurate. The relative positions of the endpoints of the two interaction adapters are used to determine the 6 degrees of freedom. If two fixed interaction adapters (e.g., pins) are used to calibrate the 6 degrees of freedom, then... It can be considered highly accurate. If a part with two interactive adapter endpoints is used directly to calibrate the six degrees of freedom, then... The accuracy will be determined by the geometric parameters of the part. Its accuracy is closely related to the part's accuracy. In this case, 6D calibration can not only be used to obtain the pose of the gripper or part, but also to test whether the part's geometric parameters meet the standards.
[0104] exist In the exact case, there are only two unknown variables, θ1 and θ2, in the matrix equations or formulas above. Typically, there are 12 meaningful equations (the first three rows of the matrix) above (*). Based on these 12 meaningful equations, the best estimate can be calculated using the least squares method or other mathematical methods. and Then you can get the 6 degrees of freedom of the end effector (such as a gripper).
[0105] In another embodiment, in In the case of unknown variables, the above (*) contains unknown variables θ1 and θ2, and There are 6 unknown variables. Similarly, there are 12 meaningful equations above (*). Based on these 12 meaningful equations, the best estimate can be calculated using the least squares method or other mathematical methods. and as well as The 6 degrees of freedom (from AE0-xyz to AE1-xyz) ). and It can be used to obtain 6D calibration results for parts. The optimal estimates of the six degrees of freedom can be used to test the geometric parameters of the part.
[0106] In a simplified scenario, see, for example Figure 10 , Only translation terms, i.e. The 6D calibration process is then simplified. Since the pose of AE1-xyz is exactly the same as that of AE0-xyz, there is no need to perform the entire 5D calibration on AE1-xyz. Furthermore, θ1 = θ2 in the matrix equation (*). The complete 6D calibration process for this situation is as follows:
[0107] 1) Step 1: Perform 5D calibration on dAE0_5D-xyz. After 5D calibration, the following results are obtained:
[0108] 2) Step 2: Update AE1-xyz and make the robot... Perform a movement, and make a square motion to obtain a translation from dAE1_5D-xyz to F-xyz, that is...
[0109] 3) Step 3: Calculate θ in dAE0_5D-xyz.
[0110] In step 3, the industrial robot system's dAE0_5D-xyz can be rotated along the y-axis of dAE0_5D-xyz, and dAE1_5D-xyz can be rotated along the y-axis of dAE1_5D-xyz, and then the same matrix equation (*) as described above can be obtained, thereby obtaining the 6D calibration result.
[0111] because Therefore, the matrix equation (*) will become:
[0112]
[0113] In this matrix equation, only the translation terms are useful. Therefore,
[0114] Continue to refer to Figure 11 The end effector before the offset is shown as 1110, while the end effector after the offset is shown as 1120. Expressed as the offset from dAE1_5D-xyz to dAE0_5D-xyz in F-xyz. Described as the offset from dAE1_5D_xyz to dAE0_5D_xyz in AE0_xyz. Let It represents the translation vector from AE1-xyz to AE0-xyz in AE0-xyz, then:
[0115]
[0116] In the above formula, only θ is an unknown variable. The second equation can be used to determine whether the calibration results are reasonable and accurate. Using the least squares method, based on the first and third equations, the final result can be obtained, as shown in the following formula:
[0117]
[0118] One or more embodiments of the present invention provide a method for calibrating the tool center point (TCP) of an industrial robot system by mounting two interactive adapters (which may have arbitrary relative poses) on the end effector, thus providing a six-degree-of-freedom tool center point TCP. A feasible calibration method. Compared with existing 5D and 6D calibration methods, the method proposed in this invention is a more general and widely applicable technical solution for calculating the offset 6D TCP.
[0119] Furthermore, those skilled in the art will readily understand that the method for calibrating the tool center point of an industrial robot system provided in one or more embodiments of the present invention can be implemented by a computer program. For example, when a computer storage medium (e.g., a USB flash drive) containing the computer program is connected to a computer, running the computer program will execute the method for calibrating the tool center point of an industrial robot system according to one or more embodiments of the present invention.
[0120] refer to Figure 2 , Figure 2 A schematic diagram of a device 2000 for calibrating the tool center point of an industrial robot system according to an embodiment of the present invention is shown. Figure 2As shown, the device 2000 includes a first calibration device 210, a second calibration device 220, and a computing device 230. The first calibration device 210 calibrates the first interactive adapter in its coordinate system AE0 with five degrees of freedom. The second calibration device 220 calibrates the second interactive adapter in its coordinate system AE1 with the same five degrees of freedom. The computing device 230 calculates the first degree of freedom not included in the five degrees of freedom in either the first interactive adapter's coordinate system dAE0_5D after five-degree-of-freedom calibration or the second interactive adapter's coordinate system dAE1_5D after five-degree-of-freedom calibration, thereby achieving six degrees of freedom calibration for the tool's center point. The first degree of freedom is the angle of rotation around the axis of the first or second interactive adapter, and the first and second interactive adapters are mounted on the end effector of the industrial robot system.
[0121] In the aforementioned device 2000, the first interactive adapter and the second interactive adapter may have arbitrary relative poses.
[0122] In one embodiment, the transformation matrix from the flange coordinate system of the industrial robot system to the coordinate system dAE0_5D of the first interactive adapter after 5-DOF calibration is... The results are obtained by calibrating the first interactive adapter in the coordinate system AE0 of the first interactive adapter using the first calibration device 210, which calibrates the first interactive adapter in five degrees of freedom, and the transformation matrix from the flange coordinate system to the coordinate system dAE1_5D of the second interactive adapter after the five degrees of freedom calibration. The calibration is obtained by using the second calibration device 220 to calibrate the second interactive adapter in the same five degrees of freedom in the coordinate system AE1 of the second interactive adapter.
[0123] In one embodiment, the computing device 230 is configured to calculate, using the following equations, the angle θ1 of rotation about the axis of the first interactive adapter and the angle θ2 of rotation about the axis of the second interactive adapter:
[0124]
[0125] in, R represents the transformation matrix from the coordinate system AE0 of the first interactive adapter to the coordinate system AE1 of the second interactive adapter. y (θ1) represents the rotation matrix obtained by rotating about the y-axis of the first interactive adapter, R y (θ2) represents the rotation matrix obtained by rotating about the y-axis of the second interactive adapter, and The matrix represents the transformation from the flange coordinate system of the industrial robot system to the coordinate system dAE1_6D of the second interactive adapter after calibration with 6 degrees of freedom.
[0126] In one embodiment, the first calibration device 210 is configured to: calculate the offset of the coordinate system dAE0_2D of the first interactive adapter after calibration of two degrees of freedom in the flange coordinate system F-xyz of the industrial robot system. In the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_4D of the first interactive adapter after calibration of 4 degrees of freedom. And in the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom.
[0127] In one embodiment, the second calibration device 220 is configured to: calculate the offset of the coordinate system dAE1_2D of the second interactive adapter after calibration of two degrees of freedom in the flange coordinate system F-xyz of the industrial robot system. In the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_4D after calibration of 4 degrees of freedom. And in the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_5D after calibration with 5 degrees of freedom.
[0128] In one embodiment, the first calibration device 210 and the second calibration device 220 respectively use photoelectric sensors to perform time-based calibration of the movement of the first interactive adapter and the second interactive adapter. The time-based calibration is achieved by converting the obtained digital signal into an operable time step, and then into the offset of the tool center point.
[0129] In one embodiment, the actions of the industrial robot system when the first calibration device 210 calibrates the first interactive adapter with 5 degrees of freedom and when the second calibration device 220 calibrates the second interactive adapter with the same 5 degrees of freedom satisfy the following equation:
[0130]
[0131] In summary, the 6D TCP calibration scheme of this invention, by installing two interactive adapters (which can have arbitrary relative poses) on the end effector, provides six degrees of freedom for the tool center point TCP. The feasible calibration method is the 6D calibration algorithm. This scheme can be executed automatically and is suitable for automated production. Moreover, compared with existing computer vision schemes, the solution of this invention has lower development and hardware costs and is easier to implement. In addition, the above-mentioned 6DOF TCP calibration process can also be used to detect the correctness of the geometric parameters of the grasped parts (e.g., the relationship between two cylindrical rods on the part).
[0132] Although the foregoing specification describes only some embodiments of the invention, those skilled in the art will understand that the invention can be implemented in many other forms without departing from its spirit and scope. Therefore, the examples and embodiments shown are to be considered illustrative rather than restrictive, and the invention may encompass various modifications and substitutions without departing from the spirit and scope of the invention as defined in the appended claims.
Claims
1. A method for calibrating the tool center point of an industrial robot system, characterized in that, The method includes: The first interactive adapter is calibrated in 5 degrees of freedom in the coordinate system AE0 of the first interactive adapter; In the coordinate system AE1 of the second interaction adapter, the same five degrees of freedom are calibrated for the second interaction adapter; and In the coordinate system dAE0_5D of the first interactive adapter after calibrating 5 degrees of freedom, or in the coordinate system dAE1_5D of the second interactive adapter after calibrating 5 degrees of freedom, the first degree of freedom not included in the aforementioned 5 degrees of freedom is calculated, thereby achieving the calibration of the 6 degrees of freedom of the tool's center point. Wherein, the first degree of freedom is the angle of rotation about the axis of the first interactive adapter or the second interactive adapter, and the first interactive adapter and the second interactive adapter are both mounted on the same end effector of the industrial robot system.
2. The method as described in claim 1, wherein, By calibrating the first interactive adapter in its coordinate system AE0 with five degrees of freedom, the transformation matrix from the flange coordinate system of the industrial robot system to the coordinate system dAE0_5D of the first interactive adapter after five-degree-of-freedom calibration is obtained. Furthermore, by calibrating the second interactive adapter in the same five degrees of freedom within the second interactive adapter's coordinate system AE1, the transformation matrix from the flange coordinate system to the second interactive adapter's coordinate system dAE1_5D after the five-degree-of-freedom calibration is obtained. .
3. The method of claim 2, wherein, In the coordinate system dAE0_5D of the first interactive adapter after calibrating 5 degrees of freedom, or in the coordinate system dAE1_5D of the second interactive adapter after calibrating 5 degrees of freedom, the calculation of the first degree of freedom not included in the aforementioned 5 degrees of freedom includes: The following equations are used to calculate the angles of rotation φ1 around the axis of the first interactive adapter and φ2 around the axis of the second interactive adapter, respectively: in, The transformation matrix represents the transformation from the coordinate system AE0 of the first interactive adapter to the coordinate system AE1 of the second interactive adapter. This represents the rotation matrix obtained by rotating about the y-axis of the first interactive adapter. The rotation matrix represents the rotation obtained by rotating about the y-axis of the second interactive adapter, and The matrix represents the transformation from the flange coordinate system of the industrial robot system to the coordinate system dAE1_6D of the second interactive adapter after calibration with 6 degrees of freedom.
4. The method of claim 1, wherein, The calibration of the first interactive adapter in the coordinate system AE0, including five degrees of freedom, includes: In the flange coordinate system F-xyz of the industrial robot system, calculate the offset of the coordinate system dAE0_2D of the first interactive adapter after calibration of two degrees of freedom. ; In the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_4D of the first interactive adapter after calibration of 4 degrees of freedom. ;as well as In the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom. .
5. The method of claim 1, wherein, In the coordinate system AE1 of the second interaction adapter, the same five degrees of freedom are calibrated for the second interaction adapter, including: In the flange coordinate system F-xyz of the industrial robot system, calculate the offset of the coordinate system dAE1_2D of the second interactive adapter after calibration of two degrees of freedom. ; In the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_4D after calibration of 4 degrees of freedom. ;as well as In the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_5D after calibration with 5 degrees of freedom. .
6. The method of claim 1, wherein, The motion of the first and second interactive adapters is calibrated in a time-based manner using photoelectric sensors. The time-based calibration is achieved by converting the obtained digital signals into operable time steps, and then into the offset of the tool center point.
7. The method of claim 1, wherein, The industrial robot system's actions when calibrating the first and second interaction adapters with 5 degrees of freedom respectively satisfy the following equation: 。 8. A device for calibrating the tool center point of an industrial robot system, characterized in that, The device includes: The first calibration device is used to calibrate the first interactive adapter in five degrees of freedom in the coordinate system AE0 of the first interactive adapter. The second calibration device is used to calibrate the second interactive adapter in the same five degrees of freedom within the coordinate system AE1 of the second interactive adapter; and The computing device is used to calculate the first degree of freedom not included in the five degrees of freedom in the coordinate system dAE0_5D of the first interactive adapter after five-degree-of-freedom calibration, or in the coordinate system dAE1_5D of the second interactive adapter after five-degree-of-freedom calibration, thereby achieving the calibration of the six degrees of freedom of the tool's center point. Wherein, the first degree of freedom is the angle of rotation about the axis of the first interactive adapter or the second interactive adapter, and the first interactive adapter and the second interactive adapter are both mounted on the same end effector of the industrial robot system.
9. The device as claimed in claim 8, wherein, The transformation matrix from the flange coordinate system of the industrial robot system to the coordinate system dAE0_5D of the first interactive adapter after calibration with 5 degrees of freedom. The results are obtained by calibrating the first interactive adapter in the coordinate system AE0 of the first interactive adapter using the first calibration device, and the transformation matrix from the flange coordinate system to the coordinate system dAE1_5D of the second interactive adapter after the five-degree-of-freedom calibration. The calibration is obtained by using the second calibration device to calibrate the second interactive adapter in the same five degrees of freedom in the coordinate system AE1 of the second interactive adapter.
10. The device as claimed in claim 9, wherein, The computing device is configured to calculate, using the following equations, the angles of rotation φ1 about the axis of the first interactive adapter and φ2 about the axis of the second interactive adapter: in, The transformation matrix represents the transformation from the coordinate system AE0 of the first interactive adapter to the coordinate system AE1 of the second interactive adapter. This represents the rotation matrix obtained by rotating about the y-axis of the first interactive adapter. The rotation matrix represents the rotation obtained by rotating about the y-axis of the second interactive adapter, and The matrix represents the transformation from the flange coordinate system of the industrial robot system to the coordinate system dAE1_6D of the second interactive adapter after calibration with 6 degrees of freedom.
11. The device as claimed in claim 8, wherein, The first calibration device is configured as follows: In the flange coordinate system F-xyz of the industrial robot system, calculate the offset of the coordinate system dAE0_2D of the first interactive adapter after calibration of two degrees of freedom. ; In the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_4D of the first interactive adapter after calibration of 4 degrees of freedom. ;as well as In the flange coordinate system F-xyz, calculate the offset of the coordinate system dAE0_5D of the first interactive adapter after calibration of 5 degrees of freedom. .
12. The device as claimed in claim 8, wherein, The second calibration device is configured as follows: In the flange coordinate system F-xyz of the industrial robot system, calculate the offset of the coordinate system dAE1_2D of the second interactive adapter after calibration of two degrees of freedom. ; In the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_4D after calibration of 4 degrees of freedom. ;as well as In the flange coordinate system F-xyz, calculate the offset of the second interactive adapter's coordinate system dAE1_5D after calibration with 5 degrees of freedom. .
13. The device as claimed in claim 8, wherein, The first calibration device and the second calibration device respectively use photoelectric sensors to perform time-based calibration of the movement of the first interactive adapter and the second interactive adapter. The time-based calibration is achieved by converting the obtained digital signal into an operable time step, and then into the offset of the tool center point.
14. The device as claimed in claim 8, wherein, The actions of the industrial robot system when the first calibration device calibrates the first interactive adapter with 5 degrees of freedom and when the second calibration device calibrates the second interactive adapter with the same 5 degrees of freedom satisfy the following equation: 。 15. A computer storage medium, characterized in that, The medium includes instructions that, when executed, perform the method as described in any one of claims 1 to 7.
16. An industrial robot system, the industrial robot system comprising the device as claimed in any one of claims 8 to 14.
Citation Information
Patent Citations
Robot tool central point calibration method using two-dimensional measurement functional tablet
CN104457645A
Method and device for controlling robot
US20050125100A1
