Robot system

By generating a workpiece removal path using 3D sensors and control devices, the problem of difficulty in judging interference between workpieces in the robot system is solved, and interference-free removal of workpieces is achieved, reducing computational load and the impact of data noise.

CN118900752APending Publication Date: 2024-11-05FANUC LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202280093905.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-03-31
Publication Date
2024-11-05

AI Technical Summary

Technical Problem

In the prior art, when a robot system removes a workpiece, it cannot correctly determine whether there is interference between the workpieces, especially when the front end of the workpiece is inserted into the opening of another workpiece, making it difficult to prevent interference between the workpiece and the hand.

Method used

The surface shape of the workpiece is measured by a three-dimensional sensor, and the extraction path is generated by a control device. The model storage, workpiece detection, model configuration and path setting modules are used to avoid interference between the workpiece and other workpieces or obstacles.

Benefits of technology

It effectively prevents interference between the workpiece and the hand or other obstacles, ensuring the smooth removal of the workpiece and reducing the impact of computational load and data noise.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118900752A_ABST
    Figure CN118900752A_ABST
Patent Text Reader

Abstract

A robot system according to one embodiment of the present disclosure includes: a model storage unit that stores a workpiece model; a workpiece detection unit that detects the position and orientation of the workpiece by comparing the characteristics of the surface shape measured by the three-dimensional sensor with the characteristics of the workpiece model; a workpiece model arrangement unit that arranges the workpiece model in the virtual space; and a path setting unit that sets an extraction path in the virtual space such that the workpiece model to be extracted moves and withdraws so as not to interfere with other workpiece models.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a robot system. Background Art

[0002] Robot systems are widely used that obtain surface shape information of the object such as range images and point group data, and use matching processing to determine the position and posture of the workpiece, thereby performing robot-based workpiece removal. There are also cases where workpieces must be removed one by one from a plurality of workpieces arranged randomly and overlappingly, starting from the workpiece arranged on the uppermost side.

[0003] When a workpiece is taken out by a robot, the posture of the robot must be determined in such a way that other workpieces, containers for accommodating the workpieces, etc. do not interfere with the robot's hand. An information processing device has also been proposed, which includes: a receiving unit that receives a distance image of an object; a recognition unit that recognizes an identification object (workpiece) in the distance image; a conversion unit that converts information of a predetermined surface of a related object (hand) related to the identification object into information on the distance image; and an output unit that outputs an evaluation result based on the converted information, and the information processing device performs overlap judgment on the identification object and the related object, etc. (see Patent Document 1).

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2019-116294 Summary of the invention

[0007] Problems to be solved by the invention

[0008] In the device described in Patent Document 1, although the presence or absence of interference is confirmed using a distance image representing the surface shape of a workpiece or a hand, in the case where, for example, the front end of a workpiece is inserted into the opening of another workpiece, it is not possible to correctly determine the presence or absence of interference between the workpieces based only on the front-to-back relationship of the distance image. Therefore, a technology is desired that can more effectively prevent interference between the workpiece as a target and the hand holding the workpiece and obstacles such as other workpieces when removing the workpiece, even if the shape or configuration of the workpiece is complex.

[0009] Means for solving problems

[0010] A robot system of one embodiment of the present invention comprises: a robot; a three-dimensional sensor that measures the surface shape of an object area where a workpiece can exist; a control device that generates a removal path for removing at least one of the workpieces by the robot based on the surface shape measured by the three-dimensional sensor, and the control device has: a model storage unit that stores a workpiece model that models the three-dimensional shape of the workpiece; a workpiece detection unit that detects the position and posture of the workpiece by comparing the characteristics of the surface shape measured by the three-dimensional sensor with the characteristics of the workpiece model; a workpiece model configuration unit that configures the workpiece model in a virtual space to the position and posture of the workpiece detected by the workpiece detection unit; and a path setting unit that moves one of the workpiece models in the virtual space in a manner that does not interfere with other workpiece models and sets the removal path.

[0011] Effects of the Invention

[0012] According to the present disclosure, when taking out a workpiece, interference between a target workpiece and a hand holding the workpiece and obstacles such as other workpieces can be prevented. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 It is a schematic diagram showing the configuration of a robot system according to a first embodiment of the present disclosure.

[0014] Figure 2 This is a schematic diagram showing the same workpiece removal as in the conventional method.

[0015] Figure 3 It means by Figure 1 Schematic diagram of workpiece removal performed by a robot system. DETAILED DESCRIPTION

[0016] Below, while referring to the attached Figure 1 Embodiments of the present disclosure will be described. Figure 1 1 is a schematic diagram showing the structure of a robot system 1 according to a first embodiment of the present disclosure. The robot system 1 takes out at least one of the randomly arranged workpieces W (hereinafter, a number is added to the end of the reference numeral when it is necessary to distinguish the workpieces). That is, the robot system 1 takes out one of the multiple workpieces W.

[0017] The robot system 1 includes: a robot 10; a hand 20, which is mounted on the front end of the robot 10 and can hold a workpiece W; a three-dimensional sensor 30, which measures the surface shape of a target area where the workpiece W can exist; and a control device 40, which generates an operation program of the robot 10 based on the surface shape measured by the three-dimensional sensor 30. In the example shown in the figure, the plurality of workpieces W1, W2, and W3 are short tubular components of the same shape having a flange at one end.

[0018] The robot 10 determines the position and posture of the hand 20, that is, the coordinates of the reference point of the hand 20 and the direction of the hand 20. Figure 1 Although a vertical articulated robot is used as an example, the present invention is not limited thereto, and may be, for example, an orthogonal coordinate robot, a horizontal articulated robot, a parallel robot, or the like.

[0019] The hand 20 only needs to be able to hold the workpiece W. In the illustrated example, the hand 20 has a pair of finger-shaped members 21 that engage with the workpiece W by gripping the workpiece W from the outside or inserting into the inside of the workpiece W and extending toward the outside. However, the present invention is not limited thereto, and the hand 20 may also have other holding mechanisms such as a vacuum pad that sucks the workpiece W.

[0020] The three-dimensional sensor 30 measures the distance of the surface of the object (three workpieces W1, W2, W3 and the tray-shaped container C on which the workpieces W1, W2, W3 are placed) existing in the field of view of the three-dimensional sensor 30 at each position in the plane direction perpendicular to the field of view center axis of the three-dimensional sensor 30. That is, the three-dimensional sensor 30 obtains surface shape information such as the distance image and point group data of the measurement object, which can create a three-dimensional image of the object.

[0021] The three-dimensional sensor 30 may be configured to include two two-dimensional cameras 31 and 32, wherein the two-dimensional cameras 31 and 32 capture a two-dimensional image of the object to be measured, and the projector 33 projects an image including grid-shaped reference points onto the object to be measured. Such a three-dimensional sensor 30 can capture the object to be measured on which the grid-shaped reference points have been projected by the two two-dimensional cameras 31 and 32, and calculate the distance from the three-dimensional sensor 30 to each grid based on the positional deviation of the grid generated by the parallax of the captured images of the two two-dimensional cameras 31 and 32. In addition, the three-dimensional sensor 30 may also be another device capable of three-dimensional measurement, such as a three-dimensional laser scanner.

[0022] The control device 40 has a model storage unit 41, a workpiece detection unit 42, a workpiece model configuration unit 43, an object selection unit 44, a hand model configuration unit 45, a path setting unit 46, a program generation unit 47, and a program execution unit 48. The control device 40 can be implemented by one or more computer devices having, for example, a memory, a CPU, an input / output interface, etc., and executing appropriate programs. The various structural elements of the control device 40 can also be structural elements classified by the functions of the control device 40, and it is not necessary to clearly distinguish them in terms of physical structure and program structure.

[0023] Before the operation of taking out the workpiece W, the model storage unit 41 pre-stores a workpiece model (such as CAD data) that models the three-dimensional shape of the workpiece W. Preferably, the model storage unit 41 also pre-stores a hand model that models the three-dimensional shape of the hand 20 and a robot model that models the three-dimensional shape of at least the front end of the robot 10. The model storage unit 41 may store a plurality of workpiece models of different shapes, and may further store an obstacle model that models objects that may exist and may become obstacles other than the workpiece W, such as a container C for placing the workpiece W.

[0024] The workpiece detection unit 42 converts the surface shape information representing the surface shape measured by the three-dimensional sensor 30 into three-dimensional point data that can be processed in the same coordinate space as the workpiece model. Then, the workpiece detection unit 42 detects the position and posture of each workpiece W1, W2, W3 by comparing the features of the three-dimensional point data with the features of the workpiece model. Such detection of workpieces W1, W2, W3 can be performed by a well-known matching process. Preferably, the workpiece detection unit 42 also detects the position and posture of obstacles by matching processing. As an example, in the case where, for example, the container C has a shape that may interfere with the workpiece W or the hand 20 when taking out the workpiece W, the workpiece detection unit 42 preferably also detects the position and posture of the container C.

[0025] The workpiece model arrangement unit 43 arranges the workpiece models in the virtual space at the positions and postures of the plurality of workpieces W1, W2, and W3 detected by the workpiece detection unit 42. Although the workpiece model arrangement unit 43 preferably registers the workpiece models of other workpieces W as obstacles only when the object to be taken out has been preselected, it is also possible to temporarily register the workpiece models corresponding to all the workpieces W1, W2, and W3 detected by the workpiece detection unit 42 as obstacles. In addition, the workpiece model arrangement unit 43 may further arrange obstacle models such as a container C on which the plurality of workpieces W1, W2, and W3 are placed in the virtual space.

[0026] The object selection unit 44 selects any one of the workpieces W1, W2, and W3 detected by the workpiece detection unit 42 as a removal target. Although the object selection unit 44 may set the workpiece located at the uppermost side as the removal target based on the data of the positions and postures of the workpieces W1, W2, and W3 detected by the workpiece detection unit 42, it is preferred to confirm the workpiece model arranged in the virtual space by the workpiece model arrangement unit 43 and select the removal target. As an example, the object selection unit 44 may also set a workpiece model that has no other workpiece model abutting on the upper side (the three-dimensional sensor 30 side) as the removal target.

[0027] When the workpiece model configuration unit 43 registers the workpiece models of all the workpieces W1, W2, and W3 as obstacles, the object selection unit 44 excludes the workpiece model of the selected removal object from the obstacles. In this way, by temporarily registering all the detected workpieces W1, W2, and W3 as obstacles and excluding the removal object selected later from the obstacles, the removal object can be appropriately selected, and correct information can be provided to the path setting unit 46. In addition, since the object selection unit 44 configured in this way can select the next removal object from the remaining workpieces (workpieces W1 and W3) registered as obstacles when the removal of the workpiece (for example, W2) of the selected removal object is completed, it is not necessary to re-acquire the surface shape data by the three-dimensional sensor 30 and the matching process by the workpiece detection unit 42. At this time, the object selection unit 44 also appropriately updates the obstacle information by excluding the workpiece model of the new removal object from the obstacles.

[0028] The hand model configuration unit 45 configures the hand model in the virtual space so as to maintain the position and posture of the workpiece model of the object to be removed. In this way, the interference between the workpieces W1, W2, and W3 and the hand 20 can be confirmed. The hand model configuration unit 45 can also generate a synthetic model by synthesizing the workpiece model of the object to be removed and the configured hand model. Since by generating a synthetic model, it is only necessary to perform a simulation of moving only a single synthetic model, the computational load can be suppressed. In addition, the hand model configuration unit 45 can also configure the robot model and the hand model together. By performing a simulation in which the robot model is also added, the interference between the workpieces W1, W2, and W3 and the hand 20 and the robot 10 can also be confirmed.

[0029] The path setting unit 46 sets the extraction path in the virtual space so that the workpiece model of the extraction object moves and retreats in a manner that does not interfere with other workpiece models, that is, workpiece models registered as obstacles and other obstacle models. Preferably, the path setting unit 46 makes the workpiece model of the extraction object retreat without changing the relative positional relationship between the workpiece model and the hand model, that is, the workpiece model of the extraction object and the hand model are moved as a whole as, for example, the above-mentioned composite model. More preferably, the path setting unit 46 is configured to set the extraction path so that the workpiece model, the hand model, and the robot model do not interfere with each other. In addition, the path setting unit 46 can also define the extraction path by a plurality of straight lines or curves joined at one or more intermediate points.

[0030] As an example, Figure 2 When the workpiece W2 to be removed is lifted in the vertical direction as shown, the short tube portion of the workpiece W2 to be removed will interfere with the flange portion of the adjacent workpiece W3. Figure 3As illustrated, the picking-out path is set so that the picking-out workpiece W2 is lifted in an inclined direction to avoid interference between the picking-out workpiece W2 and the workpiece W1 and the workpiece W3 .

[0031] The program generation unit 47 generates an operation program for the robot 10 for moving the hand 20 along the removal path set by the path setting unit 46. Such an operation program can be generated by a known technique.

[0032] The program execution unit 48 causes the robot 10 to operate according to the operation program generated by the program generation unit 47. Specifically, the program execution unit 48 converts the command of the operation program into the required position or speed of each drive axis of the robot 10, generates command values ​​for each drive axis of the robot 10, and inputs these command values ​​into the servo amplifiers that drive the drive axes of the robot 10.

[0033] The robot system 1 arranges the workpiece model of the workpiece W2 to be taken out, the workpiece models of other workpieces W1 and W3 that become obstacles, and the hand model of the hand 20 that holds the workpiece W2 to be taken out in a virtual space, and sets a simulated taking-out path in a manner that the workpiece model of the workpiece W2 to be taken out and the hand model do not interfere with the workpiece models of other workpieces W1 and W3. Therefore, since the robot system 1 only needs to confirm the interference between the model of the obstacle and the hand model, which has a smaller data volume than the surface shape data obtained by the three-dimensional sensor 30, the calculation load can be suppressed. In addition, since the robot system 1 uses the noise-removed data of the surface shape data obtained by the three-dimensional sensor 30, a more appropriate taking-out path can be set. In addition, since the robot system 1 can consider the shape of the back side of the invisible workpieces W1, W2, and W3 that cannot be confirmed in the surface shape data obtained by the three-dimensional sensor 30, a more appropriate taking-out path can be set, and even if the workpieces with complex shapes are arranged to mesh with each other and become workpieces that are not exposed as a whole, the workpiece can still be taken out.

[0034] Although the embodiments of the present disclosure have been described above, the present invention is not limited to the embodiments described above. In addition, the effects described in the embodiments described above are merely examples of the ideal effects produced by the present invention, and the effects of the present invention are not limited to the effects described in the embodiments described above. As an example, the robot system of the present invention may also be a structure that does not use a hand model but only confirms the interference between the workpiece model of the object to be removed and the workpiece model other than the object to be removed.

[0035] Description of Reference Numerals

[0036] 1 Robotic system

[0037] 10. Robot

[0038] 20 Hands

[0039] 31.32 Two-dimensional camera

[0040] 33 Projector

[0041] 30 3D Sensor

[0042] 40 Control device

[0043] 41 Model storage unit

[0044] 42 Workpiece detection unit

[0045] 43 Workpiece model configuration section

[0046] 44 Object selection section

[0047] 45 Hand model configuration section

[0048] 46 Path setting unit

[0049] 47 Program Generation Department

[0050] 48 Program Execution Department

[0051] C Container

[0052] W1, W2, W3 workpieces.

Claims

1. A robot system, characterized in that: have: robot; a three-dimensional sensor that determines a surface shape of an object area where a workpiece may exist; a control device for generating a removal path for removing at least one of the workpieces by the robot based on the surface shape measured by the three-dimensional sensor, The control device has: A model storage unit storing a workpiece model obtained by modeling the three-dimensional shape of the workpiece; a workpiece detection unit that detects the position and posture of the workpiece by comparing the features of the surface shape measured by the three-dimensional sensor with the features of the workpiece model; a workpiece model configuration unit that configures the workpiece model in a virtual space to the position and posture of the workpiece detected by the workpiece detection unit; A path setting unit sets the removal path by moving one of the workpiece models in the virtual space so as not to interfere with other workpiece models.

2. The robot system according to claim 1, characterized in that: The control device further includes an object selecting unit that selects any one of the workpieces detected by the workpiece detecting unit as a removal object.

3. The robot system according to claim 1 or 2, characterized in that: The control device selects the one workpiece model arranged by the workpiece model arrangement unit as a removal target.

4. The robot system according to any one of claims 1 to 3, characterized in that: The workpiece model arrangement unit registers the other workpiece models as obstacles and excludes the one workpiece model from the obstacles.

5. The robot system according to any one of claims 1 to 4, characterized in that: The robot system further comprises: a hand, which is arranged at the front end of the robot, The model storage unit further stores a hand model obtained by modeling the three-dimensional shape of the hand. The control device further comprises: a hand model configuration unit, which configures the hand model in the virtual space so as to hold the position and posture of the one workpiece model. The path setting unit sets the removal path so that the hand model does not interfere with the other workpiece model without changing the relative positional relationship between the one workpiece model and the hand model.

6. The robot system according to claim 5, characterized in that: The hand model configuration unit generates a synthesized model by synthesizing the one workpiece model and the hand model.

7. The robot system according to claim 5 or 6, characterized in that: The model storage unit further stores a robot model in which a three-dimensional shape of at least a front end portion of the robot is modeled. The hand model configuration unit configures the robot model and the hand model together, The path setting unit sets the removal path so that the workpiece model, the hand model, and the robot model do not interfere with each other.

8. The robot system according to any one of claims 1 to 7, characterized in that: The control device further includes a program generating unit that generates an operation program for causing the robot to move along the removal path set by the path setting unit.

9. The robot system according to claim 8, characterized in that: The control device further includes a program execution unit that causes the robot to operate according to the operation program generated by the program generation unit.