Workpiece removal system

Through the combination of a three-dimensional measuring device and robotic hand, the position and posture of the workpiece and hand are determined by using model matching processing in the virtual space, solving the problem of inappropriate holding of the workpiece caused by the limitations of sensor identification, and realizing the reliable removal and posture of the workpiece Align.

CN118946438APending Publication Date: 2024-11-12FANUC LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202280094124.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-06-16
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

When performing three-dimensional measurements on the workpiece, the sensor can only recognize the shape information at a specific position, which may not be able to properly hold the workpiece when the hand is approaching in different directions, and after removal, it needs to measure the holding state to align the direction, which has reliability problems.

Method used

The workpiece shape is measured by a three-dimensional measuring device, combined with the robot's hand and control device, and the measurement results of the three-dimensional measuring device are matched with the workpiece model, the workpiece position and posture are determined, and the hand model is configured in the virtual space to determine the position and posture of the holding position to ensure that Hands properly hold the workpiece.

Benefits of technology

Reliable removal of the workpiece is achieved, inappropriate control of the hands when approaching in different directions is avoided, the subsequent measurement operation load is reduced, and the reliability of the workpiece removal process is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118946438A_ABST
    Figure CN118946438A_ABST
Patent Text Reader

Abstract

A workpiece taking-out system according to one embodiment of the present disclosure capable of reliably taking out a workpiece is provided with: a three-dimensional measurer that measures the shape of the workpiece; a robot having a hand for gripping the workpiece; and a control device that controls the robot on the basis of the measurement results of the three-dimensional measurer so that the workpiece is taken out by the robot, the control device comprising: a storage unit that stores a workpiece model obtained by modeling the three-dimensional shape of the workpiece and a hand model obtained by modeling the three-dimensional shape of the hand; a matching unit that specifies the position and orientation of the workpiece by matching the measurement result of the three-dimensional measurer with the workpiece model; a model arrangement unit that arranges the workpiece model in the virtual space at the position and orientation specified by the matching unit; and a gripping determination unit that arranges the hand model in the virtual space, and determines a gripping position / orientation, which is the position / orientation of the hand when gripping the workpiece by the hand, on the basis of the relationship between the hand model arranged in the virtual space and the workpiece model.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a workpiece taking-out system. Background Art

[0002] The following robot system is widely used: it obtains the surface shape information of the object such as the range image and point cloud data, determines the position and posture of the workpiece through matching processing, and removes the workpiece using a robot hand. Sometimes it is necessary to remove the workpieces one by one from a plurality of workpieces randomly overlapped with each other, starting from the workpiece arranged on the upper side. In this case, the posture of the workpiece is not only in the plane direction, but also may be tilted in the vertical direction. Therefore, if the robot hand is only approached from the top, it may not be able to properly hold the workpiece.

[0003] Under such circumstances, a technique has been proposed (see, for example, Patent Document 1) for determining the optimal position and posture for holding a workpiece with a hand based on workpiece measurement data obtained by three-dimensionally measuring the workpiece with a sensor and hand shape data.

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: International Publication No. WO2012 / 066819 Summary of the invention

[0007] Problem that the invention aims to solve

[0008] When three-dimensionally measuring a workpiece, generally only information about the shape of the surface that can be visually recognized by the sensor configured at a specific position is obtained. Therefore, when the hand is approached from a direction different from the sensor, there may be a situation where the hand is inappropriate for the shape that does not appear in the workpiece measurement data. In addition, since the workpiece is taken out without sensing where on the workpiece it is held, when the direction of the workpiece is required to be aligned in the subsequent process, it is necessary to measure the holding state in some way after taking it out. Therefore, a technology that can reliably take out the workpiece is desired.

[0009] Solutions for solving problems

[0010] A workpiece removal system according to one embodiment of the present disclosure includes: a three-dimensional measuring device that measures the shape of a workpiece; a robot that has a hand that grips the workpiece; and a control device that controls the robot based on the measurement result of the three-dimensional measuring device so that the robot can pick up the workpiece; wherein the control device includes: a storage unit that stores a workpiece model obtained by modeling the three-dimensional shape of the workpiece and a hand model obtained by modeling the three-dimensional shape of the hand; a matching unit that determines the position and posture of the workpiece by matching the measurement result of the three-dimensional measuring device with the workpiece model; a model configuration unit that configures the workpiece model in a virtual space at the position and posture determined by the matching unit; and a grip determination unit that configures the hand model in the virtual space and determines the position and posture of the hand when the hand grips the workpiece, i.e., the gripping position and posture, based on the relationship between the hand model configured in the virtual space and the workpiece model.

[0011] Effects of the Invention

[0012] According to the present disclosure, the workpiece can be reliably taken out. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 It is a schematic diagram showing the structure of the workpiece removal system according to the first embodiment of the present disclosure.

[0014] Figure 2 Yes Figure 1 A schematic diagram illustrating a simplified example of the measurement results of a three-dimensional measuring instrument of a workpiece removal system.

[0015] Figure 3 is an example Figure 1 A three-dimensional image of a workpiece model stored in a storage unit of a workpiece removal system.

[0016] Figure 4 is an example Figure 1 A three-dimensional image of a hand model stored in a storage unit of a workpiece removal system.

[0017] Figure 5 Yes Description Figure 1 Schematic diagram of confirmation of gripping position and posture by a gripping determination unit of a workpiece removal system.

[0018] Figure 6 Yes Description Figure 1 The gripping determination part of the workpiece removal system is different from Figure 5 Schematic diagram of confirmation of holding position posture. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Figure 1The workpiece removal system 1 is a schematic diagram showing the structure of a workpiece removal system 1 according to the first embodiment of the present disclosure. The workpiece removal system 1 removes one or more workpieces W that are randomly arranged and may overlap one another, one by one, and arranges the removed workpieces W at predetermined positions in predetermined postures.

[0020] The workpiece removal system 1 includes a three-dimensional measuring machine 10 for measuring the shape of a workpiece W, a robot 20 having a hand 21 for holding the workpiece W, and a control device 30 for controlling the robot 20 based on the measurement result of the three-dimensional measuring machine 10 so that the robot 20 can remove the workpiece W.

[0021] The three-dimensional measuring device 10 measures the distance to the measuring object for each two-dimensional position, and outputs a measurement result representing the shape of the surface of the measuring object facing the three-dimensional measuring device 10, such as a distance image, point cloud data, etc. Figure 2 2 shows point cloud data of the workpiece W as an example of the measurement result output from the three-dimensional measuring device 10 .

[0022] As a specific example, a stereo camera including two two-dimensional cameras for capturing two-dimensional images of a measurement object and a projector for projecting an image including grid-like reference points onto the measurement object can be used as the three-dimensional measuring device 10, and the distance from the three-dimensional measuring device 10 to each reference point is calculated based on the positional offset of the reference point caused by the parallax of the images captured by the two two-dimensional cameras. In addition, the three-dimensional measuring device 10 may be another device capable of three-dimensional measurement, such as a three-dimensional laser scanner.

[0023] The three-dimensional measuring device 10 can be fixed, for example, above an area where the workpiece W is arranged so as to be able to measure the entire area where the workpiece W is arranged. Alternatively, the three-dimensional measuring device 10 can be held by a robot 20 and positioned by the robot 20 to a position where the shape of the workpiece W can be measured each time.

[0024] The robot 20 has a hand 21 at the front end for holding the workpiece W, and determines the position and posture of the hand 21, that is, the coordinate position of the reference point of the hand 21 and the direction of the hand 21. The robot 20 can Figure 1 As illustrated, a vertical articulated robot is used, but the robot is not limited thereto, and may be, for example, an orthogonal coordinate robot, a horizontal articulated robot, a parallel link robot, or the like.

[0025] The hand 21 may be configured to include a pair of gripping fingers 22 for gripping the workpiece W. The gripping fingers 22 may have a shape matching the shape of the workpiece W in a region contacting the workpiece W, such as a recessed portion 23 in the illustrated example.

[0026] The control device 30 can be implemented by one or more computer devices that have a memory, a processor, an input / output interface, etc. and execute an appropriate control program. The control device 30 includes a storage unit 31, a matching unit 32, a take-out object determination unit 33, a model configuration unit 34, an obstacle information generation unit 35, a grip determination unit 36, and a release determination unit 37. In addition, the components of the control device 30 are classified according to their functions, and may not be clearly distinguished in terms of physical structure and program structure.

[0027] The storage unit 31 stores a workpiece model Mw obtained by modeling the three-dimensional shape of the workpiece W and a hand model Mh obtained by modeling the three-dimensional shape of the hand 21. Figure 3 The workpiece model Mw is shown in Figure 4 The hand model Mh is shown in FIG. 2 . In addition, it is preferable that the storage unit 31 stores a graspable region Ag, which is a region set in the workpiece model Mw so as to be graspable by the hand 21. Figure 3 In the workpiece model Mw, the workpiece model Mw has a disc-shaped flange portion P1, a truncated cone-shaped middle portion P2 connected to one surface of the flange portion P1, and a cylindrical shaft portion P3 extending from the front end of the middle portion P2. With respect to this workpiece model Mw, the flange portion P1 can be held in the thickness direction, or the shaft portion P3 can be held in the radial direction. Figure 3 The main surface of the flange portion P1 and the outer peripheral surface of the shaft portion P3 with hatching can be set as the grippable area Ag. In addition, the storage unit 31 can also store an obstacle model obtained by modeling the three-dimensional shape of an obstacle such as a container containing the workpiece W. In addition, the storage unit 31 can also store a priority gripping position posture, which is set as a relative position posture that should be prioritized for the hand model Mh relative to the workpiece model Mw.

[0028] The matching unit 32 determines the position and posture of the workpiece W by matching the measurement results of the three-dimensional measuring device 10 with the workpiece model Mw stored in the storage unit 31. In addition, when the storage unit 31 stores an obstacle model, the matching unit 32 preferably also determines the position and posture of the obstacle by matching the measurement results of the three-dimensional measuring device 10 with the obstacle model. As the matching process performed by the matching unit 32, a well-known method can be adopted. As a specific example, the matching unit 32 can be configured to extract a plurality of feature points from the measurement results of the three-dimensional measuring device 10, and determine that the workpiece W exists when the consistency between the positional relationship of the feature points and the positional relationship of the feature points of the workpiece model Mw is greater than a predetermined value.

[0029] The picking object determination unit 33 determines one workpiece W to be picked up by the robot 20 from the workpieces W whose positions and postures are determined by the matching unit 32. Preferably, the picking object determination unit 33 confirms the workpiece model Mw configured in the virtual space by the model configuration unit 34 described later, and sets the workpiece W that is less likely to interfere with other workpieces W as the picking object. As an example, the picking object determination unit 33 may also set the workpiece model Mw that is not abutted by other workpiece models Mw on the upper side as the picking object. In addition, the picking object determination unit 33 may also be simply configured as follows: based on the coordinate position of the workpiece W determined by the matching unit 32, the workpiece W located at the uppermost side or closest to the preset reference coordinates is set as the picking object.

[0030] The model placement unit 34 places the workpiece model Mw in the virtual space at the position and posture determined by the matching unit 32. When the position and posture of an obstacle are also determined by the matching unit 32, it is preferred that the model placement unit 34 also places the obstacle model in the virtual space at the position and posture determined by the matching unit 32. The coordinate system of the virtual space in which the workpiece model Mw and the obstacle model are placed by the model placement unit 34 is preferably a coordinate system used in the control of the robot 20, and therefore, the model placement unit 34 preferably performs coordinate conversion from the coordinate system of the three-dimensional measuring machine 10 to the coordinate system of the robot 20.

[0031] The obstacle information generating unit 35 generates obstacle information which is obtained by excluding the information corresponding to the workpiece model Mw or the graspable area Ag of the object to be taken out arranged by the model arranging unit 34 from the measurement result of the three-dimensional measuring device 10, for example, information excluding the points corresponding to the point cloud data. The obstacle information can be used as information to prevent objects that cannot be detected by the matching unit 32, for example, foreign objects that are not modeled, from interfering with the hand 21.

[0032] like Figure 4 and Figure 5 As schematically shown, the grip determination unit 36 ​​further arranges the hand model Mh in the virtual space where the workpiece model Mw is arranged. The grip determination unit 36 ​​opens and closes the gripping fingers of the hand model Mh, and determines the position and posture of the hand 21 when the hand 21 grips the workpiece W, that is, the gripping position and posture, based on the relationship between the hand model Mh and the workpiece model Mw. Thus, even in a posture such as inserting the gripping fingers 22 on the side of the workpiece W opposite to the three-dimensional measuring device 10, which cannot be confirmed in the measurement results of the three-dimensional measuring device 10 such as point cloud data, it is possible to confirm whether the workpiece W can be properly gripped.

[0033] The holding determination unit 36 ​​may determine the possibility of holding at the priority holding position and posture, and if it is determined that the object cannot be held, determine the possibility of holding at a position and posture corrected from the priority holding position and posture based on a predetermined rule, thereby determining the holding position and posture. In this way, by searching for the holding position and posture with the priority holding position and posture as the starting point, the calculation load can be suppressed.

[0034] The gripping determination unit 36 ​​preferably determines the gripping position and posture in such a manner that the hand model Mh does not interfere with the workpiece model Mw of the workpiece W other than the object to be taken out. By setting it so as not to interfere with the workpiece model Mw other than the object to be taken out, it is possible to prevent the position and posture of the workpiece W to be taken out from being changed when the hand 21 actually takes out the workpiece W due to the hand 21 moving the workpiece W other than the object to be taken out, so that the workpiece W cannot be properly gripped by the hand 21.

[0035] Specifically, the grip determination unit 36 ​​can be configured to determine the gripping position and posture based on the size of the contact area between the workpiece model Mw and the hand model Mh, for example, setting the position and posture where the contact area is greater than a threshold as the gripping position and posture. The contact area can be calculated as the area of ​​the following region: for example, when the interval between the gripping fingers 22 of the hand model Mh is reduced and the hand model Mh is initially in contact with the workpiece model Mw, the distance from the surface of the workpiece model Mw to the hand model Mh is less than a predetermined threshold. In this way, by using the contact area between the workpiece model Mw and the hand model Mh as an indicator, there is no need to perform complicated preparation work such as teaching the relative position and posture of the hand 21 relative to the workpiece W multiple times in advance, and the gripping position and posture that can be properly gripped can be determined without being affected by the posture of the workpiece W.

[0036] In addition, when the storage unit 31 stores the graspable area Ag, the grasping determination unit 36 ​​may also determine the grasping position and posture based on the relationship between the graspable area Ag of the workpiece model Mw and the hand model Mh. That is, the grasping determination unit 36 ​​may not confirm the relationship between the area outside the graspable area Ag of the workpiece model Mw and the hand model Mh. In this way, the calculation load can be reduced, and the threshold of the contact area for determining the grasping position and posture can be set as a more stringent condition. In this case, it is ideal that the grasping determination unit 36 ​​does not ignore the area outside the graspable area Ag of the workpiece model Mw, but determines the grasping position and posture in a way that the hand model Mh does not interfere with the area outside the graspable area Ag of the workpiece model Mw.

[0037] Furthermore, the grip determination unit 36 ​​preferably determines the grip position and posture so that the shape indicated by the obstacle information generated by the obstacle information generation unit 35 does not interfere with the hand model Mh. This allows the workpiece W to be removed while avoiding foreign matter that is not modeled.

[0038] The release determination unit 37 determines the position and posture of the hand 21 when releasing the removed workpiece W, i.e., the release position and posture, based on the gripping position and posture determined by the gripping determination unit 36. Thus, the workpiece W can be released at a certain position and posture, so that the workpiece removal system 1 can be used as a supply device or an assembly device for the workpiece W.

[0039] The workpiece removal system 1 determines the position and posture of the workpiece W by matching the measurement results of the three-dimensional measuring device 10 with the workpiece model Mw, and arranges the workpiece model Mw and the hand model Mh in a virtual space to simulate the relationship between the workpiece W and the hand 21, thereby being able to determine the gripping position and posture taking into account the shape that does not appear in the measurement results of the three-dimensional measuring device 10, so that the workpiece can be reliably removed. In addition, the workpiece removal system 1 determines the relative position and angle of the workpiece model Mw and the hand model Mh by simulation, so there is no need to teach in advance which position of the workpiece W is to be gripped by the hand 21 at what relative angle.

[0040] The embodiments of the present disclosure are described above, but the present invention is not limited to the above embodiments. In addition, the effects described in the above embodiments are only preferred effects produced by the present invention, but the effects of the present invention are not limited to the effects described in the above embodiments.

[0041] As an example, in the workpiece removal system of the present invention, the obstacle information generating unit may be omitted. In addition, when the posture of the workpiece at the time of release is arbitrary, the release determining unit may be omitted. In addition, the removal object determining unit may be configured to determine the workpiece to be removed according to the user's input, and the removal object determining unit may be omitted when there is always only one workpiece.

[0042] Description of Reference Numerals

[0043] 1: workpiece removal system; 10: three-dimensional measuring device; 21: hand; 20: robot; 22: gripping finger; 23: recess; 30: control device; 31: storage unit; 32: matching unit; 33: removal object determination unit; 34: model configuration unit; 35: obstacle information generation unit; 36: grip determination unit; 37: release determination unit; Ag: grippable area; Mw: workpiece model; Mh: hand model; W: workpiece.

Claims

1. A workpiece removal system, comprising: A three-dimensional measuring device that determines the shape of a workpiece; a robot having a hand for holding a workpiece; and a control device that controls the robot based on the measurement result of the three-dimensional measuring device so that the robot can take out the workpiece; in, The control device has: a storage unit storing a workpiece model obtained by modeling the three-dimensional shape of the workpiece and a hand model obtained by modeling the three-dimensional shape of the hand; a matching unit that determines the position and posture of the workpiece by matching the measurement result of the three-dimensional measuring device with the workpiece model; a model arranging unit that arranges the workpiece model in a virtual space at the position and posture determined by the matching unit; as well as A grip determination unit arranges the hand model in the virtual space, and determines a gripping position and posture of the hand when the hand grips the workpiece based on a relationship between the hand model and the workpiece model arranged in the virtual space.

2. The workpiece removal system according to claim 1, wherein: The storage unit stores a graspable area in the workpiece model that can be grasped. The grip determination unit determines the grip position and posture based on a relationship between the grippable region of the workpiece model and the hand model.

3. The workpiece removal system according to claim 1, wherein: The storage unit stores a priority gripping position and posture, wherein the priority gripping position and posture is a relative position and posture of the hand model to be prioritized with respect to the workpiece model. After determining the possibility of holding at the priority holding position and posture, the holding determination unit determines the possibility of holding at a position and posture corrected from the priority holding position and posture based on a predetermined rule if it is determined that the holding is impossible.

4. The workpiece removal system according to claim 2, wherein: The control device further includes an obstacle information generating unit configured to generate obstacle information by excluding information corresponding to the graspable area from the measurement result of the three-dimensional measuring device. The grip determination unit determines the grip position and posture so that the hand model does not interfere with a shape indicated by the obstacle information.

5. The workpiece removal system according to any one of claims 1 to 4, wherein: The model placement unit places the workpiece model of the workpiece to be picked up and the workpiece models of the workpieces other than the pick-up targets in the virtual space. The grip determination unit determines the grip position and posture so that the hand model does not interfere with the workpiece model of the workpiece other than the picking target.

6. The workpiece removal system according to claim 1, wherein: The control device further includes an obstacle information generating unit configured to generate obstacle information by excluding information corresponding to the workpiece model arranged by the model arranging unit from the measurement result of the three-dimensional measuring device. The grip determination unit determines the grip position and posture so that the hand model does not interfere with a shape indicated by the obstacle information.

7. The workpiece removal system according to any one of claims 1 to 5, wherein: The control device further includes a release determination unit that determines a release position and posture that is a position and posture of the hand when releasing the taken workpiece, based on the grip position and posture determined by the grip determination unit.

8. The workpiece removal system according to any one of claims 1 to 7, wherein: The grip determination unit determines the grip position and posture based on a size of a contact area between the workpiece model and the hand model.

Citation Information

Patent Citations

  • Work pick-up apparatus

    WO2012066819A1