Robot system, robot system control method, article manufacturing method, program, and recording medium
The robot system uses sensors to measure and adjust its hand's position or posture to avoid interference, improving the success rate of workpiece grasping by preventing collisions and reducing processing time.
Patent Information
- Application Number
- JP2023085500
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-24
- Publication Date
- 2024-12-05
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing robot systems face challenges in successfully holding workpieces due to changes in the state of the workpiece or its surroundings during the approach, leading to potential interference with objects and failure in grasping the workpiece.
A robot system equipped with sensors on the robot hand and arm to measure the state of the hand and object, allowing for controlled approach and avoidance operations based on measurement results to prevent interference, including retracting or correcting the robot hand's position or posture.
Enhances the success rate of holding workpieces by preventing interference, reducing the likelihood of workpiece collapse and damage, and minimizing processing time for successful grasping.
Smart Images

Figure 2024168645000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to robot technology. [Background technology]
[0002] A commonly known technique for having a robot hand hold one workpiece from among multiple workpieces piled up involves using a camera or other device to recognize the workpiece to be held, moving the robot hand to the workpiece to be held, and having the robot hand hold the workpiece.
[0003] Patent Document 1 discloses that before a workpiece is held by a robot hand, an image of the bulk-stacked workpieces is captured by a camera, and the captured image is used to determine whether the robot hand will interfere with other workpieces around the workpiece to be held. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2018-176334 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, after capturing the image, while the robot hand is approaching the workpiece to be held, the state of the workpiece to be held and / or the state of the surroundings of the workpiece to be held may change, which may cause the robot hand to interfere with objects including the workpiece and surrounding objects, resulting in failure to hold the workpiece.
[0006] The present disclosure aims to increase the success rate of a robot hand holding a workpiece. [Means for solving the problem]
[0007] A first aspect of the present disclosure is a robot system comprising a robot having a robot arm and a robot hand, a sensor that measures a state of the robot hand and an object in a predetermined direction based on the robot hand, and a control unit that controls the robot, wherein the control unit causes the robot to perform an approach operation to bring the robot hand closer to a workpiece to be held, acquires measurement results from the sensor while the robot is performing the approach operation, and, when a predetermined condition based on the measurement results is satisfied, causes the robot to perform an avoidance operation to avoid the robot hand interfering with the object.
[0008] A second aspect of the present disclosure is a robot system comprising: a robot having a robot hand including a plurality of fingers and a robot arm; a plurality of sensors provided on each of the plurality of fingers for measuring a state of a corresponding finger among the plurality of fingers and an object in a predetermined direction based on the corresponding finger among the plurality of fingers; and a control unit for controlling the robot, wherein the control unit causes the robot to perform an approach operation to bring the robot hand closer to a workpiece to be held, acquires measurement results from each of the plurality of sensors while the robot is performing the approach operation, and, when a predetermined condition based on the measurement results is satisfied for any of the plurality of sensors, causes the robot to perform an evacuation operation to retract the robot hand in a direction opposite to the direction of movement of the robot hand when the robot is caused to perform the approach operation.
[0009] A third aspect of the present disclosure is a control method for a robot system including a robot having a robot arm and a robot hand, and a sensor that measures a state of the robot hand and an object in a predetermined direction based on the robot hand, the control method comprising: causing the robot to perform an approach operation to bring the robot hand closer to a workpiece to be held, acquiring measurement results from the sensor while the robot is performing the approach operation, and, if a predetermined condition based on the measurement results is satisfied, causing the robot to perform an avoidance operation to avoid the robot hand interfering with the object. Effect of the Invention
[0010] According to the present disclosure, the success rate of a robot hand holding a workpiece can be increased. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is an explanatory diagram illustrating a schematic configuration of a robot system according to a first embodiment. [Diagram 2] 1A is a schematic diagram of a robot hand according to the first embodiment, FIG. 1B is a schematic diagram of a robot hand according to a first modified example of the first embodiment, and FIG. 1C is an explanatory diagram of the arrangement state of a workpiece according to the first embodiment. [Diagram 3] FIG. 2 is an explanatory diagram of a control system according to the first embodiment. [Figure 4] FIG. 2 is a block diagram of a computer system in the control system according to the first embodiment. [Diagram 5] FIG. 2 is a functional block diagram of a control unit according to the first embodiment. [Figure 6] FIG. 2 is an explanatory diagram of workpieces stacked in bulk according to the first embodiment. [Figure 7] 5(a) to 5(c) are explanatory views showing the relationship between a holding point and a holding start position according to the first embodiment. [Figure 8] 5(a) and 5(b) are diagrams illustrating a method for determining a holding point and a holding start position according to the first embodiment. FIG. [Figure 9] 5(a) and 5(b) are explanatory diagrams of an approaching operation according to the first embodiment. [Figure 10] FIG. 1 is a perspective view of a robot hand according to a first embodiment. [Figure 11] 5(a) to 5(c) are diagrams illustrating a state in which interference is detected by the distance sensor according to the first embodiment. [Figure 12] FIG. 2 is a diagram showing a state in which the robot hand according to the first embodiment is positioned at a holding start position. [Figure 13] 4 is a flowchart of control according to the first embodiment. [Figure 14] FIG. 14 is an explanatory diagram of the operation of each step in the flowchart shown in FIG. [Figure 15] FIG. 11 is an explanatory diagram of a distance sensor according to a second embodiment. [Figure 16] 10 is a flowchart of a control according to a second embodiment. [Figure 17] 5(a) and 5(b) are diagrams illustrating a determination according to the first embodiment. [Figure 18] 13(a) and 13(b) are explanatory diagrams of a correction operation according to the second embodiment. [Figure 19] 13(a) and (b) are explanatory diagrams of a second modified example of the second embodiment, and FIG. 13(c) is an explanatory diagram of a third modified example of the second embodiment. [Figure 20] 13(a) and 13(b) are explanatory diagrams of a correction operation according to the third embodiment. [Figure 21] 10A is a block diagram of a robot control unit according to a fourth embodiment, and FIG. 10B is an explanatory diagram of a graphical interface according to the fourth embodiment. [Figure 22] 13 is a flowchart of a control according to a fourth embodiment. [Figure 23] FIG. 13 is an explanatory diagram of a robot hand according to the fifth embodiment. [Figure 24] 13(a) and (b) are explanatory diagrams of a robot hand according to a fifth embodiment. [Diagram 25] FIG. 13 is an explanatory diagram of a robot hand according to the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the drawings. In the description of each embodiment, the same components are denoted by the same reference numerals, and duplicate descriptions will be omitted.
[0013] [First embodiment] 1 is an explanatory diagram showing a schematic configuration of a robot system 10 according to a first embodiment. The robot system 10 includes a robot 100, a control system 500, and a camera 211 serving as an imaging device that is an example of an imaging section. The control system 500 includes an information processing device 200 and a control device 400. The robot 100 is an industrial robot that is placed on a production line and used to manufacture goods.
[0014] The robot 100 and the control device 400 are connected by wire or wirelessly to enable data transmission. The control device 400 and the information processing device 200 are connected by wire or wirelessly to enable data transmission. The camera 211 and the information processing device 200 are connected by wire or wirelessly to enable data transmission. Here, the vertical direction, i.e., the downward direction, is defined as the -Z0 direction, and the upward direction is defined as the +Z0 direction.
[0015] The robot 100 is a manipulator. The robot 100 is fixed to, for example, a stand. A tray 20 with an open top and a mounting table 30 are arranged around the robot 100, i.e., within the movable range of the robot 100. A plurality of workpieces W are stacked in bulk in the tray 20. That is, a plurality of workpieces W are stacked in bulk on the inner bottom surface 21 of the tray 20. This allows the robot 100 to access the workpieces W. Each workpiece W is an example of a holding object, for example, a part. The robot 100, the camera 211, the tray 20, the mounting table 30, the workpieces W, etc. are arranged in a working space R1, which is a real space. The robot 100 is configured to be able to hold the workpieces W and to be able to transport the held workpieces W.
[0016] Objects around the robot 100, such as the tray 20, the mounting table 30, and the workpiece W, are objects with which the robot 100 may interfere. Here, the interference of the robot 100 with an object includes the robot 100 affecting the object in addition to holding the object. For example, the interference of the robot 100 with an object includes a part of the robot 100 other than the part that holds the workpiece W coming into contact with or colliding with the object.
[0017] The robot 100 has a robot arm 101 and a robot hand 120 which is an example of an end effector (holding mechanism). The robot arm 101 is a vertically articulated robot arm. The robot arm 101 is, for example, a six-axis robot arm. Note that the robot arm 101 is not limited to a vertically articulated robot arm, and may be a SCARA (Selective Compliance Assembly Robot Arm), a parallel link robot arm, or an orthogonal robot.
[0018] The robot hand 120 is supported by the robot arm 101. The robot hand 120 is attached to a predetermined portion of the robot arm 101, for example, to the tip of the robot arm 101. The robot hand 120 is configured to be able to hold a workpiece W.
[0019] Fig. 2(a) is a schematic diagram of a robot hand 120 according to the first embodiment. As shown in Fig. 2(a), the robot hand 120 is a grip-type robot hand, and includes a main body 121 supported by a robot arm 101, and two finger portions 122 driven by the main body 121. The two finger portions 122 move to open and close by being driven by the main body 121. The two finger portions 122 move from an open position to a closing position, and come into contact with the workpiece W to pinch the workpiece W, and hold the workpiece W by the frictional force between the workpiece W and the finger portions 122. The material of the finger portions 122 may be rubber or metal.
[0020] In the following description, the robot hand 120 will be described as having two fingers 122, but the present invention is not limited thereto, and the robot hand 120 may have two or more fingers. Fig. 2(b) is a schematic diagram of a robot hand 120 according to a first modified example of the first embodiment. For example, as shown in Fig. 2(b), the robot hand 120 may have three fingers 122 as the two or more fingers.
[0021] FIG. 2(c) is an explanatory diagram of the arrangement state of the workpiece W according to the first embodiment. As shown in FIG. 2(c), the workpiece W has different shapes on the front and back sides. In FIG. 2(c), the workpiece W is exposed with the front or back side facing upward when viewed from the camera 211. The workpiece W is preferably a rigid body, but may be a flexible body having flexibility. The multiple workpieces W arranged on the tray 20 have the same shape, size, and color as each other, within a predetermined range of error.
[0022] The camera 211 is, for example, a two-dimensional digital camera, and has an image sensor (not shown). The image sensor is, for example, a CMOS image sensor or a CCD image sensor. The camera 211 is fixed to a frame (not shown) arranged around the robot 100. As shown in FIG. 1, the camera 211 is arranged at a position where it can image a predetermined area R0 including a plurality of workpieces W arranged on the tray 20. That is, the camera 211 can image a predetermined area R0 including the workpieces W to be held by the robot 100. For example, the camera 211 is arranged above the robot 100, and arranged to image a subject in the -Z0 direction. The camera 211 may be an on-hand camera arranged on the robot 100. In any case, the camera 211 only needs to be able to image an area R0 including the workpieces W to be held among the plurality of workpieces W randomly piled on the tray 20.
[0023] The information processing device 200 and the control device 400 are each composed of a computer. The information processing device 200 can send an imaging command to the camera 211 to cause the camera 211 to capture an image. The camera 211 that has received the imaging command captures an image of a predetermined area R0 in which a plurality of workpieces W are piled up in a random manner, and generates image data I1 as a captured image. The information processing device 200 is configured to be able to acquire the image data I1 generated by the camera 211, and is configured to be able to process the acquired image data I1. As an example of image processing, the information processing device 200 can execute a process of obtaining information on the workpiece W, such as the position and posture of the workpiece W to be held, based on the image data I1.
[0024] The control device 400 is capable of acquiring information on the workpiece W from the information processing device 200, and controlling the robot arm 101 so that the robot hand 120 moves to a position near the workpiece W based on the information on the workpiece W. The control device 400 then executes a control process to cause the robot hand 120 to hold the workpiece W, and then place the workpiece W on the mounting table 30. In this manner, in the first embodiment, the control device 400 executes a process to cause the robot 100 to hold the workpieces W piled in bulk on the tray 20 one by one, and align the workpieces W on the mounting table 30.
[0025] In this way, the control device 400 can move the robot hand 120 to a desired position and cause the robot 100 to perform a desired task. For example, a workpiece W and another workpiece are prepared, and an article can be manufactured by having the robot 100 perform the task of assembling the workpiece W to the other workpiece. Note that, although the example of manufacturing an article by assembling a workpiece by the robot 100 has been described, the present invention is not limited to this. For example, the robot arm 101 may be provided with a tool such as a cutting tool or a polishing tool, and the article may be manufactured by processing the workpiece with the tool.
[0026] 3 is an explanatory diagram of a control system 500 according to the first embodiment. The control system 500 includes an information processing device 200, a control device 400, a display 402 which is an example of a display unit, and a keyboard 403 and a mouse 404 which are examples of input devices. The display 402, the keyboard 403, and the mouse 404 are connected to the control device 400, for example.
[0027] 4 is a block diagram of a computer system in the control system 500 according to the first embodiment. The information processing device 200 includes a CPU (Central Processing Unit) 251, which is an example of a processor. The CPU 251 executes a program 261 to function as an information processing section, which will be described later. The information processing device 200 also includes a ROM (Read Only Memory) 252, a RAM (Random Access Memory) 253, and a HDD (Hard Disk Drive) 254, which serve as storage sections. The information processing device 200 also includes a recording disk drive 255, and an interface 256, which is an input / output interface. The CPU 251, the ROM 252, the RAM 253, the HDD 254, the recording disk drive 255, and the interface 256 are connected to each other via a bus so as to be able to transfer data therebetween.
[0028] The control device 400 and the camera 211 are connected to the interface 256 of the information processing device 200 .
[0029] The ROM 252 stores basic programs related to the operation of the computer. The RAM 253 is a storage device that temporarily stores various data such as the results of arithmetic processing by the CPU 251. The HDD 254 records the results of arithmetic processing by the CPU 251 and various data acquired from the outside, and also records a program 261 for causing the CPU 251 to execute various processes. The program 261 is application software that can be executed by the CPU 251.
[0030] The CPU 251 executes the program 261 recorded in the HDD 254, thereby enabling it to execute information processing and control processing, which will be described later. Furthermore, the CPU 251 executes the program 261 to control the camera 211 and acquire image data I1 from the camera 211. The recording disk drive 255 can read out various data, programs, etc., recorded in the recording disk 262.
[0031] In the first embodiment, the non-transient recording medium readable by a computer is the HDD 254, and the program 261 is recorded in the HDD 254, but this is not limited thereto. The program 261 may be recorded in any recording medium as long as it is a non-transient recording medium readable by a computer. As a recording medium for supplying the program 261 to a computer, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a magnetic tape, a non-volatile memory, etc. can be used. In addition, the storage device included in the information processing device 200 is the HDD 254, but this is not limited thereto, and the storage device may be an SSD (Solid State Drive).
[0032] The control device 400 includes a CPU 451, which is an example of a processor. The CPU 451 executes a program 461 to function as a robot control unit 450, which will be described later. The control device 400 also includes a ROM 452, a RAM 453, and a HDD 454 as storage units. The control device 400 also includes a recording disk drive 455, and an interface 456, which is an input / output interface. The CPU 451, the ROM 452, the RAM 453, the HDD 454, the recording disk drive 455, and the interface 456 are connected to each other via a bus so that data can be transferred between them.
[0033] The interface 456 of the control device 400 is connected to the robot 100 , the information processing device 200 , a display 402 , a keyboard 403 , and a mouse 404 .
[0034] The ROM 452 stores a basic program related to the operation of the computer. The RAM 453 is a storage device that temporarily stores various data such as the results of the calculation processing of the CPU 451. The HDD 454 records the results of the calculation processing of the CPU 451 and various data acquired from the outside, and also records (stores) a program 461 for causing the CPU 451 to execute various processes. The program 461 is application software that can be executed by the CPU 451.
[0035] The CPU 451 executes a program 461 recorded in the HDD 454 to execute control processing, thereby making it possible to control the operation of the robot 100 in Fig. 1. The recording disk drive 455 can read out various data, programs, etc. recorded in the recording disk 462.
[0036] In the first embodiment, the non-transient recording medium readable by a computer is the HDD 454, and the program 461 is recorded in the HDD 454, but this is not limited thereto. The program 461 may be recorded in any recording medium as long as it is a non-transient recording medium readable by a computer. As a recording medium for supplying the program 461 to a computer, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a magnetic tape, a non-volatile memory, etc. can be used. In addition, the storage device included in the control device 400 is the HDD 454, but this is not limited thereto, and the storage device may be an SSD.
[0037] The control device 400 or the information processing device 200 may be connected to a network. The camera 211 and the information processing device 200, the information processing device 200 and the control device 400, or the control device 400 and the robot 100 may be connected via a network.
[0038] 5 is a functional block diagram of a control unit 550 according to the first embodiment. The CPU 251 of the information processing device 200 executes a program 261, and the CPU 451 of the control device 400 executes a program 461, whereby these multiple CPUs 251, 451 function as the control unit 550. Note that in the first embodiment, the multiple CPUs 251, 451 function as the control unit 550, but this is not limiting, and the functions of the control unit 550 may be realized by one computer, i.e., one CPU.
[0039] The control unit 550 has an information processing unit 250 in which a CPU 251 functions, and a robot control unit 450 in which a CPU 451 functions. The information processing unit 250 includes an image processing unit 212, a detection unit 213, a height measurement unit 214, a priority order assignment unit 215, a position measurement unit 216, and a holding point calculation unit 217. The robot control unit 450 includes an avoidance operation control unit 410 and a main control unit 420. The avoidance operation control unit 410 includes an interference determination unit 411 and a workpiece presence / absence determination unit 412.
[0040] The main control unit 420 controls the robot 100 to hold the multiple workpieces W on the tray 20 one by one, and to align and arrange the workpieces W held by the robot 100 on the mounting table 30.
[0041] The image processing unit 212 can send an imaging command to the camera 211 to cause the camera 211 to capture an image. The image processing unit 212 is configured to be able to acquire image data I1 generated by the camera 211, and is configured to be able to process the acquired image data I1. The image data I1 is, for example, a grayscale image. The grayscale image may be a monochrome image or a color (for example, RGB) image. In addition, any image may be used as long as it can digitally digitize the shape characteristics of the workpiece W. For example, the image data I1 may be a binary image or an edge image.
[0042] FIG. 6 is an explanatory diagram of workpieces W stacked in bulk according to the first embodiment. The detection unit 213 detects a search area in the image data I1 that includes an image of a workpiece W1 that is not overlapped with another workpiece W or that is slightly overlapped with another workpiece W, among a plurality of workpieces W stacked in bulk, as shown in FIG. 6. The search area is, for example, an area that includes an image of a workpiece W1 whose exposure degree is greater than a predetermined value. The detection unit 213 then obtains information on the state of the workpiece W1 in the search area. The information on the state of the workpiece W1 includes, for example, information on the position and orientation of the workpiece W1. The information on the position and orientation of the workpiece W1 includes information on the placement position and front and back of the workpiece W, as shown in FIG. 2(c).
[0043] The height measuring unit 214 measures the height of the workpiece W1 included in the search area detected by the detection unit 213 relative to a reference position, for example, the height relative to the inner bottom surface 21 of the tray 20. The height of the workpiece W1 may be calculated, for example, from the size of the outline corresponding to the workpiece W1 in the image data I1, or may be measured by a distance sensor (not shown) for measuring height provided around the robot 100.
[0044] When two or more search areas are detected from the image data I1, the prioritization unit 215 prioritizes two or more workpieces W1 corresponding to the two or more search areas in order of ease of picking up by the robot 100. As an example, the prioritization unit 215 prioritizes two or more workpieces W1 in the order of height.
[0045] The position measurement unit 216 performs a matching process such as pattern matching on the image of the search area to obtain three-dimensional information on the position and orientation of the workpiece W1. The matching process may be performed using CAD data indicating ridge line information of the workpiece W1 for the image of the search area. For example, when the image of the search area is a grayscale image, the position measurement unit 216 may perform pre-processing such as edge detection on the grayscale image, obtain a score indicating the degree of match by comparing line segment information obtained by the pre-processing with line segment information of the CAD data, and obtain the position and orientation of the workpiece W1 based on the score. The CAD data may be stored in advance in a storage device such as the HDD 254.
[0046] The holding point calculation unit 217 determines the two-dimensional position of the holding point of the workpiece W1 in the working space R1 by comparing the information on the position and orientation of the workpiece W1 derived by the position measurement unit 216 with the information on the holding point of the workpiece W1 stored in a storage device such as the HDD 254. The height position corresponding to the holding point of the workpiece W1 is a position detected by distance sensors 305 and 306 described later.
[0047] 7(a) to 7(c) are explanatory diagrams showing the relationship between the holding point 40 and the holding start position 41 according to the first embodiment. The holding point calculation unit 217 obtains the two-dimensional position of the holding point 40 shown in FIG. 7(a) and the holding start position 41 corresponding to the holding point 40 for the workpiece W1. The holding start position 41 is a three-dimensional position in the working space R1 at which the two fingers 122 of the robot hand 120 start the holding operation. The holding start position 41 includes position information of two points 411, 412 located at the ends of a line segment passing through the holding point 40, and is set, for example, to the outer periphery position of the boss portion of the workpiece W1 shown in FIG. 7(b) or the outer periphery position of the outline of the workpiece W1 shown in FIG. 7(c). The line segment connecting the two points 411, 412 included in the holding start position 41 is a trajectory when the two fingers 122 perform a closing operation. The position of the two fingers 122 when holding the workpiece W is closer to the holding point 40 than the holding start position 41.
[0048] 8(a) and 8(b) are explanatory diagrams of a method for determining the holding point 40 and the holding start position 41 according to the first embodiment. As shown in FIG. 8(a), when the holding point 40 is on the boss portion, if the clearance value between the finger portion 122 and the boss portion of the workpiece W1 is C and the outer width of the boss portion is D1, the distance between the two points 411, 412 indicating the holding start position 41 is "D1+2×C". Also, as shown in FIG. 8(b), when the robot hand 120 is made to hold the outer shape of the workpiece W, if the clearance value between the finger portion 122 and the outer shape of the workpiece W1 is C and the outer width of the workpiece W1 is D2, the distance between the two points 411, 412 indicating the holding start position 41 is "D2+2×C". The clearance value C can be set by the user and is set within a range of 1 to 3 mm, for example, 2 mm.
[0049] The holding point calculation unit 217 can set a plurality of holding points 40 in the workpiece W1. The holding point calculation unit 217 can also set a plurality of holding start positions 41 for one holding point 40.
[0050] The information processing unit 250 can output information on the position, posture, shape and height of the workpiece W1 to be held, as well as information on the holding point 40 and holding start position 41, to the robot control unit 450.
[0051] The main control unit 420 of the robot control unit 450 controls the robot arm 101 to move the robot hand 120 to a position above the workpiece W1 to be held, based on the information on the position and posture of the workpiece W1 and the information on the holding point 40 acquired from the information processing unit 250. Then, the main control unit 420 controls the robot arm 101 to move the robot hand 120 toward the holding point 40 and approach the workpiece W1. In other words, the main control unit 420 controls the robot arm 101 to move predetermined portions of the two finger units 122 toward the holding start position 41. Here, the workpiece W1 to be held is the workpiece W1 with the highest priority.
[0052] 9(a) and 9(b) are explanatory diagrams of the approaching operation according to the first embodiment. The moving direction of the robot hand 120 when approaching the workpiece W1 may be the vertical direction, −Z0 direction, as shown in FIG. 9(a), or may be a diagonal direction relative to the −Z0 direction, or may be a straight line connecting the camera 211 and the workpiece W1, as shown in FIG. 9(b), or may be a direction other than these directions. In this case, the direction in which the tip of the finger portion 122 faces may be a direction intersecting the moving direction of the robot hand 120, but is preferably the moving direction of the robot hand 120.
[0053] The interference determination unit 411 determines whether the robot hand 120 interferes with the object using a measurement result of a sensor that measures the distance between the robot hand 120 and the object. In this embodiment, the distance is measured as the state between the robot hand 120 and the object, but this is not limited to the above. For example, relative or absolute position information between the robot hand 120 and the object based on the position of the robot hand 120 and the position of the object may be measured as the state between the robot hand 120 and the object. When the interference determination unit 411 determines that the robot hand 120 interferes with the object, the avoidance operation control unit 410 controls the robot 100 to perform an avoidance operation. The sensor that measures the distance between the robot hand 120 and the object may be a proximity sensor, a distance sensor, an image sensor, a camera, or other sensor. The sensor may be attached to any of the robot hand 120, the robot arm 101, and members other than the robot 100.
[0054] As a suitable example, a case in which a distance sensor is attached to the finger portion 122 of the robot hand 120 will be described below.
[0055] 10 is a perspective view of the robot hand 120 according to the first embodiment. A coordinate system Σ is defined with the robot hand 120 as a reference. In the coordinate system Σ, the direction parallel to the longitudinal direction of the finger portion 122 is the Z direction, the direction perpendicular to the Z direction and parallel to the opening and closing direction of the two finger portions 122 is the X direction, and the direction perpendicular to the Z direction and the X direction is the Y direction. The two finger portions 122 are claw-shaped members extending in the X direction from the main body portion 121, and are arranged side by side in the X direction.
[0056] A distance sensor 303 is disposed on one finger 1221 of two fingers 122 of the robot hand 120, and a distance sensor 304 is disposed on the other finger 1222 of the two fingers 122. Each of the distance sensors 303 and 304 is an example of a first sensor. The distance sensor 303 measures the distance between the finger 1221 and an object (not shown) in the Z direction. The distance sensor 304 measures the distance between the finger 1222 and an object (not shown) in the Z direction. The Z direction is an example of a predetermined direction.
[0057] In the first embodiment, the distance sensor 303 is provided at the tip 12211 of the finger 1221 in the Z direction. As a result, the distance sensor 303 measures the distance in the Z direction from the tip 12211 of the finger 1221 to an object (not shown) facing the tip 12211. Moreover, the distance sensor 304 is provided at the tip 12212 of the finger 1222 in the Z direction. As a result, the distance sensor 304 measures the distance in the Z direction from the tip 12212 of the finger 1222 to an object (not shown) facing the tip 12212.
[0058] Furthermore, a distance sensor 305 is disposed on a finger portion 1221 of the robot hand 120, and a distance sensor 306 is disposed on a finger portion 1222 of the robot hand 120. The distance sensors 305 and 306 are sensors for detecting whether or not a workpiece W1 is present between the two fingers 122. That is, the distance sensors 305 and 306 are sensors for detecting whether or not the finger portions 122 of the robot hand 120 can start holding the workpiece W1. Each of the distance sensors 305 and 306 is an example of a second sensor.
[0059] The distance sensor 305 is provided on the holding portion 12221 of the finger portion 1221. The distance sensor 306 is provided on the holding portion 12222 of the finger portion 1222. The holding portions 12221 and 12222 are portions that come into contact with the workpiece W1 when the robot hand 120 holds the workpiece W1 and apply a holding force to the workpiece W1. The distance sensor 305 is a sensor that measures the distance in the X direction from the holding portion 12221 of the finger portion 1221 to an object (not shown) facing the holding portion 12221. The distance sensor 306 is a sensor that measures the distance in the X direction from the holding portion 12222 of the finger portion 1222 to an object (not shown) facing the holding portion 12222.
[0060] Each of the distance sensors 303 to 306 may be a ToF (Time of Flight) sensor or a proximity sensor, and is a proximity sensor in the first embodiment. The distance sensor 303 in the first embodiment measures the distance between the distance sensor 303 and an object, and the distance sensor 304 measures the distance between the distance sensor 304 and an object.
[0061] Each of the distance sensors 303-306 has a transmitting section that irradiates energy and a receiving section that receives the energy reflected by an object. The energy may be light, ultrasonic waves, a magnetic field, an electric field, an electromagnetic field, etc., and is preferably light. The light may be laser light. Each of the distance sensors 303-306 is, for example, a photoreflector, and the transmitting section is, for example, an LED that emits light as the energy. The receiving section is a phototransistor that receives the light. It is preferable that the LED emits infrared light as the light. This is because it is less susceptible to disturbance light.
[0062] When the light emitted by the LED is irradiated onto the workpiece W1, it is reflected by the workpiece W1. The reflected light is received by a phototransistor to measure the distance. The phototransistor outputs the brightness of the reflected light according to the distance as a current. The current is measured as a voltage via a resistor. The measurable distance is generally 4 mm or less.
[0063] Each of the distance sensors 303, 304 transmits the distance measurement result, which is the detection value, to the interference determination unit 411. Each of the distance sensors 305, 306 transmits the distance measurement result, which is the detection value, to the workpiece presence / absence determination unit 412. A threshold value can be set for each of the distance sensors 303 to 306. For example, a threshold value TH1 is set for each of the distance sensors 303, 304, and a threshold value TH2 is set for each of the distance sensors 305, 306.
[0064] The distance sensors 303 and 304 measure distance by irradiating light in the optical axis direction, which is the fingertip direction, which is the +Z direction shown in Fig. 10, and receiving reflected light. The distance sensor 305 measures distance by irradiating light in the optical axis direction, which is the closing direction of the finger part 1221, which is the +X direction shown in Fig. 10, and receiving reflected light. The distance sensor 306 measures distance by irradiating light in the optical axis direction, which is the closing direction of the finger part 1222, which is the -X direction shown in Fig. 10, and receiving reflected light. The +Z direction is the positive direction in the Z direction. The -Z direction is the opposite direction to the +Z direction and is the negative direction in the Z direction.
[0065] The attachment positions of the distance sensors 305, 306 are, for example, 4.5 mm in the -Z direction from the tip of the finger portion 122. Since the attachment positions of the distance sensors 305, 306 are away from the tip of the finger portion 122, the workpiece W1 is held at a position away from the tip of the finger portion 122. Note that the attachment positions of the distance sensors 305, 306 are not limited to 4.5 mm in the -Z direction from the tip of the finger portion 122.
[0066] 11(a) to 11(c) are diagrams illustrating a state in which interference is detected by the distance sensors 303 and 304 according to the first embodiment.
[0067] 11(a) shows a case where the positional relationship between the holding point 40 of the workpiece W1 and the finger portion 122 of the robot hand 120 is shifted due to the workpiece W being displaced by being displaced due to the collapse of the randomly piled workpieces W or the position of the workpiece W1 being displaced due to vibration. In this case, the workpiece W1 to be held is an object that may interfere with the robot hand 120. When the finger portion 122 approaches the workpiece W1, the interference determination unit 411 determines that the distance measurement result of the distance sensor 303 is equal to or less than the threshold value TH1 before the finger portion 122 interferes with the boss portion of the workpiece W1.
[0068] 11(b) illustrates a case where a workpiece W2 is placed next to the workpiece W1 to be held. In this case, the workpiece W2 next to the workpiece W1 is an object that may interfere with the robot hand 120. When the finger portion 122 approaches the workpiece W1, the interference determination unit 411 determines that the distance measurement result of the distance sensor 303 is equal to or less than the threshold value TH1 before the finger portion 122 interferes with the boss portion of the adjacent workpiece W2.
[0069] 11(c) illustrates a case where the inner bottom surface 21 of the tray 20 is near the workpiece W1 to be held. In this case, the tray 20 is an object that may interfere with the robot hand 120. When the finger portion 122 approaches the workpiece W1, the interference determination unit 411 determines that the distance measurement result of the distance sensor 304 is equal to or less than the threshold value TH1 before the finger portion 122 interferes with the inner bottom surface 21 of the tray 20.
[0070] As described above, before the robot hand 120 interferes with an object, the interference determination unit 411 determines that the distance measurement result of at least one of the distance sensors 303, 304 is equal to or less than the threshold value TH1. The threshold value TH1 is set to, for example, 2 mm.
[0071] FIG. 12 is a diagram showing a state where the robot hand 120 according to the first embodiment is positioned at the holding start position 41. As shown in FIG. 12, the fingers 1221 and 1222 of the robot hand 120 are positioned at the holding start position 41. As shown in FIG. 12, since the workpiece W1 exists between the fingers 1221 and 1222, the workpiece presence / absence determination unit 412 determines that the distance measurement results of the distance sensors 305 and 306 are equal to or less than the threshold value TH2, and a value indicating "workpiece presence" is sent to the main control unit 420. The threshold value TH2 is set so as to satisfy "clearance value C<threshold value TH2" when the robot hand 120 is positioned at the holding start position 41. For example, when C=2 mm, the threshold value TH2 is set to a value greater than 2 mm. In this case, it is preferable that the threshold value TH2 is set to 4 mm or less.
[0072] The work presence / absence determination unit 412 may determine that "work is present" when the distance measurement result of the distance sensor 305 or one of the distance measurement results of the distance sensor 305 is below the threshold value TH2, or when both the distance measurement result of the distance sensor 305 and the distance measurement result of the distance sensor 305 are below the threshold value TH2.
[0073] A series of operations according to the first embodiment will be described with reference to the flowchart of Fig. 13. Fig. 13 is a flowchart of control according to the first embodiment. Fig. 14 is an explanatory diagram of the operations of each step of the flowchart shown in Fig. 13.
[0074] In step S101, the image processing unit 212 causes the camera 211 to capture an image of a predetermined area R0 in which the workpieces W are piled up in bulk.
[0075] Next, in step S102, the image processing unit 212 acquires image data I1 from the camera 211. The image processing unit 212 detects a search area including the workpiece W1 from the acquired image data I1, and recognizes the position, posture, holding point 40, and holding start position 41 of the workpiece W1 based on the search area.
[0076] Next, in step S103, the height measurement unit 214 measures the height of the workpiece W1 in the search area. If two or more search areas are detected from the image data I1, in step S104, the prioritization unit 215 prioritizes the two or more workpieces W1 corresponding to the two or more search areas in order of ease of picking up by the robot 100. For example, the prioritization unit 215 prioritizes the two or more workpieces W1 in descending order of height.
[0077] Next, in step S105, the main control unit 420 selects a work W1 with a priority level i, where i is an integer equal to or greater than 1, and the initial value of i is 1. i=1 has the highest priority level, and the larger the value of i, the lower the priority level.
[0078] As described above, in steps S101 to S105, the main control unit 420 selects the workpiece W1 to be held from among the multiple workpieces W based on the image data I1.
[0079] Next, in step S106, the main control unit 420 controls the robot arm 101 so that the robot hand 120 moves above the holding point 40. At this time, the tip of the finger portion 122 of the robot hand 120 is directed in the -Z0 direction, that is, the moving direction in which the robot hand 120 approaches the workpiece W1. Next, in step S107, the main control unit 420 controls the robot arm 101 so that the robot hand 120 approaches the holding point 40. That is, the main control unit 420 controls the robot arm 101 so that the finger portion 122 of the robot hand 120 approaches the holding start position 41. This starts an approach operation in which the robot hand 120 approaches the workpiece W1 to be held.
[0080] In this embodiment, the limit value of the movement amount of the robot hand 120 in the approaching operation can be set arbitrarily. In this embodiment, the limit value is the movement amount of the robot hand 120 until the finger portion 122 of the robot hand 120 contacts the inner bottom surface 21 of the tray 20. In this embodiment, the limit value is set to the movement amount until the finger portion 122 contacts the inner bottom surface 21 of the tray 20, but is not limited to this. For example, a position with a predetermined distance from the inner bottom surface 21 of the tray 20 may be set as the limit value. The movement amount of the robot hand 120 may be detected by providing an encoder at each joint of the robot arm 101 and acquiring the movement amount by the encoder, or may be acquired by providing a camera separately for acquiring the movement amount of the robot hand 120.
[0081] The interference determination unit 411 acquires the distance measurement results from each of the distance sensors 303 and 304 while the robot 100 is performing the approaching operation. When a predetermined condition based on the distance measurement result is satisfied, the avoidance operation control unit 410 causes the robot 100 to perform an avoidance operation to avoid the robot hand 120 from interfering with an object. In the first embodiment, in step S108 during the approaching operation, the interference determination unit 411 determines the threshold value TH1 for the distance measurement results of the distance sensors 303 and 304. That is, in the first embodiment, the predetermined condition based on the distance measurement result is satisfied when the distance measured by any of the distance sensors 303 and 304 is equal to or less than the threshold value TH1. When the predetermined condition based on the distance measurement result is not satisfied, the distance measured by any of the distance sensors 303 and 304 exceeds the threshold value TH1.
[0082] That is, in step S108, the interference determination unit 411 determines whether the robot hand 120 will interfere with the object, assuming that the robot hand 120 continued its approach motion to approach the workpiece W1 before the robot hand 120 interferes with the object.
[0083] During the approach operation, if step S108 is YES, that is, if the interference determination unit 411 determines that the distance is less than or equal to the threshold TH1, in step S109, the avoidance operation control unit 410 causes the robot 100 to perform an avoidance operation to prevent the robot hand 120 from interfering with the object.
[0084] The avoidance operation is preferably a movement operation that moves the robot hand 120 in a direction different from the movement direction (-Z0 direction) of the robot hand 120 when the robot 100 is made to perform an approach operation. The avoidance operation (movement operation) in the first embodiment is a retreat operation that retreats the robot hand 120 in the direction (+Z0 direction) opposite to the movement direction (-Z0 direction).
[0085] That is, in the first embodiment, the avoidance operation control unit 410 controls the robot arm 101 to stop the approaching operation of the robot hand 120, and then controls the robot arm 101 to retreat the robot hand 120 above the workpiece W1. This makes it possible to avoid the robot hand 120 interfering with the workpiece W1 and objects such as the workpieces W and the tray 20 around the workpiece W1.
[0086] The direction in which the robot hand 120 retreats is preferably the direction opposite to the direction in which the robot hand 120 approaches the workpiece W1, for example, a direction perpendicular to the inner bottom surface 21 of the tray 20. In addition, the retreat position of the robot hand 120 is preferably a position higher than the height of the workpiece W1, for example, a position at a predetermined height from the inner bottom surface 21.
[0087] After the robot hand 120 is withdrawn, in step S109, the main control unit 420 increments the priority i (i=i+1), returns to the process of step S105, and sets another workpiece to be held. That is, the main control unit 420 sets the workpiece with the next highest priority as the workpiece W1 to be held. Note that, although it is possible to return to the process of step S101 and have the camera 211 capture an image again, it is possible to move to the operation of holding the next workpiece W1 in a quick cycle by returning to the process of step S105.
[0088] During the approach operation, if step S108 is NO, that is, if the interference determination unit 411 determines that the distance exceeds the threshold TH1, the process proceeds to step S110. In other words, if a predetermined condition based on the distance measurement result is not satisfied, the process proceeds to step S110.
[0089] In step S110, the workpiece presence / absence determination unit 412 determines whether or not a workpiece is present. If step S110 is NO, that is, if the workpiece presence / absence determination unit 412 determines that a workpiece is not present, the interference determination unit 411 returns to the process of step S108, and the main control unit 420 continues the approaching operation to the workpiece W1. If the workpiece presence / absence determination unit 412 determines that a workpiece is present, the robot hand 120 has reached the holding start position 41, and the main control unit 420 proceeds to the process of the next step S111.
[0090] In addition, when the robot hand 120 continues to approach the workpiece W1, if the robot hand 120 reaches the limit value but does not detect the workpiece W1 in step S110, the avoidance operation control unit 410 determines that some error has occurred and stops the robot 100. Then, the control flow is terminated. When stopping the robot 100, the avoidance operation control unit 410 may retreat the robot hand 120 in the direction opposite to the moving direction of the robot hand 120 during the approach operation, and then stop the robot 100.
[0091] When it is determined that a workpiece is present in the workpiece presence / absence determination, that is, when the robot hand 120 reaches the holding start position 41 where the holding of the workpiece W1 is started, in step S111, the main control unit 420 stops the approaching operation. Then, the main control unit 420 starts a holding operation to make the robot hand 120 hold the workpiece W1 to be held. After making the robot hand 120 perform the holding operation to make the robot hand 120 hold the workpiece W1, the main control unit 420 controls the robot arm 101 to make the robot 100 transport the workpiece W1 to the mounting table 30. After that, the main control unit 420 returns to the process of step S101. By repeatedly executing the operations of the above steps S101 to S111, the multiple workpieces W piled in a random order on the tray 20 are arranged in a line on the mounting table 30 one by one.
[0092] As described above, according to the first embodiment, when one workpiece W1 among the randomly piled workpieces W is held by the robot hand 120, the robot hand 120 is moved closer to the workpiece W1 to determine whether the robot hand 120 will interfere with an object. The object includes the workpiece W1 to be held, the workpieces W around the workpiece W1, the tray 20, and the like. When it is determined that the robot hand 120 will interfere with the object, that is, the measurement result of the distance is equal to or less than the threshold value TH1, the robot arm 101 operates to prevent the robot hand 120 from interfering with the object. This allows the robot hand 120 to hold the workpiece W1 without interfering with the object, and the success rate of the robot hand 120 holding the workpiece W1 to be held can be increased.
[0093] In addition, that is, when it is determined that the distance measurement result exceeds the threshold value TH1, the robot hand 120 can hold the workpiece W1 without interfering with an object, for example, without collapsing the bulk workpieces W. That is, the success rate of the robot hand 120 holding the workpiece W1 can be increased.
[0094] In addition, since the robot hand 120 is prevented from interfering with the workpiece W, the collapse of the bulk workpieces W and damage to the workpieces W, the robot hand 120, or objects around the workpieces W are reduced.
[0095] In addition, since the collapse of the randomly piled workpieces W can be reduced, the processing time when the robot hand 120 re-approaches the workpieces W can be shortened.
[0096] Furthermore, the determination in step S108 is performed at a predetermined control period during the approach operation of bringing the robot hand 120 closer to the workpiece W1, until the robot hand 120 reaches the target holding start position 41. Therefore, during the approach operation, whether or not the robot hand 120 will interfere with the workpiece W1 is determined almost in real time, so that the robot hand 120 can be reliably prevented from interfering with an object, and the success rate of the robot hand 120 holding the workpiece W1 can be increased.
[0097] [Second embodiment] Next, a second embodiment will be described. In the second embodiment, the description of matters common to the first embodiment will be simplified or omitted, and the following will describe in detail matters different from the first embodiment. In the second embodiment, when the distance measurement result of either one of the distance sensors 303, 304 becomes equal to or smaller than the threshold value TH1, the interference determination unit 411 performs a correction operation to change the holding start position 41.
[0098] FIG. 15 is an explanatory diagram of distance sensors 303, 304 according to the second embodiment. Each of the distance sensors 303, 304 irradiates light over an irradiation range 50, which is an example of a predetermined range, in a radial direction as a predetermined direction. In the second embodiment, each of the distance sensors 303, 304 irradiates light so as to spread in the X direction or scan in the X direction. The radial direction is a direction within a predetermined angle with respect to the +Z direction. The irradiation range 50 is a range in the X direction at a predetermined position away from the distance sensor 303, 304 in the +Z direction. In the second embodiment, the X direction is the opening and closing direction of the two finger parts 122. The irradiation range 50 is a range wider than the width (hand width) 53 in the X direction of the finger parts 122, which is an example of a predetermined width. In the following, a case where light is linearly irradiated in the X direction will be described as an example, but it may be irradiated in a planar manner in the XY direction. Hereinafter, "width" refers to the width in the X direction.
[0099] Each distance sensor 303, 304 receives light reflected from an object and measures the distance between the robot hand 120 and the object in the irradiation range 50. Each distance sensor 303, 304 can detect an area in the irradiation range 50 where interference is detected, i.e., an area 51 where the measured distance is equal to or less than a threshold value TH1, and an area where interference is not detected, i.e., an area 52 where the measured distance exceeds the threshold value TH1. The area 51 is an example of a first area, and the area 52 is an example of a second area. For example, a laser displacement sensor with a built-in camera or a two-dimensional laser displacement sensor can be used as the distance sensor 303, 304.
[0100] When at least one of the distance sensors 303, 304 detects an area 51 that is equal to or smaller than a threshold value TH1, the interference determination unit 411 determines that the robot hand 120 interferes with an object. In addition, the interference determination unit 411 can obtain a value [mm] indicating the width of the areas 51, 52 in the X direction from the distance sensors 303, 304.
[0101] Area 51 can be at least a part of the illuminated area 50. Area 52 is the area of the illuminated area 50 other than area 51. If area 51 does not exist, area 52 coincides with the illuminated area 50. If area 51 coincides with the illuminated area 50, area 52 does not exist.
[0102] A series of operations according to the second embodiment will be described with reference to the flowchart of Fig. 16. Fig. 16 is a flowchart of control according to the second embodiment. In Fig. 16, the processing of steps S201 to S207 is similar to the processing of steps S101 to S107 in Fig. 13, and therefore description thereof will be omitted.
[0103] The interference determination unit 411 acquires distance measurement results from each of the distance sensors 303, 304 while the robot 100 is performing an approach operation in which the robot hand 120 approaches the workpiece W1. When a predetermined condition based on the distance measurement result is satisfied, the avoidance operation control unit 410 causes the robot 100 to perform an avoidance operation to avoid the robot hand 120 from interfering with an object.
[0104] In the second embodiment, during the approaching operation, in step S208, the interference determination unit 411 determines the threshold value TH1 for the distance measurement results of the distance sensors 303, 304. That is, in the second embodiment, the predetermined condition based on the distance measurement results is satisfied when the area 51 is detected by either of the distance sensors 303, 304. The predetermined condition based on the distance measurement results is not satisfied when the area 51 is not detected by either of the distance sensors 303, 304.
[0105] That is, in step S208, the interference determination unit 411 determines whether the robot hand 120 will interfere with the object, assuming that the robot hand 120 continued its approach motion to approach the workpiece W1 before the robot hand 120 interferes with the object.
[0106] During the approaching operation, if step S208 is YES, that is, if a region 51 where the distance is equal to or less than the threshold value TH1 is detected, the movement of the robot hand 120 is temporarily stopped, and the process proceeds to step S209. Then, in steps S209 to S211, the avoidance operation control unit 410 causes the robot 100 to perform an avoidance operation to avoid the robot hand 120 interfering with an object.
[0107] The avoidance operation is preferably a movement operation in which the robot hand 120 is moved in a direction different from the movement direction (-Z0 direction) of the robot hand 120 when the robot 100 is made to perform the approach operation.
[0108] The avoidance operation (movement operation) in the second embodiment includes an evacuation operation for evacuating the robot hand 120 in the direction (+Z0 direction) opposite to the movement direction (-Z0 direction), and a correction operation for correcting the position or posture of the robot hand 120. In the second embodiment, the avoidance operation control unit 410 selectively causes the robot 100 to perform either the evacuation operation or the correction operation depending on the width of the area 51 or the width of the area 52. Also, in the second embodiment, the correction operation is an operation for correcting the position of the robot hand 120.
[0109] More specifically, in step S209, the avoidance operation control unit 410 determines whether the area 51 is detected by only one of the distance sensors 303, 304 and whether the width of the area 52 other than the area 51 exceeds the hand width 53.
[0110] 17(a) and 17(b) are explanatory diagrams of the determination in step S209 according to the first embodiment. If step S209 is NO, for example, if the width of area 52 is equal to or smaller than hand width 53 as shown in Fig. 17(a), or if area 51 is detected by both distance sensors 303 and 304 as shown in Fig. 17(b), in step S210, the avoidance operation control unit 410 causes the robot 100 to perform an escape operation.
[0111] In the case of Fig. 17(a), it is assumed that the position or posture of the workpiece W1 has changed significantly, and it is assumed that it is difficult for the robot hand 120 to hold the workpiece W1 even if the position of the robot hand 120 is corrected. Also, in the case of Fig. 17(b), it is assumed that it is difficult for the robot hand 120 to hold the workpiece W1 no matter in which direction the robot hand 120 is moved. That is, when a predetermined condition based on the distance measurement results of both of the multiple sensors 303, 304 is established, the avoidance operation control unit 410 causes the robot 100 to perform an evacuation operation to evacuate the robot hand 120. In this way, in either case, it is preferable that the avoidance operation control unit 410 causes the robot 100 to perform an evacuation operation.
[0112] After the robot hand 120 is retracted, in step S209, the main control unit 420 increments the priority i (i=i+1), returns to the process of step S205, and sets another workpiece to be held. That is, the main control unit 420 sets the workpiece with the next highest priority as the workpiece W1 to be held. Note that, although it is possible to return to the process of step S201 and have the camera 211 capture an image again, it is possible to move to the operation of holding the next workpiece W1 in a quick cycle by returning to the process of step S205.
[0113] If step S209 is YES, that is, if the width of the area 52 exceeds the hand width 53, in step S211, the avoidance operation control unit 410 causes the robot 100 to perform a corrective operation. By causing the robot 100 to perform a corrective operation, it is possible to transition to a holding operation again in a quick cycle.
[0114] After that, the main control unit 420 causes the robot 100 to perform an approaching operation to bring the robot hand 120 closer to the workpiece W1 again, and proceeds to the process of step S212. The approaching movement amount [mm] at this time may be a designated value, or the robot may be allowed to approach until the interference determination unit 411 determines interference again. The processes of steps S212 and S213 are similar to the processes of steps S110 and S111 in FIG.
[0115] In step S212, the workpiece presence / absence determination unit 412 determines whether or not a workpiece is present based on the detection values of the distance sensors 305 and 306. If it is determined that no workpiece is present, the process returns to step S208, and the operation of approaching the workpiece W1 continues. If it is determined that a workpiece is present, the process proceeds to step S213. In step S213, the main control unit 420 commands the robot hand 120 to perform a holding operation.
[0116] If the robot hand 120 continues to approach the workpiece W1 and the robot hand 120 reaches the limit value but does not detect the workpiece W1 in step S212, the avoidance operation control unit 410 determines that some error has occurred and stops the robot 100. Then, the control flow is terminated. When stopping the robot 100, the avoidance operation control unit 410 may stop the robot 100 after retracting the robot hand 120 in the direction opposite to the moving direction of the robot hand 120 during the approach operation.
[0117] The correction operation will be specifically described below. Figures 18(a) and 18(b) are explanatory diagrams of the correction operation according to the second embodiment. Figures 18(a) and 18(b) show how the avoidance operation control unit 410 changes the holding start position 41 of the robot hand 120.
[0118] Due to imaging errors of the camera 211 or the collapse of the workpiece W after imaging, as shown in Figure 18 (a), the distance between the robot hand 120 (distance sensor 303) and the workpiece W1 becomes less than the threshold value TH1, and the robot hand 120 is about to interfere with the workpiece W1.
[0119] The avoidance operation control unit 410 compares the area 52 with the hand width 53, and if the area 52 is larger than the hand width 53, it operates the robot arm 101 so that the fingers 122 of the robot hand 120 move to a position facing the area 52, i.e., a position above the area 52, as shown in Fig. 18(b), and sets a new holding start position 41'. The correction amount [mm] at this time is set to a correction amount Δx, and the position of the robot hand 120 is corrected by linearly moving the robot hand 120 in the X direction.
[0120] As described above, according to the second embodiment, the robot hand 120 can avoid interference with an object, and the position of the robot hand 120 is corrected in the correction operation, so that the success rate of holding the workpiece W1 by the robot hand 120 can be increased. Also, the processing time can be shortened compared to the case where the robot 100 is made to perform the retraction operation of retracting the robot hand 120. Also, the correction operation can increase the number of pickable workpieces W1 among the bulk piled workpieces W, so that the probability of successfully transporting all the workpieces W in the tray 20 is improved.
[0121] Modifications of the second embodiment are described below. Fig. 19(a) and Fig. 19(b) are explanatory diagrams of Modification 2 of the second embodiment, and Fig. 19(c) is an explanatory diagram of Modification 3 of the second embodiment. In the above-mentioned second embodiment, the energy of each of the distance sensors 303, 304 is radiated so as to be wider than the hand width 53 of the finger portion 122, and the irradiation range 50 is wider than the hand width 53 of the finger portion 122, but this is not limited to the above. The energy of each of the distance sensors 303, 304 may be radiated with a width equal to or smaller than the hand width 53 of the finger portion 122, and the irradiation range 50 may be equal to or smaller than the hand width 53 of the finger portion 122.
[0122] The two finger portions 122 have the same width. In addition, the width of the light irradiated by the distance sensors 303, 304, i.e., the width of the irradiation range 50, is the same. In the distance sensors 303, 304 of the second modification, the width of the detected area 51 does not become larger than the hand width 53. For this reason, a control different from that in the second embodiment is required.
[0123] First, the second modification will be described. As shown in FIG. 19(a), the area 52 is narrower than the hand width 53. In the second modification, when the area 51 is detected by only one of the distance sensors 303 and 304, the avoidance operation control unit 410 operates the robot arm 101 so that the finger portion 122 of the robot hand 120 moves to a position facing the area 52 other than the area 51. As shown in FIG. 19(b), the avoidance operation control unit 410 moves the robot hand 120 linearly until the area 51 disappears in the irradiation range 50. At this time, the correction amount Δx is preferably within the interval 54 / 2 between the two finger portions 122. The correction direction is a direction facing the area 52. This is because if the correction amount Δx is too large, the holding point 40 may not exist within the interval 54.
[0124] As described above, when the area 51 is detected, the avoidance operation control unit 410 causes the robot 100 to perform the correction operation until the area 51 is no longer detected. After the correction operation of the robot hand 120, the main control unit 420 causes the robot 100 to perform an approach operation in which the robot hand 120 approaches the workpiece W1. The approach amount [mm] at this time may be a specified value, or may be until the distance sensors 303, 304 detect interference, or may be until the robot hand 120 reaches the holding start position.
[0125] Next, a third modification will be described. As shown in FIG. 19(c), a region 51 and two regions 52 sandwiching the region 51 may be detected in the irradiation range 50. Since the region 51 is detected between the two regions 52, it may be difficult to eliminate the region 51. In such a case, the avoidance operation control unit 410 causes the robot 100 to perform a retreat operation to retreat the robot hand 120 upward. That is, when the region 51 is sandwiched between the two regions 52 in the irradiation range 50, the avoidance operation control unit 410 causes the robot 100 to perform a retreat operation. After the retreat, as described above, the next workpiece W1 may be set as the holding target. The retreat operation of the third modification can be applied even when the width of the irradiation range 50 is wider than the hand width 53 as in the second embodiment.
[0126] In the first embodiment, a case has been described in which the robot 100 performs the retreat operation without performing the correction operation, but the present invention is not limited to this. In the first embodiment, the robot 100 may perform the correction operation of the second embodiment instead of the retreat operation. In the first embodiment, the robot 100 may selectively perform the retreat operation or the correction operation.
[0127] Furthermore, the second embodiment or the modified example of the second embodiment may be combined with at least one of the first embodiment or the modified example of the first embodiment.
[0128] [Third embodiment] Next, a third embodiment will be described. In the third embodiment, the description of matters common to the first or second embodiment will be simplified or omitted, and below, matters different from the first or second embodiment will be described in detail. In the above-mentioned second embodiment, the case where the robot hand 120 is moved linearly as a correction operation will be described, but in the third embodiment, the case where the robot hand 120 is rotated as a correction operation will be described. That is, the correction operation in the third embodiment is an operation to correct the posture of the robot hand 120.
[0129] 20(a) and 20(b) are explanatory diagrams of the correction operation according to the third embodiment. Note that the flow of control is the same as that explained using the flowchart of FIG. 16 in the second embodiment, and therefore detailed explanation will be omitted. In the third embodiment, the process of step S211 in FIG. 16 is different from that in the second embodiment.
[0130] The distance sensors 303 and 304 in the third embodiment have the same configuration as the distance sensors in the second embodiment or its modified example. In Fig. 20(a), a case is illustrated in which only the distance sensor 303 of the distance sensors 303 and 304 detects the area 51.
[0131] When the interference determination unit 411 determines that the distance between the workpiece W2 and the finger portion 122 (distance sensor 303) is less than or equal to the threshold value TH1, as shown in FIG. 20(a), the avoidance operation control unit 410 causes the robot 100 to perform a corrective operation of rotating the robot hand 120, as shown in FIG. 20(b).
[0132] The avoidance operation control unit 410 rotates the robot hand 120 around the rotation axis 55. The rotation axis 55 is an axis located at the center of the two fingers 122 in the X direction and extends parallel to the Y direction. The rotation direction of the robot hand 120 is the direction of the distance sensor 304 that detects no interference. The amount of rotation correction of the robot hand 120 may be the amount of rotation until the area 51 detected by the distance sensor 303 disappears, that is, until the measured distance exceeds a threshold, or may be a fixed amount.
[0133] It is preferable that the rotation axis 55 is an axis that passes through the center between the tips of the two finger portions 122, but is not limited to this. For example, the rotation axis 55 may be an axis that passes through the main body portion 121, or an axis that passes through one of the finger portions 122.
[0134] In the third embodiment, if the interference determination unit 411 determines that interference will occur, the main control unit 420 causes the robot 100 to perform a corrective operation so that the robot hand 120 rotates, and then causes the robot 100 to perform an approach operation again to bring the robot hand 120 closer to the workpiece W1.
[0135] As described above, according to the third embodiment, the robot hand 120 can avoid interference with an object, and the posture of the robot hand 120 is corrected in the correction operation, so that the success rate of holding the workpiece W1 by the robot hand 120 can be increased. Also, the processing time can be shortened compared to the case where the robot 100 performs the retraction operation for retracting the robot hand 120. Also, the correction operation can increase the number of pickable workpieces W1 among the bulk piled workpieces W, so that the probability of successfully transporting all the workpieces W in the tray 20 is improved.
[0136] The third embodiment or the modified example of the third embodiment may be combined with at least one of the first embodiment, the modified example of the first embodiment, the second embodiment, or the modified example of the second embodiment.
[0137] [Fourth embodiment] Next, a fourth embodiment will be described. In the fourth embodiment, the description of the matters common to the first to third embodiments will be simplified or omitted, and the matters different from the first to third embodiments will be described in detail below.
[0138] FIG. 21(a) is a block diagram of a robot control unit 400A according to the fourth embodiment. In the fourth embodiment, the robot control unit 400A has an avoidance operation control unit 410, a main control unit 420, and a setting unit 600. The setting unit 600 sets an avoidance operation according to a user's selection. The avoidance operation control unit 410 causes the robot 100 to perform the avoidance operation set in the setting unit 600. In the third embodiment, the avoidance operations selectable by the user include the retreat operation described in the first embodiment, the correction operation (position correction operation) for correcting the position of the robot hand 120 described in the second embodiment, and the correction operation (posture correction operation) for correcting the posture of the robot hand 120 described in the third embodiment.
[0139] FIG. 21(b) is an explanatory diagram of a graphical interface (GUI) according to the fourth embodiment. The setting unit 600 displays a user interface image (UI image) UI1 shown in FIG. 21(b) on the display 402 shown in FIG. 3, for example. The UI image UI1 includes a plurality of check boxes B1, B2, and B3 that allow the user to select an avoidance operation, and a decision button B10 that the user can operate. A corresponding avoidance operation is assigned to each of the check boxes B1, B2, and B3. For example, an evacuation operation is assigned to the check box B1, a position correction operation is assigned to the check box B2, and an attitude correction operation is assigned to the check box B3. The user's selection via the UI image UI1 is performed using a pointing device such as the mouse 404.
[0140] The setting unit 600 accepts the selection of an avoidance operation to be performed by the robot 100 via the UI image UI1. For example, when the user selects (checks) the check box B1 and operates the decision button B10, the setting unit 600 sets the retreat operation assigned to the check box B1 as the avoidance operation. Also, for example, when the user selects (checks) the check box B2 and operates the decision button B10, the setting unit 600 sets the position correction operation assigned to the check box B2 as the avoidance operation. Also, for example, when the user selects (checks) the check box B3 and operates the decision button B10, the setting unit 600 sets the posture correction operation assigned to the check box B3 as the avoidance operation.
[0141] Fig. 22 is a flowchart of control according to the fourth embodiment. In Fig. 22, the processing of steps S401 to S408 is similar to the processing of steps S101 to S108 in Fig. 13 or steps S201 to S208 in Fig. 16, and therefore description thereof will be omitted.
[0142] If step S408 is YES, that is, if a predetermined condition based on the distance measurement result is satisfied, in step S409, the avoidance operation control unit 410 determines whether the avoidance operation set in the setting unit 600 is an evacuation operation, a position correction operation, or an attitude correction operation.
[0143] If the avoidance operation set in the setting unit 600 is an escape operation, the avoidance operation control unit 410 proceeds to step S410. If the avoidance operation set in the setting unit 600 is a position correction operation, the avoidance operation control unit 410 proceeds to step S411. If the avoidance operation set in the setting unit 600 is a posture correction operation, the avoidance operation control unit 410 proceeds to step S412.
[0144] In step S410, the avoidance operation control unit 410 causes the robot 100 to perform an evacuation operation in which the robot hand 120 retreats from the workpiece W1. The evacuation operation is as described in the first embodiment. After retreating the robot hand 120, in step S410, the main control unit 420 increments the priority i (i=i+1), returns to the processing of step S405, and sets another workpiece as the holding target. This makes it possible to avoid the robot hand 120 interfering with the workpiece W1 and objects such as the workpieces W and the tray 20 around the workpiece W1.
[0145] In step S411, the avoidance operation control unit 410 causes the robot 100 to perform a position correction operation to correct the position of the robot hand 120. The position correction operation is as described as the correction operation in the second embodiment. After correcting the position of the robot hand 120, the process proceeds to step S413. Steps S413 and S414 are similar to steps S110 and S111 in FIG. 13, respectively, and therefore will not be described.
[0146] In step S412, the avoidance operation control unit 410 causes the robot 100 to perform a posture correction operation to correct the posture of the robot hand 120. The posture correction operation is as described as the correction operation in the third embodiment. After correcting the posture of the robot hand 120, the process proceeds to step S413.
[0147] As described above, according to the fourth embodiment, the user can select the retraction operation according to the workpiece and the equipment conditions. For example, the position correction operation can be performed by actuators of only the XYZ axes. The attitude correction operation can be performed by using a six-axis robot. Note that if the conditions of the equipment to be used are known in advance, the selection of the avoidance operation may be performed automatically.
[0148] In addition, the fourth embodiment or the modified example of the fourth embodiment may be combined with at least one of the first embodiment, the modified example of the first embodiment, the second embodiment, the modified example of the second embodiment, the third embodiment, and the modified example of the third embodiment.
[0149] [Fifth embodiment] Next, a fifth embodiment will be described. In the fifth embodiment, the description of matters common to the first to fourth embodiments will be simplified or omitted, and the following will describe in detail matters different from the first to fourth embodiments.
[0150] 23 is an explanatory diagram of a robot hand 120A according to a fifth embodiment. In the fifth embodiment, a robot hand 120A is applied to a robot instead of the robot hand 120.
[0151] The robot hand 120A is a suction-type robot hand, and includes a suction pad 601 and a suction hand body 603 having an air outlet 602. The outlet 602 of the suction hand body 603 is connected to a vacuum port of a vacuum ejector 15. The robot hand 120A closes the distance between the suction pad 601 and the workpiece W1 and holds them by suction. The vacuum ejector 15 may be provided in a robot system, or may be equipment arranged in a factory or the like. The vacuum ejector 15 operates to suck the workpiece W to the suction pad 601.
[0152] The suction pad 601 is preferably made of a rubber material in order to generate a frictional force between the suction pad 601 and the workpiece W1 being held. The frictional force between the suction pad 601 and the workpiece W1 when the workpiece W1 is suctioned can prevent the workpiece W1 from moving or falling off the suction pad 601 while the robot 100 is transporting the workpiece W1.
[0153] 24(a) and 24(b) are explanatory diagrams of a robot hand 120A according to the fifth embodiment. A distance sensor 303, which is an example of a first sensor, is disposed in the robot hand 120A. The distance sensor 303 may be disposed on the outer periphery of the suction hand main body 603 as shown in FIG. 24(a), or may be disposed inside the suction hand main body 603 as shown in FIG. 24(b). The inside of the suction hand main body 603 is hollow, and a space for installing the distance sensor 303 is secured.
[0154] Fig. 25 is an explanatory diagram of a robot hand 120A according to the fifth embodiment. As shown in Fig. 25, the distance sensor 303 measures the distance between the workpiece W1 and the suction pad 601, which is the tip of the robot hand 120A. If the measured distance is equal to or less than the threshold value TH1, it is determined that interference will occur, and the avoidance operation control unit 410 causes the robot to perform an avoidance operation so that the robot hand 120A does not interfere with the workpiece W1. For example, the avoidance operation control unit 410 causes the robot to perform an escape operation so that the robot hand 120A escapes upward.
[0155] If the workpiece presence / absence determining unit 412 determines that a workpiece is present while the robot hand 120A is approaching the workpiece W1, the main control unit 420 operates the vacuum ejector 15 to cause the robot hand 120A to hold the workpiece W1. The distance sensor 305 for checking the presence or absence of a workpiece may be set on the outer periphery of the suction hand main body 603 like the distance sensor 303, or may be installed inside the suction hand main body 603. Also, the distance sensor 305 may be omitted and the distance may be measured by the distance sensor 303.
[0156] When the robot hand 120A is about to suck and hold the workpiece W1, the robot hand 120A is separated from the workpiece W1. The threshold value TH2 of the distance sensor 305 is set to the distance between the distance sensor 305 and the workpiece W1 when the robot hand 120A is about to suck and hold the workpiece W1. The workpiece presence / absence determination unit 412 determines that a workpiece is present when the distance measured by the distance sensor 305 is equal to or less than the threshold value TH2.
[0157] The vacuum ejector 15 may be operated during the approaching operation. As a result, the robot hand 120A approaches the workpiece W1 while performing the suction operation. The workpiece presence / absence determination unit 412 may determine the presence or absence of a workpiece by reading the change in vacuum pressure when the vacuum ejector 15 is operated, instead of the distance sensor 305. The workpiece presence / absence determination unit 412 may determine the presence or absence of a workpiece by using both the determination based on the threshold value TH2 of the distance sensor 305 and the change in vacuum pressure when the workpiece is sucked. With the above configuration, the robot hand 120A can also suck the workpiece W1 to be held from among the randomly piled workpieces W without interference between the robot hand 120A and the workpiece W1.
[0158] In addition, the fifth embodiment or a variant of the fifth embodiment may be combined with at least one of the first embodiment, the variant of the first embodiment, the second embodiment, the variant of the second embodiment, the third embodiment, the variant of the third embodiment, the fourth embodiment, and the variant of the fourth embodiment.
[0159] The present disclosure is not limited to the above-described embodiments, and many modifications of the embodiments are possible within the technical concept of the present disclosure. Furthermore, the effects described in the present embodiment are merely a list of the most preferable effects resulting from the embodiments of the present disclosure, and the effects of the embodiments of the present disclosure are not limited to those described in the present embodiment.
[0160] In the first to fifth embodiments, the robot arm 101 is described as a vertically multi-jointed robot arm, but the present invention is not limited thereto. The robot arm 101 may be, for example, a horizontally multi-jointed robot arm, a parallel link robot arm, an orthogonal robot, or any other type of robot arm. The present disclosure is also applicable to a machine that can automatically perform operations of extension and contraction, bending and stretching, vertical movement, horizontal movement, or rotation, or a combination of these operations, based on information in a storage device provided in a control device.
[0161] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0162] The disclosure of the above embodiments includes the following sections.
[0163] (Section 1) a robot having a robot arm and a robot hand; a sensor that measures a state of the robot hand and an object in a predetermined direction based on the robot hand; A control unit for controlling the robot, The control unit is The robot is caused to execute an approaching operation for bringing the robot hand closer to a workpiece to be held; acquiring a measurement result from the sensor when the robot is executing the approaching operation; When a predetermined condition based on the measurement result is satisfied, the robot is caused to execute an avoidance operation to avoid interference of the robot hand with the object. A robot system comprising:
[0164] (Section 2) The sensor measures a distance between the robot hand and the object, A case where the predetermined condition based on the measurement result of the distance is satisfied includes a case where the distance measured by the sensor is equal to or smaller than a threshold value. 2. The robot system according to item 1,
[0165] (Section 3) the avoidance action includes a movement action of moving the robot hand in a direction different from a movement direction of the robot hand when the robot is caused to perform the approach action, 3. The robot system according to item 1 or 2,
[0166] (Section 4) The moving operation includes a retracting operation of retracting the robot hand in a direction opposite to the moving direction. Item 4. The robot system according to item 3,
[0167] (Section 5) The control unit sets a workpiece other than the workpiece as the holding target after the robot hand is retracted. 5. The robot system according to item 4,
[0168] (Section 6) The sensor irradiates energy, receives the energy reflected by the object, and measures the distance. 3. The robot system according to item 2,
[0169] (Section 7) The sensor irradiates energy to a predetermined range, receives the energy reflected by the object, and measures the distance within the predetermined range. 3. The robot system according to item 2,
[0170] (Section 8) A case where the predetermined condition based on the measurement result of the distance is satisfied includes a case where the sensor detects a first region in the predetermined range in which the distance is equal to or less than a threshold value. Item 8. The robot system according to item 7, characterized in that:
[0171] (Section 9) the avoidance action includes a movement action of moving the robot hand in a direction different from a movement direction of the robot hand when the robot is caused to perform the approach action, Item 9. The robot system according to item 8, characterized in that:
[0172] (Section 10) The moving operation includes a retreat operation for retreating the robot hand in a direction opposite to the moving direction, and a correction operation for correcting a position or a posture of the robot hand, The control unit causes the robot to perform either the retreat operation or the correction operation depending on a width of the first area or a width of a second area other than the first area in the predetermined range. Item 10. The robot system according to item 9, characterized in that:
[0173] (Section 11) the moving operation includes a retracting operation of retracting the robot hand in a direction opposite to the moving direction, The control unit causes the robot to perform the retreat operation when a width of a second area other than the first area in the predetermined range is equal to or smaller than a predetermined width. Item 10. The robot system according to item 9, characterized in that:
[0174] (Section 12) The moving operation includes a correction operation for correcting a position or a posture of the robot hand, The control unit causes the robot to perform the correction operation when a width of a second region other than the first region in the predetermined range exceeds a predetermined width. Item 9 or 11. The robot system according to item 9 or 11.
[0175] (Section 13) The predetermined range is wider than the predetermined width. 13. The robot system according to item 11 or 12,
[0176] (Section 14) the robot hand has fingers, The predetermined width is the width of the finger portion. Item 14. The robot system according to item 13,
[0177] (Section 15) The moving operation includes a correction operation for correcting a position or a posture of the robot hand, When the first area is detected, the control unit causes the robot to perform the correction operation until the first area is no longer detected. Item 10. The robot system according to item 9, characterized in that:
[0178] (Section 16) the moving operation includes a retracting operation of retracting the robot hand in a direction opposite to the moving direction, The control unit causes the robot to perform the retreat operation when the first area is sandwiched between two second areas in the predetermined range, the distance between which exceeds the threshold value. Item 10. The robot system according to item 9, characterized in that:
[0179] (Section 17) After performing the correction operation, the control unit continues the approaching operation. Item 16. The robot system according to item 10, 12, or 15,
[0180] (Section 18) Further comprising an imaging device for imaging a predetermined area in which a plurality of workpieces are stacked in bulk, The control unit is acquiring an image of the predetermined area from the imaging device; selecting the workpiece to be held from among the plurality of workpieces based on the captured image; 18. The robot system according to any one of items 1 to 17,
[0181] (Section 19) The control unit is Acquire a holding start position at which a holding operation for holding the workpiece to be held is started; The approaching operation includes an operation of moving the robot hand to the holding start position. Item 19. The robot system according to any one of items 1 to 18,
[0182] (Section 20) When the robot hand reaches the holding start position, the control unit stops the approaching operation and causes the robot hand to perform the holding operation. 20. The robot system according to item 19, characterized in that:
[0183] (Section 21) the sensor is a first sensor, The robot hand has a plurality of fingers, Further comprising a second sensor for detecting whether or not the workpiece to be held is present between the plurality of fingers. 21. The robot system according to item 19 or 20,
[0184] (Section 22) The robot hand has fingers, the sensor is provided on the finger portion and measures the distance between the finger portion and the object as the distance; 3. The robot system according to item 2,
[0185] (Section 23) the sensor is provided at a tip of the finger and measures the distance between the tip of the finger and the object as the distance; 23. The robot system according to item 22,
[0186] (Section 24) the energy being light; Item 18. The robot system according to any one of items 6 to 17,
[0187] (Section 25) The light is infrared light. 25. The robot system according to item 24,
[0188] (Section 26) The control unit is displaying, on a display unit, a user interface image for receiving a user's selection of an avoidance operation for avoiding interference of the robot hand with the object; when a predetermined condition based on the measurement result is satisfied, causing the robot to execute the avoidance action in accordance with a selection made by the user via the user interface image; 26. The robot system according to any one of items 1 to 25,
[0189] (Section 27) a robot having a robot hand including a plurality of fingers and a robot arm; a plurality of sensors provided on each of the plurality of finger portions, the sensors measuring a state of the corresponding finger portion and an object in a predetermined direction based on the corresponding finger portion among the plurality of finger portions; A control unit for controlling the robot, The control unit is The robot is caused to execute an approaching operation for bringing the robot hand closer to a workpiece to be held; acquiring measurement results from each of the plurality of sensors when the robot is executing the approaching operation; When a predetermined condition based on the measurement results of any of the plurality of sensors is satisfied, the robot is caused to execute a retraction operation for retracting the robot hand in a direction opposite to a moving direction of the robot hand when the robot is caused to execute the approach operation. A robot system comprising:
[0190] (Section 28) A method for controlling a robot system including a robot having a robot arm and a robot hand, and a sensor for measuring a state of the robot hand and an object in a predetermined direction based on the robot hand, comprising: The robot is caused to execute an approaching operation for bringing the robot hand closer to a workpiece to be held; acquiring a measurement result from the sensor when the robot is executing the approaching operation; When a predetermined condition based on the measurement result is satisfied, the robot is caused to execute an avoidance operation to avoid interference of the robot hand with the object. A method for controlling a robot system comprising:
[0191] (Section 29) Item 28. A method for manufacturing an article, comprising the steps of: manufacturing an article by using the robot system according to any one of items 1 to 27.
[0192] (Section 30) Item 29. A program for causing a computer to execute the control method according to item 28.
[0193] (Section 31) Item 31. A computer-readable recording medium having the program according to item 30 recorded thereon. [Explanation of symbols]
[0194] 10... robot system, 100... robot, 101... robot arm, 120... robot hand, 303... distance sensor (sensor), 304... distance sensor (sensor), 550... control unit
Claims
1. a robot having a robot arm and a robot hand; a sensor that measures a state of the robot hand and an object in a predetermined direction based on the robot hand; A control unit for controlling the robot, The control unit is The robot is caused to execute an approaching operation for bringing the robot hand closer to a workpiece to be held; acquiring a measurement result from the sensor when the robot is executing the approaching operation; When a predetermined condition based on the measurement result is satisfied, the robot is caused to execute an avoidance operation to avoid interference of the robot hand with the object. A robot system comprising:
2. The sensor measures a distance between the robot hand and the object, A case where the predetermined condition based on the measurement result of the distance is satisfied includes a case where the distance measured by the sensor is equal to or smaller than a threshold value.
2. The robot system according to claim 1 .
3. the avoidance action includes a movement action of moving the robot hand in a direction different from a movement direction of the robot hand when the robot is caused to perform the approach action, 2. The robot system according to claim 1 .
4. The moving operation includes a retracting operation of retracting the robot hand in a direction opposite to the moving direction.
4. The robot system according to claim 3.
5. The control unit sets a workpiece other than the workpiece as the holding target after the robot hand is retracted.
5. The robot system according to claim 4.
6. The sensor irradiates energy, receives the energy reflected by the object, and measures the distance.
3. The robot system according to claim 2.
7. The sensor irradiates energy to a predetermined range, receives the energy reflected by the object, and measures the distance within the predetermined range.
3. The robot system according to claim 2.
8. A case where the predetermined condition based on the measurement result of the distance is satisfied includes a case where the sensor detects a first region in the predetermined range in which the distance is equal to or less than a threshold value.
8. The robot system according to claim 7.
9. the avoidance action includes a movement action of moving the robot hand in a direction different from a movement direction of the robot hand when the robot is caused to perform the approach action, The robot system according to claim 8 .
10. The moving operation includes a retreat operation for retreating the robot hand in a direction opposite to the moving direction, and a correction operation for correcting a position or a posture of the robot hand, The control unit causes the robot to perform either the retreat operation or the correction operation depending on a width of the first area or a width of a second area other than the first area in the predetermined range. The robot system according to claim 9 .
11. the moving operation includes a retracting operation of retracting the robot hand in a direction opposite to the moving direction, The control unit causes the robot to perform the retreat operation when a width of a second area other than the first area in the predetermined range is equal to or smaller than a predetermined width. The robot system according to claim 9 .
12. The moving operation includes a correction operation for correcting a position or a posture of the robot hand, The control unit causes the robot to perform the correction operation when a width of a second region other than the first region in the predetermined range exceeds a predetermined width. The robot system according to claim 9 .
13. The predetermined range is wider than the predetermined width. The robot system according to claim 11 .
14. the robot hand has fingers, The predetermined width is the width of the finger portion. The robot system according to claim 13 .
15. The moving operation includes a correction operation for correcting a position or a posture of the robot hand, When the first area is detected, the control unit causes the robot to perform the correction operation until the first area is no longer detected. The robot system according to claim 9 .
16. the moving operation includes a retracting operation of retracting the robot hand in a direction opposite to the moving direction, the control unit causes the robot to perform the retreat operation when the first area is sandwiched between two second areas in the predetermined range, the distance between which exceeds the threshold value. The robot system according to claim 9 .
17. After performing the correction operation, the control unit continues the approaching operation. The robot system according to claim 10 .
18. Further comprising an imaging device for imaging a predetermined area in which a plurality of workpieces are stacked in bulk, The control unit is acquiring an image of the predetermined area from the imaging device; selecting the workpiece to be held from among the plurality of workpieces based on the captured image; 2. The robot system according to claim 1 .
19. The control unit is Acquire a holding start position at which a holding operation for holding the workpiece to be held is started; The approaching operation includes an operation of moving the robot hand to the holding start position.
2. The robot system according to claim 1 .
20. When the robot hand reaches the holding start position, the control unit stops the approaching operation and causes the robot hand to perform the holding operation.
20. The robot system of claim 19.
21. the sensor is a first sensor, The robot hand has a plurality of fingers, Further, a second sensor is provided for detecting whether or not the workpiece to be held is present between the plurality of fingers.
20. The robot system of claim 19.
22. The robot hand has fingers, the sensor is provided on the finger portion and measures the distance between the finger portion and the object as the distance; 3. The robot system according to claim 2.
23. the sensor is provided at a tip of the finger and measures the distance between the tip of the finger and the object as the distance; 23. The robotic system of claim 22.
24. the energy being light; 7. The robot system according to claim 6.
25. The light is infrared light.
25. The robotic system of claim 24.
26. The control unit is displaying, on a display unit, a user interface image for receiving a user's selection of an avoidance operation for avoiding interference of the robot hand with the object; when a predetermined condition based on the measurement result is satisfied, causing the robot to execute the avoidance action in accordance with a selection made by the user via the user interface image; 2. The robot system according to claim 1 .
27. a robot having a robot hand including a plurality of fingers and a robot arm; a plurality of sensors provided on each of the plurality of finger portions, the sensors measuring a state of the corresponding finger portion and an object in a predetermined direction based on the corresponding finger portion among the plurality of finger portions; A control unit for controlling the robot, The control unit is The robot is caused to execute an approaching operation for bringing the robot hand closer to a workpiece to be held; acquiring measurement results from each of the plurality of sensors when the robot is executing the approaching operation; When a predetermined condition based on the measurement results of any of the plurality of sensors is satisfied, the robot is caused to execute a retraction operation for retracting the robot hand in a direction opposite to a moving direction of the robot hand when the robot is caused to execute the approach operation. A robot system comprising:
28. A method for controlling a robot system including a robot having a robot arm and a robot hand, and a sensor for measuring a state of the robot hand and an object in a predetermined direction based on the robot hand, comprising: The robot is caused to execute an approaching operation for bringing the robot hand closer to a workpiece to be held; acquiring a measurement result from the sensor when the robot is executing the approaching operation; When a predetermined condition based on the measurement result is satisfied, the robot is caused to execute an avoidance operation to avoid interference of the robot hand with the object. A method for controlling a robot system comprising:
29. A method for manufacturing an article, comprising the steps of: manufacturing an article by using the robot system according to any one of claims 1 to 27;
30. A program for causing a computer to execute the control method according to claim 28.
31. A computer-readable recording medium having the program according to claim 30 recorded thereon.
Citation Information
Patent Citations
Information processing device, measurement device, system, interference determination method and article manufacturing method
JP2018176334A
Cited By
Refrigerator and method for controlling refrigerator
WO2026177444A1
