Control device, robot system, and robot control method
The described robot system with a radially offset suction device and advanced detection methods addresses the challenge of interference in robot picking and placement by ensuring non-overlap and optimal orientation, enabling precise and efficient workpiece handling.
Patent Information
- Application Number
- PCT/JP2023/020183
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-30
- Publication Date
- 2024-12-05
AI Technical Summary
Conventional robot control systems face difficulties in accurately picking and placing workpieces due to interference between the robot arm or hand and other objects, especially when considering only the interference during picking, which can lead to inappropriate placement.
A control device and robot system with a robot arm and hand, where the suction device is positioned offset in the radial direction about a predetermined reference axis, allowing for detection and determination of the relative position and orientation of the hand to avoid overlap and ensure non-parallel offset, enabling precise picking and placing by considering multiple reference sides and optimizing placement efficiency.
This approach allows for appropriate and efficient picking and placement of workpieces by minimizing interference and maximizing placement options, ensuring the robot arm and hand do not overlap with the workpiece or other objects, thereby improving the overall efficiency of the pick-and-place process.
Smart Images

Figure JP2023020183_05122024_PF_FP_ABST
Abstract
Description
Control device, robot system, and robot control method
[0001] The technology disclosed herein relates to a control device, a robot system, and a method for controlling a robot.
[0002] Conventionally, control devices for controlling robots that perform picking have been known. For example, a control device described in Patent Literature 1 controls a robot arm and hand to pick a workpiece, transport it to another location, and place it there. This control device changes the gripping mode depending on the state of the workpiece to be picked, thereby realizing gripping of the workpiece by the robot arm and hand without interfering with other objects.
[0003] Japanese Patent Application Laid-Open No. 2004-230513
[0004] When picking a workpiece, one target workpiece is often selected from multiple candidates, so interference between the robot arm and hand and other objects tends to be taken into consideration when selecting the target workpiece.
[0005] However, if only interference during picking is taken into consideration, it may become difficult to place the workpiece appropriately.
[0006] The technology disclosed herein has been made in consideration of these points, and its purpose is to appropriately pick and place workpieces.
[0007] The control device disclosed herein is a control device that controls a robot having a robot arm and a hand attached to the robot arm, the control device including a suction device arranged at a position offset in a radial direction centered on a predetermined reference axis of the robot arm, and is equipped with a detector that detects a workpiece to be picked, and a position and attitude determiner that determines the relative position and attitude of the hand, which is the position and attitude of the hand with respect to the target workpiece at the time of picking, and the position and attitude determiner determines, as the relative position and attitude of the hand, an attitude in which the hand does not overlap with a reference side portion of the target workpiece when viewed in the direction of the reference axis, and the offset direction of the suction device with respect to the reference axis is not parallel to the side portion.
[0008] The robot system of the present disclosure includes a robot having a robot arm, a hand attached to the robot arm, and a suction device arranged at a position radially offset from a predetermined reference axis of the robot arm, and the control device.
[0009] The robot control method disclosed herein includes detecting a target workpiece to be picked by a robot having a robot arm and a hand attached to the robot arm, the robot arm including a suction device arranged at a position offset in a radial direction around a predetermined reference axis of the robot arm, and determining the relative position and attitude of the hand, which is the position and attitude of the hand with respect to the target workpiece at the time of picking, and in determining the relative position and attitude of the hand, an attitude is determined as the relative position and attitude of the hand such that the hand does not overlap with a reference side portion of the target workpiece when viewed in the direction of the reference axis and the offset direction of the suction device with respect to the reference axis is not parallel to the side portion.
[0010] According to the control device, the picking and placing of the workpiece can be performed appropriately.
[0011] According to the robot system, it is possible to appropriately pick and place the workpiece.
[0012] According to the robot control method, the workpiece can be picked and placed appropriately.
[0013] FIG. 1 is a schematic diagram showing the configuration of a robot system. FIG. 2 is a diagram showing a schematic hardware configuration of a robot control device and a main control device. FIG. 3 is a block diagram showing the configuration of a control system of a processor. FIG. 4 is a diagram showing the interior of a first container as viewed from above. FIG. 5 is an explanatory diagram showing a hand when picking up a target workpiece. FIG. 6 is a flowchart of a pick-and-place process. FIG. 7 is a flowchart of a pickup position planning subroutine. FIG. 8 is a schematic diagram showing the relative position and posture of the hand when viewed in the direction of the reference axis. FIG. 9 is a schematic diagram showing a region where the angle between the edge serving as the reference side and the offset direction of the suction device is equal to or greater than a threshold value α and a region where the angle is less than the threshold value α. FIG. 10 is a flowchart of a place position planning subroutine. FIG. 11 is a schematic plan view showing a placing operation when the offset direction of the suction device is parallel to the reference side. FIG. 12 is a schematic plan view showing a placing operation when the offset direction of the suction device is non-parallel to the two reference sides. Fig. 13 is a schematic plan view showing a placing operation in which only one reference side portion is brought into contact with the side surface of the second container, and Fig. 14 is a schematic plan view showing a placing operation in which only the other reference side portion is brought into contact with the side surface of the second container.
[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An exemplary embodiment will now be described in detail with reference to the accompanying drawings. 1 is a schematic diagram showing the configuration of a robot system 100. As shown in FIG.
[0015] The robot system 100 includes a robot 1 and a main control device 3 that controls the robot 1. The main control device 3 controls the robot 1 to cause the robot 1 to execute a process. In this example, the process performed by the robot 1 is a pick-and-place process. For example, the robot 1 picks up a target workpiece from a first container 91 in which multiple workpieces are piled up randomly, and transfers the target workpiece to a second container 92. The robot 1 arranges the target workpieces in a regular pattern within the second container 92. The robot system 100 arranges the multiple workpieces in the first container 91 within the second container 92 by repeating the pick-and-place process. The target workpiece has, for example, a substantially rectangular parallelepiped shape.
[0016] The robot system 100 may be equipped with a camera 51 that acquires images of the workpieces. The camera 51 may include a first camera 51A that acquires images of the inside of the first container 91 and a second camera 51B that acquires images of the inside of the second container 92. The first camera 51A is fixedly disposed above the first container 91. The first camera 51A captures images of the inside of the first container 91 from above. The first camera 51A acquires images including a plurality of workpieces in the first container 91. The second camera 51B is fixedly disposed above the second container 92. The second camera 51B captures images of the inside of the second container 92 from above. The second camera 51B acquires images including a plurality of workpieces in the second container 92. Hereinafter, when there is no need to distinguish between the first camera 51A and the second camera 51B, they will be simply referred to as cameras 51.
[0017] Here, the image is a two-dimensional image or a three-dimensional image. The three-dimensional image may be point cloud data, an RGB-D image, an RGB image, a depth image, a voxel image, or the like. That is, the camera 51 may be a three-dimensional camera, i.e., an RGB-D camera that outputs an RGB-D image, a stereo camera that acquires an RGB image, or a three-dimensional vision sensor that acquires point cloud data.
[0018] -Robot- The robot 1 has a robot arm 12 and a hand 14 attached to the robot arm 12. In this example, the robot 1 is an industrial robot. The hand 14 is a so-called end effector. A base coordinate system with three orthogonal axes is defined in the space in which the robot 1 is placed.
[0019] The robot arm 12 is configured to move three-dimensionally. Specifically, the robot arm 12 is configured to perform movements including translation with at least three degrees of freedom. In this example, the robot arm 12 is a vertical multi-joint robot arm. The robot arm 12 is supported by a base 10. The robot arm 12 has a plurality of links, a plurality of joints connecting the plurality of links, and servo motors that rotate the plurality of joints.
[0020] In detail, the robot arm 12 has a first link 12a connected to the base 10, a second link 12b connected to the first link 12a, a third link 12c connected to the second link 12b, a fourth link 12d connected to the third link 12c, and a fifth link 12e connected to the fourth link 12d.
[0021] Specifically, the base 10 and the first link 12a are connected to each other via a first joint 13a that is rotatable about an axis extending in the vertical direction. The first link 12a and the second link 12b are connected to each other via a second joint 13b that is rotatable about an axis extending in the horizontal direction. The second link 12b and the third link 12c are connected to each other via a third joint 13c that is rotatable about an axis extending in the horizontal direction. The third link 12c and the fourth link 12d are connected to each other via a fourth joint 13d that is rotatable about the axis of the fourth link 12d (i.e., the direction in which the fourth link 12d extends). The fourth link 12d and the fifth link 12e are connected to each other via a fifth joint 13e that is rotatable about an axis perpendicular to the axis of the fourth link 12d.
[0022] The robot arm 12 has servo motors 16 (see FIG. 2) that rotate and drive each joint. Each servo motor 16 has an encoder 16a (see FIG. 2).
[0023] The robot arm 12 configured in this manner is configured to perform translational movements in the directions of three orthogonal axes and rotational movements around each of the three orthogonal axes.
[0024] The hand 14 includes a suction device 15 that is disposed at a position offset in the radial direction around a predetermined reference axis T of the robot arm 12. The suction device 15 is disposed at a position eccentric to the reference axis T. For example, the hand 14 has a base 14a that is attached to the robot arm 12. The base 14a extends in the radial direction around the reference axis T. The suction device 15 is attached to the end of the base 14a that is farther from the reference axis T via a plate, a block, or the like.
[0025] Furthermore, the suction device 15 is configured to be able to change its position relative to the robot arm 12. For example, the hand 14 is attached to the robot arm 12 so as to be rotatable about a reference axis T. Specifically, the hand 14 is connected to the tip of the robot arm 12, i.e., the fifth link 12e. The fifth link 12e and the hand 14 are connected to each other via a sixth joint 13f so as to be rotatable about the reference axis T. The suction device 15 changes its position relative to the robot arm 12 by rotating the hand 14 about the reference axis T.
[0026] The hand 14 sucks the workpiece W using a suction device 15. The suction device 15 has a suction pad. An air hose connected to a negative pressure generator is connected to the suction device 15. A solenoid valve serving as an actuator 15a (see FIG. 2) is provided on the air hose. By controlling the solenoid valve, the suction device 15 can switch between suction and release. The suction device 15 sucks the surface of the target workpiece W. A pressure sensor 15b (see FIG. 2) is provided on the air hose. The pressure sensor 15b detects the magnitude of the negative pressure in the air hose.
[0027] 2 is a diagram showing the general hardware configuration of the robot controller 2 and the main controller 3. The main controller 3 transmits and receives signals, information, etc. to and from the robot controller 2. The main controller 3 controls the robot 1 via the robot controller 2. The main controller 3 outputs commands to the robot controller 2. The robot controller 2 controls the servo motor 16 of the robot arm 12 in response to commands from the main controller 3.
[0028] Images from the first camera 51A and the second camera 51B are input to the main control device 3. The main control device 3 detects the target workpiece W based on the images. In addition, the main control device 3 generates a target path for the robot 1 based on the detected target workpiece W, and outputs a command corresponding to the generated target path to the robot control device 2. An actuator 15a and a pressure sensor 15b are connected to the main control device 3. The main control device 3 controls suction by the hand 14 via the actuator 15a and the pressure sensor 15b. The main control device 3 is an example of a control device.
[0029] The robot control device 2 has a processor 21 , a storage device 22 , and a memory 23 .
[0030] The processor 21 controls the entire robot control device 2. The processor 21 performs various types of arithmetic processing. For example, the processor 21 is formed of a processor such as a CPU (Central Processing Unit). The processor 21 may also be formed of an MCU (Micro Controller Unit), an MPU (Micro Processor Unit), an FPGA (Field Programmable Gate Array), a PLC (Programmable Logic Controller), a system LSI, or the like.
[0031] The storage unit 22 stores various data and programs executed by the processor 21. The storage unit 22 is formed of a non-volatile memory, a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 23 temporarily stores data, etc. For example, the memory 23 is formed of a volatile memory.
[0032] The processor 21 drives the servo motor 16 based on a command from the main control device 3. At this time, the robot control device 2 feedback controls the current supplied to the servo motor 16 based on the detection result of the encoder 16a.
[0033] The main control device 3 includes a processor 31 , a storage device 32 , and a memory 33 .
[0034] The processor 31 controls the entire main control device 3. The processor 31 performs various types of arithmetic processing. For example, the processor 31 is formed of a processor such as a CPU (Central Processing Unit). The processor 31 may also be formed of an MCU (Micro Controller Unit), an MPU (Micro Processor Unit), an FPGA (Field Programmable Gate Array), a PLC (Programmable Logic Controller), a system LSI, or the like.
[0035] The storage unit 32 stores various data and programs executed by the processor 31. The storage unit 32 is formed of a nonvolatile memory, a hard disk drive (HDD), a solid state drive (SSD), or the like.
[0036] For example, the memory 32 stores an object detection program for detecting an object, a position and orientation determination program for determining the position and orientation of the hand 14, and a path generation program for generating a target path for the robot 1. The various programs cause the main control device 3 to realize various functions.
[0037] The memory 33 temporarily stores data etc. For example, the memory 33 is formed of a volatile memory. The memory 33 stores images from the camera 51.
[0038] The processor 31 causes the robot 1 to perform a picking operation in which the hand 14 moves to the target workpiece W and causes the suction device 15 to pick up the target workpiece W, and a placing operation in which the hand 14 that has sucked up the target workpiece W moves to a target place position and causes the suction device 15 to release the suction of the target workpiece W. The processor 31 causes the robot 1 to perform a placing operation after the picking operation.
[0039] Prior to the picking operation, the processor 31 determines the relative position and posture of the hand 14, which is the position and posture of the hand 14 with respect to the target workpiece W at the time of picking. Prior to the placing operation, the processor 31 determines the target placement position of the target workpiece W at the time of placing.
[0040] 3 is a block diagram showing the configuration of a control system for the processor 31. The processor 31 realizes various functions by reading a program from the storage device 32 into the memory 33 and expanding the program. Specifically, the processor 31 functions as a detector 34 that detects the workpiece W to be picked and a position and orientation determiner 35 that determines the relative position and orientation of the hand 14. The processor 31 also functions as an operation controller 36 that causes the robot arm 12 and the hand 14 to perform the picking operation and the placing operation. Furthermore, the processor 31 also functions as an imaging controller 37 that causes the camera 51 to acquire an image.
[0041] The photography controller 37 controls the first camera 51A and the second camera 51B to capture images from each of the first camera 51A and the second camera 51B. The first camera 51A captures an image of the inside of the first container 91. The second camera 51B captures an image of the inside of the second container 92. The photography controller 37 stores the images from the cameras 51 in the memory 33.
[0042] The detector 34 detects the target workpiece W from the image through image recognition. The image may include multiple workpieces. The detector 34 performs plane detection using, for example, RANSAC (Random Sample Consensus) to detect the surface of the target workpiece W (hereinafter referred to as the "target surface S"). That is, the detector 34 detects the target workpiece W by detecting a plane of a predetermined shape included in the image. FIG. 4 is a top view of the inside of the first container 91. The detector 34 can detect multiple target surfaces S, i.e., multiple target workpieces W. When detecting the target surface S, the detector 34 determines at least the center position of the target surface S, the normal direction of the target surface S, the vertical and horizontal orientation of the target surface S, and the size (e.g., vertical and horizontal dimensions) of the target surface S. The size of the target surface S may be stored in the memory 32 in advance.
[0043] The position and orientation determiner 35 determines the relative position and orientation of the hand 14 during picking, using the target surface S detected as the target workpiece W as the suction surface. FIG. 5 is an explanatory diagram showing the hand 14 when suctioning the target workpiece W. Specifically, the position and orientation of the hand 14 is determined so that the suction device 15 is located at a suction position on the target surface S. The suction position is, for example, the center of the target surface S. Because the suction device 15 is eccentric with respect to the reference axis T, even if the position of the suction device 15 is determined, the reference axis T can be positioned at any position within 360 degrees around the suction device 15. Therefore, the relative position and orientation of the hand 14 is determined by the position of the suction device 15 with respect to the target workpiece W, the position of the reference axis T, and the orientation of the reference axis T. In other words, once the relative position and orientation of the hand 14 is determined, the position and orientation of the reference axis T with respect to the target workpiece W and the offset direction of the suction device 15 with respect to the reference axis T are also determined. The "offset direction of the suction device 15 with respect to the reference axis T" is the direction in which a straight line connecting the reference axis T and the suction device 15 extends from the reference axis T when viewed in the direction of the reference axis T, and in this example, is the direction in which the base 14a extends from the reference axis T. In other words, the offset direction of the suction device 15 with respect to the reference axis T is the eccentric direction of the suction device 15 with respect to the reference axis T. Hereinafter, the offset direction of the suction device 15 with respect to the reference axis T will be simply referred to as the "offset direction of the suction device 15."
[0044] In this example, the position and posture determiner 35 determines the relative position and posture of the hand 14 so that, when viewed in the direction of the reference axis T, the reference side of the target workpiece W (hereinafter referred to as the "reference side") does not overlap with the hand 14, and the offset direction of the suction device 15 relative to the reference axis T is non-parallel to the reference side.
[0045] The "side of the target workpiece W" is a portion of the target workpiece W facing to the side. Specifically, when the target workpiece W is viewed in the direction of the reference axis T, it is a portion of the target workpiece W facing in a direction intersecting the normal direction. In other words, the side of the target workpiece W is a side surface of the target workpiece W that intersects with the suction surface that is suctioned by the suction device 15. In this example, since the target workpiece W has a roughly rectangular parallelepiped shape, the portion of the target workpiece W facing in a direction roughly perpendicular to the normal direction of the target surface S, that is, the four side surfaces other than the target surface S and the surface opposite it, are the side of the target workpiece W.
[0046] Furthermore, the position and orientation determiner 35 determines a target placement position for the target work W. For example, the target placement position is defined by the position and orientation of the target work W. The position and orientation determiner 35 determines the target placement position so as to increase the efficiency with which the target work W can be accommodated in the second container 92. For example, the target placement position is a position where a reference side of the target work W comes into contact with an object that serves as a reference for placement. The object that serves as a reference for placement is, for example, the wall surface of the second container 92 or the side of an existing target work W that has already been placed.
[0047] The position and orientation determiner 35 generates a target path for the robot arm 12 and the hand 14. The position and orientation determiner 35 generates a target path for the robot arm 12 and the hand 14 for moving the hand 14 to the determined relative position and orientation of the hand 14. Furthermore, the position and orientation determiner 35 generates a target path for the robot arm 12 and the hand 14 for transferring the target workpiece W to the determined target placement position. The target path is an ordered set of target positions and target orientations of the robot arm 12 and the hand 14. In other words, the target path is a time-dependent change in the target position and target orientation of the robot arm 12 and the hand 14. The target path may also be an ordered set of target rotation angles for each joint of the robot arm 12 (including the sixth joint 13f) that realizes the time-dependent change in the target position and target orientation of the robot arm 12 and the hand 14. The target path uniquely defines the position and orientation of the robot arm 12 and the hand 14. The target path also defines a target rotation position of the suction device 15 around the reference axis T.
[0048] For example, the position and orientation determiner 35 executes path planning using a probabilistic roadmap method (PRM) or a rapidly-exploring random tree (RRT). In these methods, the position and orientation determiner 35 also executes an interference check, i.e., checks whether the robot arm 12 and the hand 14 interfere with other objects. The interference check may be performed using point cloud data or CAD data, for example.
[0049] The motion controller 36 outputs a command according to the target path to the robot control device 2. Specifically, the motion controller 36 outputs a command according to the target rotation angle of each joint of the robot arm 12 to the robot control device 2. As described above, the robot control device 2 drives the servo motor 16 based on the command, causing the robot arm 12 and the hand 14 to move along the target path.
[0050] The operation controller 36 switches between suction by the suction device 15 and release of the suction by controlling the actuator 15a of the hand 14. The operation controller 36 controls the actuator 15a to generate negative pressure in the suction device 15, thereby causing the suction device 15 to suction the workpiece. The operation controller 36 controls the actuator 15a to release the negative pressure in the suction device 15, thereby causing the suction device 15 to release the suction of the workpiece W. The operation controller 36 determines that suction by the suction device 15 has been completed, based on the detection result of the pressure sensor 15b. The operation controller 36 determines that suction has been completed when the negative pressure detected by the pressure sensor 15b is equal to or greater than a predetermined threshold.
[0051] Next, a description will be given of the operation of the robot system 100 configured as above. The pick-and-place process in the robot system 100 will be described with reference to the flowchart of Fig. 6. Fig. 6 is a flowchart of the pick-and-place process.
[0052] First, in step S101, the photography controller 37 acquires an image of the inside of the first container 91. More specifically, the photography controller 37 causes the first camera 51A to acquire an image of the inside of the first container 91.
[0053] Next, in step S102, the detector 34 detects the target workpiece W, specifically the target surface S, from the image of the inside of the first container 91. For example, the detector 34 detects a plurality of target surfaces S. Step S102 corresponds to detecting the target workpiece to be picked by the robot.
[0054] Subsequently, in step S103, the position and orientation determiner 35 executes a pickup position plan. In the pickup position plan, the target workpiece W to be picked up by the hand 14 is determined, and the relative position and orientation of the hand 14 with respect to the target workpiece W is also determined. At this time, a target path for the robot arm 12 and the hand 14 to realize the relative position and orientation of the hand 14 is also generated. Step S103 corresponds to determining the relative position and orientation of the hand.
[0055] Once the relative position and posture of the hand 14 has been determined, in step S104, the motion controller 36 causes the robot arm 12 and the hand 14 to perform a picking operation. That is, the motion controller 36 controls the robot arm 12 and the hand 14 so that the target workpiece W determined in the pickup position plan is picked up at the determined relative position and posture of the hand 14. Specifically, the motion controller 36 moves the robot arm 12 and the hand 14 along the target path, and moves the suction device 15 to the target workpiece W. The motion controller 36 causes the suction device 15 to pick up the target workpiece W.
[0056] During or after the picking operation is completed, in step S105, the photography controller 37 captures an image of the inside of the second container 92. More specifically, the photography controller 37 causes the second camera 51B to capture an image of the inside of the second container 92.
[0057] Next, in step S106, the position and orientation determiner 35 executes a place position plan. In the place position plan, a target place position of the target workpiece W is determined. At this time, a target path of the robot arm 12 and the hand 14 for realizing the target place position of the target workpiece W is also generated.
[0058] Once the target placement position has been determined, in step S107, the motion controller 36 causes the robot arm 12 and hand 14 to perform a placement operation. That is, the motion controller 36 controls the robot arm 12 and hand 14 so that the target workpiece W is placed at the target placement position determined in the placement position plan. Specifically, the motion controller 36 moves the robot arm 12 and hand 14 along the target path to move the target workpiece W to the target placement position. When the target workpiece W reaches the target placement position, the motion controller 36 releases the suction by the suction device 15. In this way, the placement of the target workpiece W at the target placement position is completed. This completes the pick-and-place process.
[0059] When the main control device 3 completes the pick-and-place process for one target workpiece W, it repeats the process from step S101 to pick-and-place another target workpiece W. By repeating this control, the main control device 3 sequentially transfers the target workpieces W in the first container 91 into the second container 92.
[0060] =Pickup Position Planning= Next, the pickup position planning will be described in detail. Fig. 7 is a flowchart of the pickup position planning subroutine.
[0061] In step S201, the position and orientation determiner 35 generates candidates for the relative position and orientation of the hand 14. At this time, the position and orientation determiner 35 may generate multiple candidates for the relative position and orientation of the hand 14. More specifically, the position and orientation determiner 35 may generate multiple candidates for the relative position and orientation of the hand 14 with respect to one target surface S. Furthermore, if there are multiple target surfaces S, the position and orientation determiner 35 may generate candidates for the relative position and orientation of the hand 14 with respect to each of the target surfaces S.
[0062] FIG. 8 is a schematic diagram showing the relative position and orientation of the hand 14 when viewed in the direction of the reference axis T. In FIG. 8, the dashed-dotted line indicates the offset direction OD of the suction device 15. During picking, the suction device 15 is positioned at a pickup position on the target surface S, and the reference axis T is approximately perpendicular to the target surface S. The position of the reference axis T can be any position within 360 degrees around the suction device 15. In other words, the position and orientation determiner 35 can generate multiple candidates for the relative position and orientation of the hand 14, in which the reference axis T is located at different positions in the circumferential direction around the pickup position on the target surface S. In this example, the pickup position is approximately the center of the target surface S. Furthermore, the position and orientation determiner 35 can generate multiple candidates for the relative position and orientation of the hand 14 for different target surfaces S.
[0063] Next, in step S202, the position and orientation determiner 35 assigns priorities to the 14 relative position and orientation candidates of the hand. For example, the position and orientation determiner 35 assigns priorities from two perspectives.
[0064] In the first aspect, a high priority is assigned to a candidate for the target workpiece W whose reference side does not overlap with the hand 14 when viewed in the direction of the reference axis T and whose offset direction of the suction device 15 relative to the reference axis T is not parallel to the reference side. When this condition is met, the hand 14 picks up the target workpiece W in a state where the reference axis T and the reference side are relatively far apart when viewed in the direction of the reference axis T.
[0065] In this example, the position and orientation determiner 35 sets two reference sides for the target workpiece W. For example, the position and orientation determiner 35 sets any two of the sides R1, R2, R3, and R4 of the target workpiece W, specifically, the two sides that are connected to form a corner of the target workpiece W, as the reference sides. The position and orientation determiner 35 then assigns a high priority to candidates for which the hand 14 does not overlap either of the two reference sides and the offset direction of the suction device 15 with respect to the reference axis T is non-parallel for both of the two sides. Furthermore, the position and orientation determiner 35 may change the reference sides to two other sides and assign a high priority to candidates for which the two changed sides satisfy the above-mentioned conditions.
[0066] Specifically, the position and orientation determiner 35 regards the edges of the target surface S as the sides of the target workpiece W. The position and orientation determiner 35 assigns a relatively high priority to candidates that satisfy the above-described conditions for each of the two edges that form the four corners of the target surface S, i.e., for a total of four edges. The position and orientation determiner 35 then assigns a relatively low priority to the remaining candidates. For example, if the angle between the edge serving as the reference side and the offset direction of the suction unit 15 is equal to or greater than a threshold value α, the position and orientation determiner 35 considers the reference side and the offset direction to be non-parallel. FIG. 9 is a schematic diagram showing a region A where the angle between the edge serving as the reference side and the offset direction of the suction unit 15 is equal to or greater than the threshold value α and a region B where the angle is less than the threshold value α. As a result, as shown in FIG. 9 , a relatively high priority is assigned to candidates whose offset direction of the suction unit 15 falls within region A. On the other hand, a relatively low priority is assigned to candidates whose offset direction of the suction unit 15 falls within region B.
[0067] Alternatively, two reference sides may be determined in advance for the target workpiece W. In this case, the position and orientation determiner 35 assigns a high priority to candidates that satisfy the above-described conditions for the pair of reference sides, and assigns a low priority to other candidates.
[0068] In the second aspect, the position and orientation determiner 35 assigns a higher priority to a candidate with a smaller amount of movement from the current state, i.e., the current position, of the robot arm 12. For example, a higher priority may be assigned to a candidate with a smaller total amount of movement of all the joints of the robot arm 12.
[0069] Next, in step S203, the position and orientation determiner 35 determines whether or not there are candidates for the relative position and orientation of the hand 14. If there is no appropriate target surface S, it is possible that no candidates for the relative position and orientation of the hand 14 are generated in step S201 described above. In such a case, the pick-and-place process ends in step S206.
[0070] If there are candidates for the relative position and orientation of the hand 14, in step S204, the position and orientation determiner 35 extracts the candidate with the highest priority. Then, the position and orientation determiner 35 generates a target path for the robot arm 12 from the current position and orientation of the hand 14 to the extracted relative position and orientation of the hand 14. At this time, the position and orientation determiner 35 checks for interference with the target path and generates a target path that is free of interference. If interference is detected, the position and orientation determiner 35 does not generate a target path.
[0071] In step S205, the position and orientation determiner 35 determines whether a target path has been generated. If a target path has not been generated, the position and orientation determiner 35 excludes the extracted candidate for the relative position and orientation of the hand 14 from the candidates, and returns to step S203. The position and orientation determiner 35 again extracts the candidate with the highest priority and generates a target path again.
[0072] In this way, the position and orientation determiner 35 attempts to generate a target path in descending order of priority from among the candidates for the relative position and orientation of the hand 14. When an interference-free target path is generated, the position and orientation determiner 35 determines the relative position and orientation of the hand 14 and the target path, and ends the pickup position planning.
[0073] =Place Position Planning= Next, the place position planning will be described in detail. Fig. 10 is a flowchart of the place position planning subroutine.
[0074] In step S301, the position and orientation determiner 35 generates a plurality of candidates for the target placement position. Specifically, the position and orientation determiner 35 generates a plurality of candidates for the target placement position of the target workpiece W in the second container 92.
[0075] Next, in step S302, the position and orientation determiner 35 assigns priorities to candidates for the target placement position. For example, the position and orientation determiner 35 assigns a high priority to a candidate for the target placement position that has a high efficiency of storing the target work W in the second container 92. The position and orientation determiner 35 may evaluate the storage efficiency using various methods. For example, the position and orientation determiner 35 assigns a high priority to a candidate in which a side of the target work W contacts a reference object for placement. The reference object for placement is, for example, a wall surface of the second container 92 or a side of an existing target work W that has already been placed. Furthermore, the position and orientation determiner 35 assigns a higher priority to a candidate in which more sides of the target work W contact the reference object for placement. In other words, in the case of a candidate to be placed in a corner space formed by the side wall of the second container 92 or the side of an existing target work W in the second container 92, two sides of the target work W contact the reference object for placement. Placing the items starting from the corners of the second container 92 is advantageous in terms of increasing the storage efficiency, so such a placement target position is given a higher priority because it has a higher storage efficiency.
[0076] Next, in step S303, the position and orientation determiner 35 determines whether or not there are any candidates for the placement target position. If there is no space in the second container 92, it is possible that no candidates for the placement target position are generated in step S301. In such a case, in step S306, the pick-and-place process ends.
[0077] If there are candidates for the place target position, in step S304, the position and orientation determiner 35 extracts the candidate with the highest priority. Then, the position and orientation determiner 35 generates a target path for the robot arm 12 and hand 14 from the current position and orientation of the robot arm 12 and hand 14 to the position and orientation corresponding to the place target position. At this time, the position and orientation determiner 35 checks for interference with the target path and generates a target path that is free of interference. Depending on the status of surrounding objects, the position and orientation determiner 35 may not be able to generate a target path that is free of interference.
[0078] In step S305, the position and attitude determiner 35 determines whether or not a collision-free target path has been generated.
[0079] If an interference-free target path has not been generated, the position and orientation determiner 35 excludes the extracted candidate for the place target position from the candidates and returns to step S303. The position and orientation determiner 35 again extracts the candidate with the highest priority and again generates a target path and performs an interference check.
[0080] In this way, the position and attitude determiner 35 attempts to generate a target path from among the candidate placement target positions in descending order of priority. When an interference-free target path is generated, the position and attitude determiner 35 determines the placement target position and target path, and ends the placement position planning.
[0081] In this pick-and-place process, the relative position and posture of the hand 14 that picks up the target workpiece W is determined so that the reference side of the target workpiece W does not overlap with the hand 14 when viewed in the direction of the reference axis T, and the offset direction of the suction device 15 is non-parallel to the reference side. Furthermore, the reference sides are two sides of the target workpiece W that are connected to form an angle. As a result, when viewed in the direction of the reference axis T, the distance between the reference axis T and each of the two reference sides is greater than the distance between the suction device 15 and each of the two reference sides. The reference axis T is located at the tip of the robot arm 12. In other words, the distance between the tip of the robot arm 12 and each of the two reference sides is greater. Therefore, when viewed in the direction of the reference axis T, the tip of the robot arm 12 and the two reference sides are less likely to overlap. As a result, when placing the target workpiece W, it is easier to place the target workpiece W with the reference side in contact with a wall or object that serves as a reference for placement.
[0082] This point will be explained in detail. FIG. 11 is a schematic plan view showing a placing operation when the offset direction OD of the suction device 15 is parallel to the reference side R1. If the offset direction OD of the suction device 15 is parallel to the reference side R1, the tip of the robot arm 12 may overlap the reference side R1 when viewed in the direction of the reference axis T. Depending on the size of the hand 14, the hand 14 may overlap the reference side R1 when viewed in the direction of the reference axis T. In other words, the tip of the robot arm 12 may partially extend outside the reference side R1 when viewed in the direction of the reference axis T. As described above, in order to increase the storage efficiency of the target workpieces W in the second container 92, it is preferable to bring the side of the target workpiece W into contact with the wall surface of the second container 92 or the side of an existing target workpiece W that has already been placed. However, even if an attempt is made to bring the reference side R1 into contact with the side surface of the second container 92, the tip of the robot arm 12 comes into contact with the side surface of the second container 92, making it impossible to bring the reference side R1 into contact with the side surface of the second container 92. In the above-described pick-and-place process, a place target position that brings the reference side R1 into contact with the side surface of the second container 92 or the like does not pass the interference check (step S305) of the target path in the place position plan. Such a place target position is excluded from the place position plan.
[0083] 12 is a schematic plan view showing a placing operation when the offset direction OD of the suction device 15 is non-parallel to the two reference sides R1, R2. When the offset direction OD of the suction device 15 is non-parallel to the two reference sides R1, R2, the reference axis T is spaced apart from the two reference sides R1, R2 when viewed in the direction of the reference axis T. This makes it difficult for the tip of the robot arm 12 to overlap with the two reference sides R1, R2 when viewed in the direction of the reference axis T. In other words, it is difficult for the tip of the robot arm 12 to extend beyond the two reference sides R1, R2 when viewed in the direction of the reference axis T. Therefore, both of the two reference sides R1, R2 can be brought into contact with the side surfaces of the second container 92 without the tip of the robot arm 12 coming into contact with the side surfaces of the second container 92. In the above-described pick-and-place process, a target placement position that brings the two reference sides R1, R2 into contact with the side surfaces of the second container 92 is preferentially selected, and such a target placement position can pass the interference check (step S305) of the target path of the placement position plan. In the placing operation, the motion controller 36 operates the robot arm 12 and the hand 14 so that the target workpiece W is placed at the target placement position where the reference sides R1, R2 come into contact with the object that serves as the reference for placement. In this way, by making the offset direction OD of the suction device 15 non-parallel to the two reference sides R1, R2, it becomes easier to achieve a placement in which one of the two reference sides R1, R2 comes into contact with the side surfaces of the second container 92. As a result, the efficiency with which the target workpiece W can be accommodated in the second container 92 can be improved.
[0084] Note that by making the offset direction OD of the suction device 15 non-parallel to the two reference sides R1, R2, it is also possible to achieve a placement in which only one of the reference sides R1, R2 is brought into contact with the side surface of the second container 92. FIG. 13 is a schematic plan view showing a placement operation in which only one of the reference sides R1 is brought into contact with the side surface of the second container 92. FIG. 14 is a schematic plan view showing a placement operation in which only the other reference side R2 is brought into contact with the side surface of the second container 92. In this way, by making the offset direction OD of the suction device 15 non-parallel to the two reference sides R1, R2, it is possible to increase the number of options for the placement target position, and as a result, it becomes easier to achieve an appropriate placement.
[0085] In the pickup position plan described above, the position and posture determiner 35 generates candidates for the relative position and posture of the hand 14 during picking without considering the relationship between the reference side of the target workpiece W and the offset direction of the suction device 15 or the hand 14, and when prioritizing the candidates, takes into consideration the relationship between the reference side of the target workpiece W and the offset direction of the suction device 15 or the hand 14. As a result, the position and posture determiner 35 determines, as the relative position and posture of the hand 14, a posture in which the reference side of the target workpiece W does not overlap with the hand 14 when viewed in the direction of the reference axis T and the offset direction of the suction device 15 is not parallel to the reference side. In other words, of the multiple candidates for the relative position and orientation of the hand 14, the position and orientation determiner 35 determines, as the relative position and orientation of the hand 14, a candidate in which the reference side of the target workpiece W and the hand 14 do not overlap when viewed in the direction of the reference axis T and the offset direction of the suction device 15 relative to the reference axis T is non-parallel to the reference side, in preference to a candidate in which the reference side of the target workpiece W and the hand 14 overlap when viewed in the direction of the reference axis T and a candidate in which the offset direction of the suction device 15 relative to the reference axis T is parallel to the reference side when viewed in the direction of the reference axis T. In this case, if there is no candidate for the relative position and orientation of the hand 14 in which the reference side of the target workpiece W and the hand 14 do not overlap when viewed in the direction of the reference axis T and the offset direction of the suction device 15 is non-parallel to the reference side, the position and orientation determiner 35 determines, as the relative position and orientation of the hand 14, a candidate that does not satisfy this condition. In this case, the target workpiece W cannot be placed with the reference side portion in contact with the object that serves as the reference for placement, but at least the target workpiece W can be transported.
[0086] Other Embodiments As described above, the above-described embodiments have been described as examples of the technology disclosed in the present application. However, the technology of the present disclosure is not limited to these embodiments and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made as appropriate. Furthermore, the components described in the above-described embodiments can be combined to create new embodiments. Furthermore, the components described in the accompanying drawings and detailed description may include not only components essential for solving the problem, but also components that are not essential for solving the problem in order to exemplify the technology. Therefore, the fact that these non-essential components are described in the accompanying drawings or detailed description should not be interpreted as immediately determining that these non-essential components are essential.
[0087] For example, the robot system 100 incorporating the main control device 3 is not limited to one that transfers the target workpiece W from the first container 91 to the second container 92. For example, the robot 1 may also perform debunking.
[0088] The robot arm 12 is not limited to a vertical articulated robot arm, but may be a horizontal articulated robot arm, a parallel link robot arm, a rectangular coordinate robot arm, a polar coordinate robot arm, or the like.
[0089] The suction device 15 does not have to rotate around the reference axis T relative to the robot arm 12. Even if the suction device 15 cannot rotate around the reference axis T, it only needs to be disposed at a position offset in the radial direction from the reference axis T of the robot arm 12, that is, at a position eccentric to the reference axis T. The suction device 15 may attract the workpiece by magnetic force or the like instead of negative pressure.
[0090] The camera 51 does not have to include the first camera 51A and the second camera 51B. One camera 51 may capture an image of the inside of the first container 91 and an image of the inside of the second container 92. The camera 51 may not be fixedly disposed, but may be attached to the robot arm 12 and moved by the robot arm 12.
[0091] The robot system 100 may not be equipped with the camera 51. In that case, an image may be input to the main control device 3 from outside. The method of acquiring the image does not matter. The image input from outside may be stored in the memory 33 or the storage device 32.
[0092] The target workpieces to be picked may not be piled up randomly but may be aligned. The target workpieces are not limited to rectangular parallelepiped workpieces. For example, the target workpieces may have a substantially triangular prism shape. The target workpieces may also be bags filled with powder or granular material such as fertilizer, lime, or gravel.
[0093] The reference side of the target workpiece is not limited to a flat surface. If the target workpiece is a bag-shaped workpiece, the reference side may be a portion facing laterally relative to the suction surface that comes into contact with the suction unit 15.
[0094] Alternatively, the position and orientation determiner 35 may approximate the target workpiece to a rectangular parallelepiped, use one face of the approximate rectangular parallelepiped as the chucking face, and use the face on the side of the chucking face as the reference side. For example, the position and orientation determiner 35 may approximate the target workpiece using an OBB (Oriented Bounding Box).
[0095] The processing by the detector 34, the position and orientation determiner 35, the motion controller 36, and the imaging controller 37 is merely an example. For example, the detector 34 can detect the target surface S from the image by various methods. The position and orientation determiner 35 can determine the relative position and orientation of the hand 14 by various methods.
[0096] For example, the position and orientation determiner 35 may execute the pickup position planning after the place position planning. In this case, the position and orientation determiner 35 can determine the relative position and orientation of the hand 14 during picking based on the previously determined place target position. For example, in the case of a place target position where one of the sides of the target workpiece W is to be brought into contact with an object serving as a reference for placement, the position and orientation determiner 35 determines, as the relative position and orientation of the hand 14, a posture where the hand 14 does not overlap with the side to be contacted when viewed in the direction of the reference axis T and where the offset direction of the suction device 15 is not parallel to the side to be contacted. In the case of a place target position where neither side of the target workpiece W is to be brought into contact with another object, the position and orientation determiner 35 determines the relative position and orientation of the hand 14 without being constrained by the positional relationship between the side of the target workpiece W and the offset directions of the hand 14 and the suction device 15.
[0097] When determining the relative position and posture of the hand 14, the position and posture determiner 35 sequentially changes the reference side among the sides of the target workpiece W, but is not limited to this. The reference side may be predetermined to a specific side among the sides of the target workpiece W. For example, two sides that form a specific corner of the target workpiece W may be predetermined as the reference sides. A relative position and posture of the hand 14 is determined such that the hand 14 does not overlap with the two predetermined reference sides when viewed in the direction of the reference axis X and the offset position of the suction device 15 is not parallel to the two predetermined reference sides.
[0098] When prioritizing candidates for the relative position and posture of the hand 14, the position and posture determiner 35 may change the magnitude of the priority depending on the angle between the reference side and the offset direction of the suction unit 15. For example, the priority may be increased continuously or stepwise as the angle between the reference side and the offset direction of the suction unit 15 increases.
[0099] When generating candidates for the relative position and posture of the hand 14, the position and posture determiner 35 does not need to generate as candidates the relative position and posture of the hand 14 in which the reference side of the target workpiece W and the hand 14 overlap when viewed in the direction of the reference axis T, or the relative position and posture of the hand 14 in which the offset direction of the suction unit 15 is parallel to the reference side when viewed in the direction of the reference axis T. In other words, the position and posture determiner 35 may generate as candidates only the relative position and posture of the hand 14 in which the reference side of the target workpiece W and the hand 14 do not overlap when viewed in the direction of the reference axis T and the offset direction of the suction unit 15 with respect to the reference axis T is not parallel to the reference side.
[0100] The control device does not have to be a single device like the main control device 3. The control device may include multiple separate devices. For example, the detector 34, the position and attitude determiner 35, and the motion controller 36 may each be realized by a separate device.
[0101] The flowchart is merely an example. Steps in the flowchart may be changed, replaced, added, omitted, etc. as appropriate. The order of steps in the flowchart may also be changed, and serial processing may be performed in parallel. For example, photographing the interior of the second container 92 in step S105 and planning the placement position in step S106 in FIG. 6 may be performed at any time before the placing operation. Specifically, photographing the interior of the second container 92 and planning the placement position may be performed prior to or in parallel with the pickup position planning, etc.
[0102] The functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a Central Processing Unit (CPU), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered a circuit or processing circuit. A processor may also be a programmable processor that executes a program stored in a memory.
[0103] In this specification, a circuit, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions.
[0104] If the hardware is a processor considered to be a type of circuitry, the circuit, means, or unit is a combination of hardware and software used to configure the hardware and / or processor.
[0105] The technology of the present disclosure can be summarized as follows.
[0106] [1] A main control device 3 (control device) controls a robot 1 having a robot arm 12 and a hand 14 attached to the robot arm 12, the hand 14 including a suction device 15 arranged at a position offset in a radial direction centered on a predetermined reference axis T of the robot arm 12. The main control device 3 includes a detector 34 that detects a target workpiece W to be picked, and a position and orientation determiner 35 that determines the relative position and orientation of the hand 14, which is the position and orientation of the hand 14 with respect to the target workpiece W during picking, and the position and orientation determiner 35 determines, as the relative position and orientation of the hand 14, an orientation in which the hand 14 does not overlap with a side portion R1 that serves as a reference for the target workpiece W when viewed in the direction of the reference axis T and in which the offset direction of the suction device 15 with respect to the reference axis T is not parallel to the side portion R1.
[0107] According to this configuration, when viewed in the direction of the reference axis T, the reference axis T is spaced apart from the reference side R1. When viewed in the direction of the reference axis T, the attachment portion of the hand 14 of the robot arm 12 is less likely to overlap with the reference side R1, i.e., is less likely to extend beyond the reference side R1. This increases the options for how to place the target workpiece W, i.e., the placement position. For example, placing the target workpiece W with the reference side R1 in contact with another object can be added to the placement options. As a result, the target workpiece W can be picked and placed appropriately.
[0108] [2] In the main control device 3 described in [1], the position and attitude determiner 35 further determines a target placement position for the target work W picked up by the hand 14, and the target placement position is the position where the side part R1 contacts an object that serves as a reference for placement.
[0109] According to this configuration, the reference side R1 of the target workpiece W is the portion that comes into contact with the object that serves as the reference for placement when the target workpiece W is placed. By adopting the relative position and posture of the hand 14 as described above based on the reference side R1 of the target workpiece W, it becomes easier to place the target workpiece W with the reference side R1 in contact with the object that serves as the reference for placement. For example, the target workpiece W can be placed by coming into contact with, for example, the side of the second container 92 or a target workpiece W that has been previously placed. This allows the target workpieces W to be packed tightly into the second container 92, thereby improving the efficiency with which the target workpieces W can be accommodated in the second container 92.
[0110] [3] In the main control device 3 described in [1] or [2], the position and posture determiner 35 determines, as the relative position and posture of the hand 14, a posture in which the hand 14 does not overlap with at least two side portions R1, R2 that serve as references for the target workpiece W when viewed in the direction of the reference axis T, and the offset direction of the suction device 15 with respect to the reference axis T is non-parallel to both of the at least two side portions R1, R2.
[0111] According to this configuration, when viewed in the direction of the reference axis T, the reference axis T is spaced apart from at least two reference sides R1 and R2. In other words, when viewed in the direction of the reference axis T, the attachment portion of the hand 14 of the robot arm 12 is less likely to overlap with the reference sides R1 and R2. This further increases the options for how to place the target workpiece W, i.e., the placement position. This allows for placement options to include placing the target workpiece W with the reference side R1 in contact with another object, placing the reference side R2 in contact with another object, and placing the target workpiece W with both reference sides R1 and R2 in contact with another object. Furthermore, since the target workpiece W can be placed in contact with two placement references, the target workpiece W can be placed more orderly. As a result, picking and placing of the target workpiece W can be performed more appropriately.
[0112] [4] In the main control device 3 described in any one of [1] to [3], the at least two side portions R1, R2 are two side portions of the target workpiece W that are connected to form a corner.
[0113] According to this configuration, when viewed in the direction of the reference axis T, the reference axis T is spaced apart from the angle formed by the two reference side portions R1, R2. This allows the target workpieces W to be placed by aligning the angle formed by the two reference side portions R1, R2 with a corner inside the second container 92. As a result, the target workpieces W can be placed more orderly, and the target workpieces W can be picked and placed more appropriately.
[0114] [5] In the main control device 3 described in any one of [1] to [4], the side portion R1 is a side surface of the target workpiece W that intersects with the suction surface that is adsorbed by the suction device 15.
[0115] According to this configuration, the side portion R1 of the target workpiece W is a surface facing laterally relative to the suction surface. For example, in the case of a target workpiece W having a substantially rectangular parallelepiped shape, the four side surfaces other than the suction surface and the surface opposite thereto can be the side portion R1.
[0116] [6] In the main control device 3 described in any one of [1] to [5], the position and attitude determiner 35 creates multiple candidates for the relative position and attitude of the hand 14, and among the multiple candidates, determines a candidate in which the hand 14 does not overlap with the reference side R1 of the target workpiece W when viewed in the direction of the reference axis T and the offset direction OD of the suction device 15 with respect to the reference axis T is not parallel to the side R1 as the relative position and attitude of the hand 14 in priority to a candidate in which the hand 14 overlaps with the reference side R1 of the target workpiece W when viewed in the direction of the reference axis T and a candidate in which the offset direction OD of the suction device 15 with respect to the reference axis T is parallel to the side R1 when viewed in the direction of the reference axis T.
[0117] According to this configuration, the relative position and posture of the hand 14 in which the hand 14 overlaps with the reference side R1 of the target workpiece W or the relative position and posture of the hand 14 in which the offset direction OD of the suction device 15 is parallel to the side R1 are also generated as candidates. Basically, a candidate in which the hand 14 does not overlap with the reference side R1 of the target workpiece W and the offset direction OD of the suction device 15 is not parallel to the side R1 is determined as the relative position and posture of the hand 14. However, if such a candidate does not exist, a candidate in which the hand 14 overlaps with the reference side R1 of the target workpiece W or a candidate in which the offset direction OD of the suction device 15 is parallel to the side R1 can be determined as the relative position and posture of the hand 14. Therefore, even if the optimal relative position and posture of the hand 14 cannot be realized, at least the transfer of the target workpiece W can be achieved.
[0118] [7] The robot system 100 includes a robot 1 having a robot arm 12, a suction device 15 disposed at a position radially offset from a predetermined reference axis T of the robot arm 12, and a hand 14 attached to the robot arm 12, and a main control device 3.
[0119] According to this configuration, when viewed in the direction of the reference axis T, the reference axis T is spaced apart from the reference side R1. When viewed in the direction of the reference axis T, the attachment portion of the hand 14 of the robot arm 12 is less likely to overlap with the reference side R1, i.e., is less likely to extend beyond the reference side R1. This increases the options for how to place the target workpiece W, i.e., the placement position. For example, placing the target workpiece W with the reference side R1 in contact with another object can be added to the placement options. As a result, the target workpiece W can be picked and placed appropriately.
[0120] [8] A control method for a robot 1 includes detecting a target workpiece W to be picked by the robot 1, which includes a robot arm 12 and a hand 14 attached to the robot arm 12, the robot arm 12 including a suction device 15 arranged at a position offset in a radial direction around a predetermined reference axis T of the robot arm 12, and determining a relative position and attitude of the hand 14, which is the position and attitude of the hand 14 with respect to the target workpiece W at the time of picking. In determining the relative position and attitude of the hand 14, an attitude is determined as the relative position and attitude of the hand 14 such that the hand 14 does not overlap with a reference side R1 of the target workpiece W when viewed in the direction of the reference axis T and the offset direction of the suction device 15 with respect to the reference axis T is not parallel to the side R1.
[0121] According to this configuration, when viewed in the direction of the reference axis T, the reference axis T is spaced apart from the reference side R1. When viewed in the direction of the reference axis T, the attachment portion of the hand 14 of the robot arm 12 is less likely to overlap with the reference side R1, i.e., is less likely to extend beyond the reference side R1. This increases the options for how to place the target workpiece W, i.e., the placement position. For example, placing the target workpiece W with the reference side R1 in contact with another object can be added to the placement options. As a result, the target workpiece W can be picked and placed appropriately.
[0122] 100 Robot system 1 Robot 12 Robot arm 14 Hand 15 Suction device 3 Main control device (control device) 34 Detector 35 Position and orientation determiner T Reference axis R1 Reference side (side) R2 Reference side (side) W Target work
Claims
1. A control device for controlling a robot having a robot arm and a hand attached to the robot arm, the hand including a suction device arranged at a position offset in a radial direction centered on a predetermined reference axis of the robot arm, the control device comprising: a detector for detecting a workpiece to be picked; and a position and orientation determiner for determining the relative position and orientation of the hand, which is the position and orientation of the hand with respect to the target workpiece at the time of picking, the position and orientation determiner determining, as the relative position and orientation of the hand, an orientation in which the hand does not overlap with a reference side portion of the target workpiece when viewed in the direction of the reference axis and the offset direction of the suction device with respect to the reference axis is not parallel to the side portion.
2. A control device as described in claim 1, wherein the position and orientation determiner further determines a target placement position of the target workpiece picked by the hand, and the target placement position is a position where the side portion comes into contact with an object that serves as a reference for placement.
3. A control device as described in claim 1, wherein the position and posture determiner determines, as the relative position and posture of the hand, a posture in which the hand does not overlap with either of at least two sides that serve as references for the target workpiece when viewed in the direction of the reference axis, and the offset direction of the suction device relative to the reference axis is non-parallel to either of the at least two sides.
4. A control device according to claim 3, wherein the at least two side portions are two side portions of the target workpiece that are joined to form an angle.
5. A control device according to claim 1, wherein the side portion is a side surface of the target workpiece that intersects with an adsorption surface that is adsorbed by the adsorber.
6. A control device as described in claim 1, wherein the position and posture determiner creates multiple candidates for the relative position and posture of the hand, and among the multiple candidates, determines as the relative position and posture of the hand a candidate in which the hand does not overlap with a reference side portion of the target workpiece when viewed in the direction of the reference axis and the offset direction of the suction unit relative to the reference axis is not parallel to the side portion, in priority to a candidate in which the hand overlaps with a reference side portion of the target workpiece when viewed in the direction of the reference axis and a candidate in which the offset direction of the suction unit relative to the reference axis is parallel to the side portion when viewed in the direction of the reference axis.
7. A robot system comprising: a robot having a robot arm, a hand attached to the robot arm, the hand including a suction device arranged at a position offset in a radial direction centered on a predetermined reference axis of the robot arm; and the control device according to claim 1.
8. A method for controlling a robot, comprising: detecting a target workpiece to be picked by a robot having a robot arm, a hand attached to the robot arm, the robot arm including a suction device arranged at a position offset in a radial direction centered on a predetermined reference axis of the robot arm; and determining a relative position and attitude of the hand, which is the position and attitude of the hand with respect to the target workpiece at the time of picking; wherein in determining the relative position and attitude of the hand, an attitude in which the hand does not overlap with a reference side portion of the target workpiece when viewed in the direction of the reference axis and the offset direction of the suction device with respect to the reference axis is not parallel to the side portion is determined as the relative position and attitude of the hand.
Citation Information
Patent Citations
Device to take out material
JP1985019621A
Robot system and method for conveying work
JP2014176926A
Handling device, control device and holding method
JP2021041513A
