Robot, robot control device, and working robot system

Abstract

This robot 10 comprises an arm 10a and a control device for controlling the arm and performs a predetermined work on a part to be worked of an article 100 being moved by an article moving device. The control device performs passing point following control to control the arm 10a at one or each of multiple passing points 211, 212 before moving a component 110 or a tool supported by the arm 10a to a work start position 220 such that the component 110 or the tool follows the article 100 being moved. In addition, the control device places the component 110 or the tool in the work start position 220 after the passing point following control and controls the arm 10a such that the component 110 or the tool follows the article 100 during the work.

Description

[Technical Field]

[0001] The present invention relates to a robot, a robot control device, and a working robot system. [Background technology]

[0002] In the past, it was common for conveyance systems to stop when assembling parts onto an item being conveyed by the system. This was especially true when precisely assembling parts onto a large item, such as an automobile body. This sometimes led to a decrease in system efficiency.

[0003] On the other hand, there is known a robot system in which a robot follows an object or the like being moved by a conveying device. For example, see Patent Documents 1 to 3. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-140084 [Patent Document 2] Japanese Patent Publication No. 62-241684 [Patent Document 3] Japanese Patent Application Laid-Open No. 2007-090479 Summary of the Invention [Problem to be solved by the invention]

[0005] As mentioned above, it is important for the efficiency of the system that a robot be moved by a transport device or the like to perform work on an object. In this case, depending on the type of object, it may be preferable not to move the part at the tip of the robot in a straight line toward the work start position. Alternatively, depending on the type of object, it may not be possible to move the part at the tip of the robot in a straight line toward the work start position. For example, this may occur when moving the part in a straight line would result in contact with the object. Thus, there is a demand for a robot, a robot control device, and a work robot system that can avoid contact between the part or tool supported by the robot and the object as much as possible. [Means for solving the problem]

[0006] A first aspect of the present invention is a robot that includes an arm and a control device that controls the arm, and that performs a predetermined task on a target portion of an article that is being moved by an article moving device. The control device is configured to perform way point tracking control, which controls the arm so that the part or tool supported on the tip of the arm follows the moving article at each of one or more way points before moving the part or tool supported on the tip of the arm to a task start position for the predetermined task. The control device is also configured to perform work-time tracking control, which controls the arm so that the part or tool follows the moving article at each of one or more way points after the way point tracking control, and places the part or tool at the task start position.

[0007] A second aspect of the present invention is a robot control device that controls a robot arm that performs a predetermined task on a target portion of an article being moved by an article moving device. The control device is configured to perform way point tracking control, which controls the arm so that the part or tool supported at the tip of the arm follows the moving article at each of one or more way points before moving the part or tool supported at the tip of the arm to a task start position for the predetermined task. The control device is also configured to perform work-time tracking control, which places the part or tool at the task start position after the way point tracking control, and controls the arm so that the part or tool follows the moving article during the task.

[0008] A third aspect of the present invention is a working robot system including an article moving device that moves an article, a robot having an arm, and a control device that controls the arm to perform a predetermined task on a target portion of the article being moved by the article moving device. The control device is configured to perform way point tracking control, which controls the arm so that the part or tool supported on the tip of the arm follows the moving article at each of one or more way points before moving the part or tool to a task start position for the predetermined task. The control device is also configured to perform work-time tracking control, which places the part or tool at the task start position after the way point tracking control, and controls the arm so that the part or tool follows the moving article during work. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic plan view of a working robot system according to a first embodiment. [Figure 2] FIG. 1 is a schematic side view of a working robot system according to a first embodiment. [Figure 3] 3 is an example of image data obtained by a sensor of the working robot system of the first embodiment. [Figure 4]FIG. 2 is a block diagram of a control device of the working robot system of the first embodiment. [Figure 5] 4 is a flowchart of an example of processing performed by the control device of the working robot system of the first embodiment. [Figure 6] 3 is an example of a screen of a display device of the working robot system of the first embodiment. [Figure 7] 4 is a flowchart of an example of processing performed by the control device of the working robot system of the first embodiment. [Figure 8] FIG. 1 is a schematic plan view of a working robot system according to a first embodiment. [Figure 9] 3 is an example of a screen of a display device of the working robot system of the first embodiment. [Figure 10] FIG. 10 is a schematic plan view of a working robot system according to a second embodiment. [Figure 11] FIG. 10 is a schematic side view of a working robot system according to a third embodiment. [Figure 12] FIG. 10 is a schematic plan view of a working robot system according to a third embodiment. [Figure 13] 10 is an example of a screen of a display device of a working robot system according to a third embodiment. [Figure 14] 10 is a flowchart of an example of processing performed by a control device of a working robot system according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] A working robot system 1 according to a first embodiment will be described with reference to the drawings. As shown in Figures 1 and 2, working robot system 1 includes a transport device (article moving device) 2 that transports an article 100, which is the work target. Working robot system 1 also includes a robot 10, a control device 20 that controls robot 10, and a detection device 40. Robot 10 performs a predetermined task on a target portion 101 of article 100 that is moved by transport device 2. Working robot system 1 also includes a first tracking sensor 50 and a second tracking sensor 60 attached to the tip of robot 10.

[0011] The detection device 40 acquires data that can identify at least the position of the article 100 and its target portion 101 transported by the transport device 2. The detection device 40 may also acquire data that can identify the position and posture of the target portion 101. In the first embodiment, the target portion 101 has multiple holes 101a. The function of the detection device 40 may be performed by the tracking sensors 50 and 60.

[0012] Any device having the above-described functions can be used as the detection device 40. The detection device 40 is, for example, a two-dimensional camera, a three-dimensional camera, a three-dimensional distance sensor, a sensor that measures the shape of an object by irradiating a line of light onto the object, a photoelectric sensor, etc. The detection device 40 of the first embodiment has the same functions as the tracking sensors 50 and 60. The detection device 40 of the first embodiment is a two-dimensional camera installed along the conveyance route of the conveyance device 2. The detection device 40 acquires image data of the object 101 when the object 101 is within a predetermined range of the angle of view, and transmits the image data as output to the control device 20. The detection device 40 may be a camera or sensor facing downward, or a camera or sensor facing horizontally, diagonally downward, etc.

[0013] The image data is data that can identify the position of at least one of the multiple target portions 101. The control device 20 may identify the position of the target portion 101 based on the position, shape, etc. of a characteristic portion of the article in the image data. The control device 20 can also identify the orientation of the target portion 101 based on the positional relationship of the multiple target portions 101 in the image data. The control device 20 can identify the orientation of the target portion 101 based on the position, shape, etc. of the characteristic portion in the image data. The characteristic portion may be a characteristic element such as the mark M shown in FIG. 3 or a corner of the article 100.

[0014] The article 100 is not limited to a specific type of object, but in the first embodiment, as an example, the article 100 is a car body. The conveying device 2 moves the article 100 in one direction by driving the motor 2a, and in the first embodiment, the conveying device 2 moves the article 100 toward the right side in FIG. 2. The motor 2a is equipped with an actuation position detection device 2b, which sequentially detects the rotation position and amount of rotation of the output shaft of the motor 2a. The actuation position detection device 2b is, for example, an encoder. The detection value of the actuation position detection device 2b is transmitted to the control device 20. The conveying device 2 may also be equipped with other components for moving the article 100, such as a belt.

[0015] The configuration described in this specification can also be applied to a working robot system 1 that performs other tasks, such as processing, assembly, inspection, and observation, on the item 100. The item 100 may be transported by any means of transportation, and a robot other than the robot 10 may be used as the item moving device. If the item 100 is the body or frame of an automobile, the body or frame may be moved by an engine, motor, wheels, etc. mounted thereon. In this case, the engine, motor, wheels, etc. function as the item moving device. The item 100 may be moved by an AGV (Automated Guided Vehicle) or the like as the item moving device. Furthermore, the control device 20 may receive data on the movement route of the item 100 or target part 101 from the control device of another robot, an automobile, an AGV, sensors provided thereon, etc. Alternatively, the control device 20 may calculate the movement route data using image data sequentially obtained by the detection device 40, tracking sensors 50, 60, etc.

[0016] The target portion 101 is a portion of the article 100 on which the arm 10a of the robot 10 performs a predetermined operation. In the first embodiment, as the predetermined operation, the arm 10a lifts the component 110 using the tool 30, and then attaches the attachment portion 111 of the component 110 to the target portion 101. As a result, for example, multiple shafts 111a extending downward from the attachment portion 111 of the component 110 are fitted into multiple holes 101a provided in the target portion 101 of the article 100. In the first embodiment, the arm 10a attaches the attachment portion 111 of the component 110 to the target portion 101 while the article 100 continues to be moved by the conveyance device 2.

[0017] Although the robot 10 is not limited to a specific type, the robot 10 of the first embodiment is a multi-joint robot having six axes. The arm 10a is equipped with a plurality of servo motors 11 that respectively drive a plurality of movable parts 12 (see FIGS. 2 and 4). Each servo motor 11 has an operating position detection device for detecting its operating position, and the operating position detection device is, for example, an encoder. The control device 20 receives the detection values ​​of the operating position detection devices.

[0018] The robot 10 has a tool 30 attached to its tip, and the tool 30 is used to carry a part 110 . In one example, the tool 30 is a hand, and the tool 30 is equipped with a servo motor 31 that drives a claw (see FIG. 4). The servo motor 31 has an operating position detection device for detecting its operating position, and the operating position detection device is, for example, an encoder. The detected value of the operating position detection device is transmitted to the control device 20. Various types of servo motors, such as rotary motors and linear motors, can be used as the servo motors 11 and 31.

[0019] The robot 10 has a force sensor 32 at its tip. The force sensor 32 detects forces in, for example, the X-axis, Y-axis, and Z-axis directions shown in FIGS. 1 to 3. The force sensor 32 also detects forces around the X-axis, Y-axis, and Z-axis. Other sensors that can detect the direction and magnitude of force applied to the tool 30 or the part 110 gripped by the tool 30 can be used as the force sensor 32. In the first embodiment, the force sensor 32 is provided between the robot 10 and the tool 30. Alternatively, the force sensor 32 may be provided within the tool 30, at the base end of the arm 10a, in another part of the arm 10a, in the base of the robot 10, or the like.

[0020] The tracking sensors 50, 60 are attached to the tip of the arm 10a. In one example, the tracking sensors 50, 60 are attached to the wrist flange 10b of the arm 10a, similar to the tool 30. The tracking sensors 50, 60 are two-dimensional cameras, three-dimensional cameras, three-dimensional distance sensors, etc. In the first embodiment, the tracking sensors 50, 60 are two-dimensional cameras.

[0021] In the first embodiment, the first tracking sensor 50 can sequentially acquire image data of the target 101 as shown in FIG. 3 when the target 101 is within a predetermined range of the angle of view. The first tracking sensors 50, 60 can sequentially acquire image data when the via-point tracking targets 121, 122, and 123 shown in FIG. 1 are within a predetermined range of the angle of view. The tracking sensors 50, 60 sequentially transmit image data (output) to the control device 20. The image data is data that can identify at least the positions of the target 101 and the via-point tracking targets 121, 122, and 123 transported by the transport device 2. The tracking sensors 50, 60 may also acquire image data that can identify the positions and orientations of the target 101 and the via-point tracking targets 121, 122, and 123.

[0022] When multiple target portions 101 exist, the image data is data that can identify the position of at least one of the multiple target portions 101. The control device 20 may identify the position and orientation of the via point tracking targets 121, 122, 123, etc. based on the position, shape, etc. of a characteristic portion of the article in the image data. The control device 20 can also identify the orientation of the target portions 101, via point tracking targets 121, etc. based on the positional relationship, etc. of the multiple target portions 101 and multiple via point tracking targets 121 in the image data. The characteristic portion may be a characteristic element such as the mark M shown in FIG. 3 or a corner of the article 100.

[0023] The position and direction of the coordinate system of the tracking sensors 50, 60 and the position and direction of the coordinate system of the robot 10 are previously associated within the control device 20. In one example, the coordinate system of one of the tracking sensors 50, 60 is set as the reference coordinate system of the robot 10 that operates based on the operation program 23b stored in the control device 20. It is possible to associate the reference coordinate system with a coordinate system whose origin is the tool center point (TCP) of the tool 30, a coordinate system whose origin is the reference position of the part 110, or the like.

[0024] As shown in FIG. 4 , the control device 20 has a processor 21 having one or more processor elements such as a CPU, a microcomputer, etc., and a display device 22. The control device 20 has a memory unit 23 having a non-volatile storage, a ROM, a RAM, etc. The control device 20 has a plurality of servo controllers 24 corresponding to the servo motors 11 of the robot 10, respectively, and a servo controller 25 corresponding to the servo motors 31 of the tool 30. The control device 20 also has an input unit 26 connected to the control device 20 by wire or wirelessly. In one example, the input unit 26 is an input device such as a control panel that can be carried by the user. In another example, the input unit 26 is a tablet computer. In the case of a tablet computer, the input is performed using a touch screen function. The control panel or tablet computer may have the display device 22.

[0025] The memory unit 23 stores a system program 23a, which performs the basic functions of the control device 20. The memory unit 23 also stores an operation program 23b. The memory unit 23 also stores a pre-approach control program 23c, a waypoint tracking control program 23d, an in-operation tracking control program 23e, and a force control program 23f.

[0026] Based on these programs, the control device 20 transmits control commands to the servo controllers 24, 25 to perform a predetermined task on the article 100. This causes the arm 10a and the tool 30 to perform the predetermined task on the article 100. The operation of the control device 20 at this time will be described with reference to the flowchart in FIG.

[0027] First, the control device 20 detects the article 100 based on the output of the detection device 40 or the tracking sensors 50, 60 (step S1-1). After this detection, the control device 20 transmits control commands to the arm 10a and the tool 30 based on the pre-approach control program 23c (step S1-2). As a result, the arm 10a moves the tool 30, which was in the standby position, to the position where the part 110 is placed, and the tool 30 grips the part 110. The arm 10a also moves the part 110 to the approach start position 200 shown in FIG. 1.

[0028] 1, in the first embodiment, the approach start position 200 is a position closer to the base end of the robot 10 than the boundary line BL. Also, in the first embodiment, the approach start position 200 and a waypoint, which will be described later, are positions corresponding to the attachment portion 111 of the component 110. Alternatively, the approach start position 200 and the waypoint may be positions corresponding to other positions on the component 110, the tip of the arm 10a, a predetermined position of the tool 30, or the like.

[0029] Here, the position and posture of each article 100 on the conveying device 2 may vary. This variation occurs, for example, when each article 100 is placed on the conveying device 2. This variation may also occur when each article 100 on the conveying device 2 moves slightly in an unintended direction due to vibration or the like. As shown in FIG. 1, the article 100 may be placed on the conveying device 2 in a state rotated about the vertical axis. In this case, one end 120 of the article 100 in the X direction is positioned closer to the robot 10 than the target part 101 in the Y direction.

[0030] The one end 120 can be said to be an interference location. In one example, the interference location is a location that is close to the robot 10, the tool 30, and the part 110 in the Y direction. In FIG. 1, the rotation of the article 100 is exaggerated. For example, if the length of the article 100 is about 5 m, the rotational position of the article 100 around the vertical axis may vary within a range of about 2°. In this case, the position of the one end 120 may vary by 10 cm or more, sometimes by 20 cm or more, in the Y direction. If the variation in the placement position in the Y direction is added to this variation, the variation in the position of the one end 120 in the Y direction becomes even greater.

[0031] In one example, the memory unit 23 of the control device 20 stores start position data 23g, which is the coordinate values ​​of the part 110 at the approach start position 200 (FIG. 4). That is, as shown in FIG. 1, the arm 10a places the part 110 at the approach start position 200 corresponding to the start position data 23g. As a result, even if the one end 120 is moved by the conveyance device 2 until it passes in front of the part 110, the part 110 does not interfere with the one end 120. In the first embodiment, interference refers to the one end 120 interfering with the part 110, the arm 10a, or the tool 30 while the one end 120 passes in front of the part 110, as described above. The memory unit 23 of the control device 20 may also store start position data 23g, which is the coordinate values ​​of the tool 30 or the coordinate values ​​of the tip of the arm 10a.

[0032] In another example, the memory unit 23 of the control device 20 stores position information of the boundary line BL as boundary position data 23h (FIG. 4). The memory unit 23 of the control device 20 may store information on an area AR1 where interference may occur, information on an area AR2 where interference will not occur, etc. (FIG. 4). As shown in FIG. 1, the boundary line BL is a line that separates the area AR1 where interference may occur and the area AR2 where interference will not occur due to the one end 120 being moved by the conveyance device 2. The start position data 23g and / or the boundary position data 23h enable the arm 10a to position the part 110 at the approach start position 200 so as not to come into contact with the article 100.

[0033] The memory unit 23 may store at least one of the start position data 23g and the boundary position data 23h. In one example, based on a user's input to the input unit 26, the control device 20 stores the start position data 23g and the boundary position data 23h in the memory unit 23. In another example, the control device 20 detects or calculates a path of the one end 120 moved by the conveying device 2 using image data from the detection device 40 or the tracking sensor 50.

[0034] In one example, the path corresponds to the boundary line BL. The control device 20 then sets the start position data 23g and the boundary position data 23h based on the results of the detection or calculation. The control device 20 may update the start position data 23g and the boundary position data 23h each time the next item 100 arrives. For example, when the next item 100 to be worked on arrives, the control device 20 detects the position of the one end 120 using image data. The control device 20 then updates the start position data 23g or the boundary position data 23h using the detected position or using the detected position and data on the movement route of the conveyance device 2. This update prevents the distance between the part 110 and the target part 101 at the approach start position 200 from becoming unnecessarily long. The start position data 23g may also be data indicating a predetermined range. In this case, the arm 10a moves the part 110 to any position within the predetermined range. Setting the approach start position 200 can also be substituted for setting the first waypoint 211, which will be described later.

[0035] Based on the pre-approach control program 23c, the control device 20 adjusts the attitude of the part 110 at the approach start position 200 or the attitude of the part 110 heading towards the approach start position 200 to match the attitude of the target part 101 (step S1-3). In one example, the control device 20 adjusts the attitude of the part 110 while the part 110 is moving towards the approach start position 200 or when the part 110 reaches the approach start position 200. For example, the control device 20 detects the attitude of the target part 101 using image data from the tracking sensors 50 and 60, and adjusts the attitude of the part 110 to match the detected attitude. It is also possible to set the control device 20 not to execute step S1-3.

[0036] The control device 20 causes the arm 10a to make the part 110 follow the article 100 at the first way point 211 (FIG. 1) based on the way point following control program 23d (step S1-4). Following at the second way point 212 is also performed based on the way point following control program 23d. In the first embodiment, a position corresponding to the attachment portion 111 of the part 110 follows the part 110. Note that the way points 211 and 212 are relative positions with respect to the article 100. A setting may be used in which the tip of the arm 10a, the tool 30, etc. follow the article 100 at the first way points 211 and 212.

[0037] For this tracking, the control device 20 performs visual feedback using image data sequentially obtained by, for example, the tracking sensors 50 and 60. In another example, the control device 20 performs visual feedback using data sequentially obtained by other cameras, other sensors, etc. The other cameras and other sensors may be supported on the tip of another robot, or may be fixed in a predetermined location. The other cameras and other sensors may be supported on a slider that is movable in the conveying direction by the conveying device 2. Depending on the type, shape, etc. of the target part 101, the tracking sensors 50 and 60, other cameras, and other sensors may be three-dimensional cameras or three-dimensional distance sensors.

[0038] A known visual feedback may be used for the above control. In the first embodiment, for example, either of the following two types of control may be adopted as the visual feedback control. In the two types of control, the control device 20 detects at least the position of the via point tracking target 121, and causes the part 110 to follow the article 100 based on the detected position. The control by the control device 20 is also the same when causing the part 110 to follow the article 100 based on the positions of the via point tracking targets 122, 123, the target part 101, etc.

[0039] The route along which the article 100 is moved by the conveying device 2 may not be a straight line. Also, the posture of the article 100 on the conveying device 2 may gradually change due to vibrations or the like. In these cases, the control device 20 may make the posture of the part 110 follow the posture of the target part 101 in step S1-4 and step S1-5 described later. In particular, making the posture of the part 110 follow the posture of the target part 101 in step S1-5 is useful for smoothly performing work on the target part 101 by the arm 10a.

[0040] The first control is a control for making the part 110 follow the article 100 by always positioning the target to be followed at a predetermined position within the angle of view of the tracking sensors 50 and 60. The second control detects the position of the target to be followed on the article 100 in the coordinate system of the robot 10 (position relative to the robot 10). The second control then corrects the operation program 23b using the detected position of the target to be followed, making the part 110 follow the article 100. The target to be followed is the waypoint target to be followed 121, 122, 123, the target part 101, etc.

[0041] In the first control, the control device 20 detects characteristic parts on the image data sequentially obtained by the first tracking sensors 50 and 60. The characteristic parts are the overall shape of the target part 101, the hole 101a in the target part 101, the mark M (FIG. 3) provided on the target part 101, etc. The overall shapes of the via-point tracking targets 121, 122, and 123 of the article 100 are also characteristic parts.

[0042] The control device 20 always positions the feature at a predetermined position in the image data so that it is within a reference shape and size range. The control device 20 sends a control command for this to the servo controller 24. This allows the control device 20 to make the part 110 track the position and orientation of the feature. If the tracking sensors 50, 60 are three-dimensional cameras, three-dimensional distance sensors, or the like, the control device 20 always positions the feature at a predetermined position in the three-dimensional image data so that it has a reference orientation. That is, the control device 20 sends a control command for this to the servo controller 24.

[0043] In the second control, the control device 20 detects the actual position of the characteristic part relative to the coordinate system of the robot 10 using image data sequentially obtained by the tracking sensors 50, 60, etc. Then, the control device 20 corrects the teaching points of the operation program 23b based on the difference between the position of the characteristic part assumed in the operation program 23b and the actual position of the characteristic part.

[0044] In one example, to execute step S1-4, the control device 20 always places the position of the first way point tracking target 121 obtained using the second tracking sensor 60 at a predetermined position on the image data. This causes the control device 20 to make the part 110 follow the article 100 at the first way point 211. When step S1-4 starts, for example, in FIG. 1, the position of the shaft 111a (relative position with respect to the article 100) moves from the approach start position 200 to the first way point 211.

[0045] Next, the control device 20 causes the arm 10a to make the part 110 follow the article 100 at the second way point 212 (step S1-5). To perform step S1-5, the control device 20 constantly places the position of the second way point follow target 122 obtained using the second following sensor 60 at a predetermined position on the image data. Alternatively, to perform step S1-5, the control device 20 constantly places the position of the third way point follow target 123 obtained using the first following sensor 50 at a predetermined position on the image data. The control device 20 may also make the part 110 follow both way point follow targets 122 and 123. The way point follow control at each way point 211 and 212 ends when the degree of match between the images sequentially obtained by the following sensors 50 and 60 and the teaching image exceeds a predetermined standard. For example, the control device 20 ends follow at the first way point 211 when the degree of match at the first way point 211 exceeds a predetermined standard. Then, the control device 20 proceeds to an operation for tracking control at the second way point 122. In one example, the time for which way point tracking control is performed at each way point 211, 212 is 0.1 seconds to several seconds. Way point tracking may also be performed for a time shorter than the above time. Note that the time, distance, etc. for which way point tracking control is performed at each way point 211, 212 can be set arbitrarily.

[0046] Next, the control device 20 moves the shaft 111a of the part 110 to the work start position 220 relative to the target part 101 based on the in-work tracking control program 23e (step S1-6). The control device 20 executes step S1-5 using the visual feedback and image data from the tracking sensors 50 and 60. In another example, in step S1-6, the control device 20 moves the part 110 by a predetermined distance toward the target part 101 using the arm 10a. In step S1-6, the control device 20 may use the arm 10a to move the part 110 closer to the target part 101 while using data from the other camera or other sensor. At this time, the control device 20 may use the visual feedback to cause the posture of the part 110 approaching the target part 101 to follow the posture of the target part 101.

[0047] By controlling the arm 10a in step S1-6, the part 110 reaches a position and posture for fitting to the target part 101. As a result, the target part 101 is present within a certain range of the angle of view of the first tracking sensor 50. Then, when the distance between the attachment part 111 and the target part 101 falls within a reference value (step S1-7), the control device 20 starts in-work tracking control (step S1-8). The control device 20 also starts fitting control to fit the attachment part 111 to the target part 101 based on the operation program 23b (step S1-9).

[0048] The control device 20 executes step S1-8 by making the part 110 follow the target part 101 based on the in-work follow-up control program 23e. In addition, the determination in step S1-7 becomes more accurate when the detection results of the second follow-up sensor 60, the other camera, or the other sensor are also used.

[0049] Preferably, the control device 20 uses the feature portion visible to the tracking sensor 50 when the mating is performed for the in-work tracking control in step S1-8. Alternatively, the control device 20 can change the feature portion used for the tracking control when the feature portion used for the tracking control becomes invisible to the tracking sensors 50, 60.

[0050] In this controlled state, the control device 20 starts force control based on the force control program 23f (step S1-10). Known force control can be used in step S1-10. In the first embodiment, under the control of the control device 20, the arm 10a moves the part 110 in a direction away from the force detected by the force sensor 32. The control device 20 determines the amount of movement in accordance with the value detected by the force sensor 32.

[0051] For example, after the fitting control is started, the force sensor 32 may detect a force in the opposite direction to the direction of movement by the conveyance device 2. In this case, the control device 20 performs in-work tracking control and moves the component 110 in the direction opposite to the direction of movement by the conveyance device 2 according to the detection value of the force sensor 32. Furthermore, if the force sensor 32 detects a force equal to or greater than a reference value, the control device 20 performs an abnormality response operation.

[0052] Meanwhile, the control device 20 determines whether the fitting operation is complete (step S1-11), and if the fitting operation is complete, sends a control command to the arm 10a and the tool 30 (step S1-12). As a result, the tool 30 moves away from the component 110, and the tool 30 is moved by the arm 10a to a standby position or a location where the next component 110 is stocked.

[0053] In the first embodiment, the position of the attachment unit 111 passes through a first way point 211 and a second way point 212 between the approach start position 200 and the work start position 220. Furthermore, at the first way point 211 and the second way point 212, the position of the attachment unit 111 follows the item 100 being conveyed by the conveyance device 2. If the first way point 211 and the second way point 212 are not set, the position of the attachment unit 111 moves, for example, in a straight line from the approach start position 200 to the work start position 220. If there is a possibility that the part 110 and the item 100 may come into contact with each other during this straight-line movement, the first embodiment, which allows for setting of the above-mentioned way points 211 and 212 to follow, is useful. Note that, when two tracking sensors 50 and 60 are used, even if these are two-dimensional sensors, it is possible to track the movement of the article 100 in each of the X, Y, and Z directions.

[0054] The conveying speed of the conveying device 2 may change under certain conditions. Or, when the detection device 40 detects the item 100, the position of the item 100 relative to the detection device 40 may not be completely constant. The latter is influenced by factors such as the cycle time when the control device 20 processes the image of the detection device 40. In these cases, the setting to perform the linear movement after a certain time from detection by the detection device 40 may result in contact between the part 110 and the item 100. Even in such a situation, the tracking setting at the above-mentioned way points 211 and 212 is useful.

[0055] Note that there may be cases where a single tracking sensor 50 is provided without the tracking sensor 60. Even in this case, as described above, it is possible to make the position of the shaft 111a follow the position of the article 100 being conveyed at the first way point 211 and the second way point 212.

[0056] The method and configuration for setting the tracking at the waypoints 211 and 212 will be described below. The user performs the setting by inputting information into the input unit 26, for example. The input unit 26 is an operation panel, a tablet computer, a remote controller with a joystick, or the like, and the input is performed using a touch screen function, a joystick, or the like.

[0057] The input unit 26 has a display device 22 that can display multiple types of screens for teaching the operation of the arm 10a. One of the multiple types of screens is a teaching screen for setting a movement path for the tip of the arm 10a, a predetermined position of the tool 30, etc. One example of the teaching screen is a known teaching screen in which a user teaches multiple teaching points. The user may teach the multiple teaching points by inputting coordinate values. The user may also teach the multiple teaching points by moving the tip of the arm 10a to multiple arbitrary positions and making a predetermined input to the input unit 26. The arm 10a can be moved in this case by known methods such as operating the joystick, operating the operation panel, or by the user applying force to the tip of the arm 10a to move it.

[0058] In the first embodiment, for example, the standby position, the position where the component 110 is placed, the approach start position 200, etc. are taught as the teaching points. At least one other of the plurality of types of screens is a way point teaching screen 300 (FIG. 6) for teaching the above-mentioned following at way points 211, 212. On the way point teaching screen 300 illustrated in FIG. 6, the user teaches the following target to be followed at each way point 211, 212. An example of the processing of the control device 20 for teaching the following target will be described below with reference to FIG. 7. Typically, the user teaches the following using a stationary article 100 on a stopped conveying device 2. However, there are also cases where the following teaching is possible even when the article 100 is being moved by the conveying device 2.

[0059] For example, the user places the tip of arm 10a in an arbitrary position and orientation, and in this state, the user performs a first input for setting a via point on input unit 26. In response to the first input, control device 20 causes each of tracking sensors 50, 60 to acquire an image at the position and orientation (step S2-1). Thereafter, the user performs a second input for setting a via point on input unit 26. In response to the second input, control device 20 determines a target to be tracked on the acquired image (step S2-3). The user actually places the arm 10a, tool 30, part 110, etc. relative to the article 100, and the control device 20 sets the target to be tracked based on an image acquired at that position. This configuration is useful for preventing contact, improving work efficiency, etc. Note that there may be cases where the control device 20 sets the first waypoint 211 as the approach start position 200.

[0060] Before the second input, the control device 20 displays one or more indicator figures 410 on the acquired image 400 shown in Fig. 6 (step S2-2). The acquired image 400 may be an enlarged portion of the image of the tracking sensors 50, 60 as shown in Fig. 6. Each indicator figure 410 indicates a portion on the acquired image 400 that can be set as a tracking target, or indicates a characteristic shape on the acquired image 400. Instead of the indicator figure 410 in Fig. 6, an indicator figure that highlights the outer edge, interior, etc. of a characteristic shape may be displayed. In a specification in which the characteristic shape indicated by the cursor is highlighted, the cursor also functions as an indicator figure.

[0061] The user moves or changes the size of the instruction graphic 410 as part of the second input. Alternatively, the user selects any one or more of the instruction graphics 410 as the second input. The characteristic shapes set by the second input become the via point tracking targets 121, 122, 123, etc. Note that when the control device 20 automatically sets the characteristic shapes on the acquired image 400 as via point tracking targets, the control device 20 does not perform the above-described processing for the second input.

[0062] Thereafter, the user performs a third input to the input unit 26 for setting a via point. In response to the third input, the control device 20 sets the tracking sensors 50, 60 to be used at each via point 211, 212. The via point teaching screen 300 has a sensor selection display 420 for selecting or displaying whether each of the tracking sensors 50, 60 is to be used for tracking at each via point 211, 212. The control device 20 sets the tracking sensor selected by the third input as the tracking sensor to be used for via point tracking (step S2-4). In the first embodiment, the user performs the third input using a check box belonging to the sensor selection display 420. Note that if the tracking sensor to be used for tracking is predetermined, or if only a single tracking sensor 50 is provided, the control device 20 does not perform the above-described process for the third input.

[0063] The user also provides a fourth input to the input unit 26 for setting a via point. In response to the fourth input, the control device 20 sets the following direction for via point tracking at each of the via points 211, 212 (step S2-5). More specifically, the control device 20 sets the following direction based on the input to the input unit 26. The via point teaching screen 300 has a direction selection display 430 for setting the following direction at each of the via points 211, 212 for each of the multiple following sensors 50, 60. The control device 20 sets the direction selected by the fourth input as the following direction at each of the via points 211, 212. Note that if the following direction is predetermined or if the control device 20 automatically sets the following direction, the control device 20 does not perform the above-described process for the fourth input.

[0064] With the above configuration, the user can set whether or not to use each of the tracking sensors 50, 60, and can easily set the tracking direction. The user can also perform a test operation to move the arm 10a under tracking control while changing the setting of the direction selection display 430. This configuration is useful for preventing contact, improving work efficiency, etc.

[0065] Fig. 6 shows that for the first way point, tracking control is performed only in the X direction using the image of the second tracking sensor 60. For the second way point 122, Fig. 6 also shows that the image of the first tracking sensor 50 is used for tracking control in the X and Y directions, and the image of the second tracking sensor 60 is used for tracking control in the Z direction.

[0066] The above configuration of the first embodiment is a useful aid for teaching way point tracking that performs tracking control at each way point 211, 212. Furthermore, the above configuration that enables selection of the tracking sensors 50, 60 at each way point 211, 212 is a useful aid for accurately performing tracking, robot operation, etc. at each way point 211, 212. Furthermore, the above configuration that enables setting the direction of each tracking sensor 50, 60 at each way point 211, 212 is also a useful aid for accurately performing tracking, robot operation, etc. at each way point 211, 212. As described above, the setting status of the tracking target is displayed on the way point teaching screen 300. This configuration is useful for the user to accurately and easily recognize whether or not a way point has been set, the setting status of each way point, etc.

[0067] One of the multiple types of screens is a work teaching screen for teaching work-time tracking at the work start position 220. As the work teaching screen, a known teaching screen for causing the shaft 111a of the part 110 to follow the target part 101 by visual feedback can be used. For example, the user places the arm 10a at the work start position 220, and the control device 20 causes the first tracking sensor 50 to acquire an image of the target part 101 at that position. In one example, the acquisition is performed when the user makes a predetermined input to the input unit 26. The control device 20 sets a characteristic shape in the acquired image as a tracking target, and the control device 20 performs the above-described work-time tracking control using the tracking target.

[0068] When the arm 10a moves to each way point 211, 212, the control device 20 may move the tip of the arm 10a in a predetermined direction based on the operation program 23b. In FIG. 1, when moving from way point 211 to way point 212, the control device 20 may move the part 110 in the Y direction based on the operation program 23b. In this case, the user can cancel the Y direction specification of the direction selection display 430 of the first tracking sensor 50 for the second way point on the way point teaching screen 300 of FIG. 6. With this setting, the control device 20 does not cause the part 110 to follow the article 100 in the Y direction for the second way point. If the direction of the operation control based on the control command of the operation program 23b and the direction of the tracking control match, the operation of the arm 10a may become unsmooth due to overshooting, etc. The above configuration is useful for reducing or eliminating such problems.

[0069] 8 and 9 illustrate cases where the robot passes through way points 211' and 212', which are different from those in FIG. 1. In the example of FIG. 9, Z-direction tracking is not performed at way points 211' and 212'. When approach start position 200 is higher than work start position 220, the Z-direction positions of way points 211' and 212' are also higher than work start position 220. In FIG. 8, the X-direction and Y-direction positions of second way point 212' are slightly offset from those of work start position 220, but they may be the same. In this case, the target to be tracked at work start position 220 can be used as the target to be tracked at second way point 212'. This configuration is useful for reducing the teaching work required by the user.

[0070] A working robot system according to the second embodiment will be described with reference to Figure 10. In the second embodiment, the part 130 gripped by the tool 30 in the first embodiment is a steering wheel, and the target part 101' is a mounting part for the steering wheel. In the second embodiment, the same components as those in the first embodiment are given the same reference numerals, and descriptions of those components and the same effects obtained by those components will be omitted.

[0071] In the second embodiment, at least one of the multiple via points 231, 232 is set inside the article 100. In the second embodiment, the center of the part 130 is the attachment part that is attached to the target part 101′, and the center of the part 130 follows the part 110 at each of the via points 231, 232 and the work start position 240.

[0072] For example, the first way point 231 is set on the outside of the article 100, and the second way point 232 is set on the inside of the article 100. The object to be followed by the second way point 232 can be a shift knob or the like. In the second embodiment, when the part 130 moves linearly from the approach start position 200′ to the work start position 240, the part 130 always comes into contact with the article 100. Even in such a case, the second embodiment, which has the same configuration as the first embodiment, makes it possible to easily set up the attachment of the part 130 without contact.

[0073] A working robot system according to the third embodiment will be described with reference to Figures 11 to 14. In the third embodiment, a first following sensor 50' fixed in a predetermined position is used instead of the following sensors 50 and 60 of the first embodiment. In this embodiment, the following sensor 50' is supported using a well-known frame 51 or the like.

[0074] The placement position, support structure, etc. of the tracking sensor 50' are arbitrary. In this embodiment, the placement position of the tracking sensor 50' is above the article 100. The tracking sensor 50' may be supported by another robot, or may be supported by a known linear guide that is movable in the conveying direction of the conveying device 2. The tracking sensor 50' may also be supported by other methods. In the second embodiment, the same components as in the first embodiment are denoted by the same reference numerals, and descriptions of those components and the same effects obtained by those components will be omitted.

[0075] The tracking sensor 50' may be, for example, a three-dimensional camera or a three-dimensional distance sensor. The position and direction of the coordinate system of the tracking sensor 50' and the position and direction of the coordinate system of the robot 10 are previously associated within the control device 20. In the third embodiment, for example, the standby position, the position where the part 110 is placed, the approach start position 200, etc. are taught as the teaching points. The way point teaching screen 300' in the third embodiment may be slightly different from that in the first embodiment, as shown in FIG. 13. On the way point teaching screen 300' illustrated in FIG. 13, the user teaches the target to be followed at each of the way points 211 and 212 (FIG. 12). An example of the processing of the control device 20 for teaching the target to be followed will be described below with reference to FIG. 14.

[0076] The control device 20 obtains instructions for the target to be followed by the user using the via point instruction screen 300' and a known voice generating device built into the control device 20. The user places the tip of the arm 10a in an arbitrary position and posture, and in this state the user performs a first input for setting a via point on the input unit 26. In response to the first input, the control device 20 causes the tracking sensor 50' to acquire an image at the position and posture (step S3-1).

[0077] As in the first embodiment, the control device 20 displays one or more indication figures 410 on the acquired image 400 shown in Fig. 13 (step S3-2). The user performs a second input to the input unit 26 for setting a via point. In response to the second input, the control device 20 determines the tracking target on the acquired image (step S3-3). The tracking target of the first via point 211 in Fig. 13 is the target part 101, but another part 123 of the article 100 that is convenient for via point tracking may also be used as the tracking target.

[0078] Next, the user performs third and fourth inputs to the input unit 26 for setting waypoints, as in the first embodiment, and performs the same processing as in the first embodiment (steps S3-4 and S3-5). Note that in this embodiment, step S3-3 is unnecessary because there is only one tracking sensor, but step S3-3 is useful when there are two or more tracking sensors. Note that if two two-dimensional cameras facing in the same direction as the tracking sensors 50 and 60 are used instead of the tracking sensor 50' that obtains three-dimensional images, three-dimensional detection becomes possible with the two-dimensional cameras.

[0079] Next, the control device 20 asks the user to teach the relative position and relative posture between the target and the part to be followed, using the via point teaching screen 300′, the voice generating device, etc. The user places the tip of the arm 10a in an arbitrary position and posture corresponding to the first via point 211, and in this state, the user performs a fifth input for setting the via point on the input unit 26.

[0080] In response to the fifth input, the control device 20 causes the tracking sensor 50' to acquire an image at the position and orientation (step S3-6). The acquired image indicates the relative position of the target to be tracked and the portion of the part 110 that should be tracked. In this embodiment, the part to be tracked is the part 110, the mounting portion 111 of the part 110, etc. The control device 20 stores the acquired image in the memory unit 23 as a reference image (step S3-7). In step S3-1, the control device 20 may determine that both the tracking target and the portion to be tracked are included in the acquired image. In this case, step S3-7 is performed without performing step S3-6.

[0081] The control device 20 repeats steps S3-1 to S3-6 until the above settings have been made for all the way points (step S3-8). In the third embodiment, too, for tracking at each of the way points 211 and 212, the control device 20 performs visual feedback using image data sequentially obtained by the tracking sensors 50 and 60. While known visual feedback can be used for the above control, in the third embodiment, the control device 20 performs the following tracking control.

[0082] The control device 20 positions the target and the portion to be tracked within the angle of view of the tracking sensor 50' so that their relative positions match within a predetermined standard with respect to the reference image. In addition, the control device 20 may position the target and the portion to be tracked within the angle of view so that their relative orientations also match beyond a predetermined standard with respect to the reference image. This visual feedback causes the mounting portion 111 of the part 110 to follow the target portion 101 of the article 100.

[0083] In the third embodiment, the control device 20 performs waypoint tracking based on the relative positions of the target to be tracked and the part to be tracked, as seen by the tracking sensor 50' fixed to a location other than the arm 10a. In the field of view of the tracking sensor attached to the tip of the arm 10a, the tool 30 or the like may interfere with the detection of the target to be tracked. The third embodiment allows for a high degree of freedom in the placement of the tracking sensor 50', which contributes to reducing the interference with detection.

[0084] In the third embodiment, the via point instruction screen 300' displays the settings of the target to be followed and the settings of the target to be followed. This configuration is useful for the user to accurately and easily recognize whether or not a via point has been set, the setting status of each via point, etc.

[0085] There are situations in which the linear movement of the part 110 from the approach start position 200 to the work start position may result in contact between the arm 10a, the tool 30, the part 110, or the like and the article 100. Alternatively, as in the second embodiment, there are situations in which the part 110 inevitably comes into contact with the article 100 when it moves linearly from the approach start position 200 to the work start position. In each of the above embodiments, the arm 10a can cause the part 110 to perform way point tracking at multiple way points before moving the part 110 to the work start position. This configuration allows the user to perform various settings to prevent the contact. Note that there are also cases in which the arm 10a causes the part 110 to perform way point tracking at a single way point before moving the part 110 to the work start position. Even in such cases, the effects of each of the above embodiments can be achieved.

[0086] In the above embodiments, the arm 10a moves the part 110 to follow the article 100. Similarly, in the above embodiments, the arm 10a may move the tool 30 to follow the article 100. This configuration also achieves the same effects as the above embodiments. The tool 30 may be any tool that performs various known operations, such as welding, assembly processing, and sealant application, on a part of the article 100 as a predetermined operation.

[0087] Furthermore, the control device 20 of the first embodiment may perform waypoint tracking based on the relative positions of the tracking target and the part to be tracked, as in the third embodiment. In this case, the reference image is also stored in the storage unit 23 in the first embodiment.

[0088] Although the embodiments of the present disclosure have been described in detail, the present disclosure is not limited to the individual embodiments described above. These embodiments can be variously added, replaced, modified, partially deleted, etc., without departing from the gist of the invention or the concept and spirit of the present invention derived from the content of the claims and their equivalents. For example, in the above-described embodiments, the order of each operation, the order of each process, the omission or addition of some operations depending on conditions, and the omission or addition of some processes depending on conditions can be changed without being bound by the above examples. The same applies when numerical values ​​or mathematical expressions are used in the description of the above embodiments. [Explanation of symbols]

[0089] 1. Working robot system 2. Conveyor equipment 10. Robot 11 Servo motor 20 Control device 21 processors 22 Display device 23 Memory section 23a System Program 23b Operating program 23c Pre-approach Control Program 23d Via point tracking control program 23e Work tracking control program 23f Force control program 23g Starting position data 23h Boundary position data 26 Input section 30 hands 31 Servo motor 32 Force Sensor 40 Detection Device 50,60,50' following sensor 100 goods 101,101' Target part 101a hole 110 parts 111 Mounting part 111a shaft 200,200' Approach start position 211,212,211',212', 231,232 waypoints 220,240 Work start position 300,300' Waypoint teaching screen

Claims

1. A robot comprising an arm and a control device that controls the arm, and that performs a predetermined task on a target portion of an article being moved by an article moving device, The control device a waypoint tracking control that controls the arm so that the part or tool supported on the tip of the arm follows the moving article at each of one or more waypoints before moving the part or tool supported on the tip of the arm to a work start position for the predetermined work; a work-time tracking control that, after the waypoint tracking control, places the part or the tool at the work start position and controls the arm so that the part or the tool follows the moving object during work; The robot is configured to:

2. The robot according to claim 1 , wherein the control device is configured to perform the waypoint tracking control using visual feedback.

3. The control device is configured to perform the work tracking control using visual feedback, The robot according to claim 1 or 2, wherein the object to be followed used in the during-work tracking control is used for the tracking of a way point that is closest to the work start position among the one or more way points.

4. The control device stores an operation program for causing the arm to perform a predetermined operation, The robot according to claim 1 or 2, wherein the control device, when performing the following while moving the part or the tool in a predetermined direction according to the operation program, does not cause the part or the tool to follow the article in the predetermined direction.

5. a display device capable of displaying a way point teaching screen for teaching the following at each of the one or more way points; The robot according to claim 1 or 2, further comprising: an input unit for inputting an input for teaching the following.

6. the display device is capable of displaying a screen for specifying a direction in which the tracking will be performed at each of the one or more way points, The robot according to claim 5 , wherein the control device causes the arm to perform the following in a direction according to the designation at each way point.

7. A robot control device that controls an arm of a robot that performs a predetermined task on a target portion of an article being moved by an article moving device, a waypoint tracking control that controls the arm so that the part or tool supported on the tip of the arm follows the moving article at each of one or more waypoints before moving the part or tool supported on the tip of the arm to a work start position for the predetermined work; a work-time tracking control that, after the waypoint tracking control, places the part or the tool at the work start position and controls the arm so that the part or the tool follows the moving object during work; A control device for a robot configured to perform the above.

8. a display device capable of displaying a way point teaching screen for teaching the following at each of the one or more way points; The robot control device according to claim 7 , further comprising: an input unit for inputting the instruction for the following.

9. the display device is capable of displaying a screen for specifying a direction in which the tracking will be performed at each of the one or more way points, The robot control device according to claim 8 , wherein the control device causes the arm to perform the following in a direction according to the designation at each way point.

10. an article moving device that moves an article; a robot having an arm; a control device that controls the arm so as to perform a predetermined operation on a target portion of an article being moved by the article moving device, The control device a waypoint tracking control that controls the arm so that the part or tool supported on the tip of the arm follows the moving article at each of one or more waypoints before moving the part or tool supported on the tip of the arm to a work start position for the predetermined work; a work-time tracking control that, after the waypoint tracking control, places the part or the tool at the work start position and controls the arm so that the part or the tool follows the moving object during work; A working robot system configured to:

11. the control device stores an operation program for causing the arm to perform a predetermined operation, 11. The work robot system according to claim 10, wherein when the control device performs the following while moving the part or the tool in a predetermined direction according to the operation program, the control device does not cause the part or the tool to follow the article in the predetermined direction.

12. a display device capable of displaying a way point teaching screen for teaching the following at each of the one or more way points; an input unit used for the instruction of the following on the way point instruction screen, the control device is configured to perform the way point tracking control using visual feedback based on an output of a sensor; The control device an image acquisition process of causing the sensor to acquire an image based on an input to the input unit while the tip of the arm is disposed at a position corresponding to each of the one or more via points; a tracking target setting process for setting a part or all of the article appearing in the acquired image as a tracking target in the way point tracking control; The working robot system according to claim 10 or 11, configured to perform the following:

13. 13. The work robot system according to claim 12, wherein the control device controls the arm in the waypoint tracking control so that the relative positions of the target to be tracked and a portion of the part or tool to be tracked match within a predetermined standard within images successively obtained by the sensor.

Images