Processing device, control system, and program

The processing device and control system address inefficiencies in robot coordination by generating tailored control information for each robot, enhancing cooperation and task completion efficiency.

JP2024158731APending Publication Date: 2024-11-08KYOCERA CORP +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023074211
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing robot control systems face challenges in effectively coordinating multiple robots working together, leading to inefficiencies and potential failures due to varying performance, environmental conditions, and communication delays.

Method used

A processing device and control system that acquires operation command information and robot information to generate individualized control information for each robot, considering their performance, state, and environment, enabling precise coordination and cooperation among robots.

Benefits of technology

Enables multiple robots to work together effectively by adjusting operations based on real-time performance and environmental factors, ensuring accurate and efficient task completion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024158731000001_ABST
    Figure 2024158731000001_ABST
Patent Text Reader

Abstract

To provide a technology that enables appropriate control of a plurality of robots that perform work in cooperation with each other.SOLUTION: A processing device includes an acquisition unit and a generation unit. The acquisition unit acquires operation command information related to work that a plurality of robots perform in cooperation with each other, and robot information related to at least one of the plurality of robots. The generation unit generates control information on at least one of the plurality of robots on the basis of the operation command information and the robot information.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to controlling a robot. [Background technology]

[0002] Patent Document 1 describes a technology for controlling a robot. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-91894 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is room for improvement in controlling the robot. [Means for solving the problem]

[0005] A processing device, a control system, and a program are disclosed. In one embodiment, the processing device includes an acquisition unit and a generation unit. The acquisition unit acquires operation command information related to a task performed by multiple robots in cooperation with each other, and robot information related to at least one of the multiple robots. The generation unit generates control information for at least one of the multiple robots based on the operation command information and the robot information.

[0006] In one embodiment, a control system includes the above-mentioned processing device and a control device that transmits operation command information to the processing device.

[0007] In one embodiment, the program causes a computer device to function as the processing device described above. Effect of the Invention

[0008] It becomes possible to appropriately control multiple robots working in cooperation with each other. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is a schematic diagram showing an example of a configuration of a processing apparatus. [Diagram 2] FIG. 1 is a schematic diagram illustrating an example of a configuration of a robot system. [Diagram 3] FIG. 1 is a schematic diagram illustrating an example of a configuration of a robot. [Figure 4] FIG. 2 is a schematic diagram showing an example of the configuration of a control device. [Diagram 5] FIG. 2 is a schematic diagram showing an example of a configuration of a processing apparatus. [Figure 6] FIG. 1 is a schematic diagram illustrating an example of a configuration of a robot system. [Figure 7] FIG. 2 is a schematic diagram illustrating an example of a configuration of a generating unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Fig. 1 is a schematic diagram showing an example of the configuration of a processing device 1 that generates control information for controlling a robot. Fig. 2 is a schematic diagram showing an example of the configuration of a robot system 200 including the processing device 1.

[0011] 2, the robot system 200 includes, for example, a plurality of robots 50 and a control system 250 that controls the plurality of robots 50. The plurality of robots 50 are controlled by the control system 250, so that they can work in cooperation with each other.

[0012] The control system 250 includes, for example, a processing device 1 and a control device 10. The control device 10 is located, for example, at a remote location relative to the multiple robots 50. On the other hand, the processing device 1 is located in a location close to the multiple robots 50. The control device 10 and the processing device 1 can communicate with each other, for example, through a network 80 including the Internet. The control device 10 and each robot 50 can communicate with each other, for example, through the network 80. The processing device 1 can communicate with each robot 50 directly, for example, without going through the network 80. The communication delay between the processing device 1 and the robot 50 is shorter than, for example, the communication delay between the control device 10 and the robot 50. Hereinafter, the multiple robots 50 may be collectively referred to as a robot group.

[0013] The control device 10 and the robot group are, for example, located in different locations. Specifically, the control device 10 and the robot group may be located in different buildings, or in different spaces separated by a fence or the like. Furthermore, one of the control device 10 and the robot group may be located indoors, and the other of the control device 10 and the robot group may be located outdoors. Furthermore, the control device 10 may be located in a safe area, and the robot group may be located in a dangerous area.

[0014] The control device 10 generates operation command information related to a task performed by multiple robots 50 in cooperation with each other. The operation command information indicates an operation command for at least one robot 50. The control device 10 transmits the generated operation command information to the processing device 1. By transmitting the operation command information for at least one robot 50 to the processing device 1, the control device 10 can control the at least one robot 50 through the processing device 1.

[0015] In this embodiment, the multiple robots 50 have a first robot. The control device 10 generates an operation command for the first robot. The control device 10 may change the first robot for which the operation command is generated among the multiple robots 50. That is, for example, when a user generates an operation command by directly operating the robot 50 via the control device 10, the robot 50 to be operated may be switchable. In this case, among the multiple robots 50, the robot 50 to be operated after switching becomes the first robot. Note that the multiple robots 50 may have one first robot. Specifically, the multiple robots 50 may not be the direct operation target of the user at the same time, and the robot 50 that the user can directly operate may be one robot 50. Hereinafter, simply speaking of a task means a task performed by the multiple robots 50 in cooperation with each other.

[0016] The processing device 1 generates control information for each robot 50 individually from operation command information for at least one robot 50. Then, the processing device 1 transmits to each robot 50 control information corresponding to the robot 50 (i.e., control information for controlling the robot 50). The multiple robots 50 perform operations based on the control information from the processing device 1, so that the multiple robots 50 can work in cooperation with each other. For example, the multiple robots 50 perform a task of holding an object to be worked on (also called a work target) in cooperation with each other and carrying it to a predetermined position while performing different operations from each other. However, the content of the task is not limited to this.

[0017] In this embodiment, when the multiple robots 50 include a first robot and a second robot, the processing device 1 can generate first control information for the first robot and second control information for the second robot. The first control information is transmitted to the first robot, and the second control information is transmitted to the second robot. The first robot operates according to the first control information, and the second robot operates according to the second control information, so that the first robot and the second robot can perform a cooperative task.

[0018] <Example of processing device configuration> As shown in Fig. 1, the processing device 1 includes, for example, a control unit 2, a storage unit 3, a communication unit 4, and a communication unit 5. The communication unit 4 is connected to, for example, a network 80, and can communicate with the control device 10 through the network 80. The control unit 2 can acquire operation command information from the control device 10 through the communication unit 4 and the network 80. The control unit 2 generates control information for each robot 50 based on the acquired operation command information. The communication unit 4 can be, for example, a communication circuit, an interface, or an interface circuit. The communication unit 4 may communicate with the network 80 via wired communication or wireless communication.

[0019] The communication unit 5 can, for example, directly communicate with each robot 50. The communication unit 5 transmits a plurality of pieces of control information generated by the control unit 2 and corresponding to each of the plurality of robots 50 to each of the plurality of robots 50. The communication unit 5 can also be called, for example, a communication circuit, an interface, or an interface circuit. The communication unit 5 may communicate with each robot 50 via wired communication or wireless communication.

[0020] The control unit 2 can generally manage the operation of the processing device 1 by controlling the other components of the processing device 1. The control unit 2 can also be referred to as, for example, a control circuit. The control unit 2 includes at least one processor to provide control and processing power for performing various functions, as described in more detail below.

[0021] According to various embodiments, the at least one processor may be implemented as a single integrated circuit (IC) or as multiple communicatively connected integrated circuit ICs and / or discrete circuits. The at least one processor may be implemented according to various known techniques.

[0022] In one embodiment, a processor includes one or more circuits or units configured to perform one or more data computation procedures or processes, for example by executing instructions stored in associated memory. In other embodiments, a processor may be firmware (e.g., discrete logic components) configured to perform one or more data computation procedures or processes.

[0023] According to various embodiments, the processor may include one or more processors, controllers, microprocessors, microcontrollers, application specific integrated circuits (ASICs), digital signal processors, programmable logic devices, field programmable gate arrays, or any combination of these devices or configurations, or other known devices and configurations, to perform the functions described below.

[0024] The control unit 2 may include, for example, a CPU (Central Processing Unit) as a processor. The storage unit 3 may include a non-transitory recording medium readable by the CPU of the control unit 2, such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage unit 3 stores, for example, a program 30 for controlling the processing device 1. Various functions of the control unit 2 are realized, for example, by the CPU of the control unit 2 executing the program 30 in the storage unit 3.

[0025] The configuration of the control unit 2 is not limited to the above example. For example, the control unit 2 may include multiple CPUs. The control unit 2 may also include at least one DSP (Digital Signal Processor). All or some of the functions of the control unit 2 may be realized by a hardware circuit that does not require software to realize the function. The storage unit 3 may also include a computer-readable non-transitory recording medium other than ROM and RAM. The storage unit 3 may also include, for example, a small hard disk drive and an SSD (Solid State Drive).

[0026] <Example of robot configuration> 3 is a schematic diagram showing a configuration example of each robot 50. The robot 50 includes a robot mechanism 52 and a robot controller 51 that controls the robot mechanism 52. The robot 50 also includes a sensor unit 53 that detects the state of the robot 50, and a camera 54 that captures images of the surroundings of the robot 50.

[0027] The robot controller 51 (also simply referred to as the controller 51) is, for example, a computer device. The controller 51 may include, for example, a control unit similar to the control unit 2, a storage unit similar to the storage unit 3, a first communication unit similar to the communication unit 4, and a second communication unit similar to the communication unit 5. The first communication unit is capable of communicating with the control device 10 via the network 80. The second communication unit is capable of communicating with the communication unit 5 of the processing device 1.

[0028] The robot mechanism 52 may be, for example, a humanoid robot mechanism that imitates at least a part of a human body, or an arm-type robot mechanism having one or two arms. The robot mechanism 52 may be fixed in position or may be movable.

[0029] The robot mechanisms 52 of the multiple robots 50 can work in cooperation with each other. The structures of the multiple robots 50 may be different from each other or the same as each other. For example, the robot mechanisms 52 of the multiple robots 50 included in the robot system 200 may include multiple robot mechanisms 52 having different structures from each other, or may include robot mechanisms 52 having the same structure as each other. Furthermore, the specifications or settings of the multiple robots 50 may be different from each other or the same as each other. For example, the robot mechanisms 52 of the multiple robots 50 included in the robot system 200 may include multiple robot mechanisms 52 having different specifications or settings from each other, or may include robot mechanisms 52 having the same specifications or settings as each other. Furthermore, the multiple robots 50 may have different specifications or settings from each other even if they have the same structure. For example, consider two robots 50 that are the same type but have different control methods from each other. In this case, one robot 50 may be a robot that operates by imitating the user's movements, and the other robot 50 may be an autonomously controlled robot.

[0030] The robot mechanism 52 includes at least one motor 520 that drives at least one moving part included in the robot mechanism 52. The robot controller 51 can control the operation of the robot mechanism 52 by controlling the at least one motor 520 included in the robot mechanism 52.

[0031] The camera 54 is, for example, a color camera or an infrared camera. The camera 54 captures the surroundings of the robot mechanism 52 to generate a camera image. The camera image is, for example, a moving image. The camera image generated by the camera 54 is input to the controller 51. The controller 51 transmits the input camera image to the control device 10 via the network 80. The camera 54 may have a sensing mechanism such as LiDAR (Light Detection And Ranging) so as to be able to grasp the distance to the subject, or may be a depth camera or the like.

[0032] The sensor unit 53 can detect the state of the robot 50, specifically, the state of the robot mechanism 52. The sensor unit 53 includes, for example, an encoder, a torque sensor, a voltage sensor, a current sensor, and a temperature sensor. The encoder detects the number of rotations of the motor 520. The torque sensor detects the torque applied to the motor 520. The voltage sensor detects the power supply voltage (in other words, the drive voltage) of the motor 520. The current sensor detects the current flowing through the motor 520. The temperature sensor detects the temperature of the motor 520. The sensor unit 53 may also have a sensor capable of grasping the surrounding environment of the robot 50. Specifically, the sensor unit 53 may have an optical sensor or a gas sensor capable of detecting surrounding obstacles or abnormalities. Note that the detection results acquired by the sensor capable of grasping the surrounding environment do not necessarily need to be visualized for the user.

[0033] Hereinafter, the rotation speed detected by the encoder will be referred to as the detected rotation speed. Additionally, the torque detected by the torque sensor will be referred to as the detected torque. Additionally, the power supply voltage detected by the voltage sensor will be referred to as the detected power supply voltage. Additionally, the current detected by the current sensor will be referred to as the detected current. Additionally, the temperature detected by the temperature sensor will be referred to as the detected temperature.

[0034] The sensor unit 53 outputs the detection result of the state of the robot 50 as sensor detection information to the controller 51. The sensor detection information includes, for example, a detected rotation speed, a detected torque, a detected power supply voltage, a detected current, and a detected temperature.

[0035] The controller 51 generates individual robot information 510 (see FIG. 5 described later), which is information about the robot 50 to which it belongs, and transmits it to the processing device 1. The multiple pieces of individual robot information 510 transmitted by the multiple robots 50 respectively constitute robot information 500 about the multiple robots 50. Hereinafter, the robot information 500 may be referred to as overall robot information 500. In the processing device 1, the control unit 2 stores the individual robot information 510 from the multiple robots 50 in the memory unit 3 as overall robot information 500.

[0036] The individual robot information 510 includes, for example, performance information indicating the performance of the robot 50. The performance information includes, for example, the maximum range within which the robot 50 can move according to the specifications (maximum movable range according to the specifications). The performance information also includes the maximum rotation speed according to the specifications of the motor 520. The performance information also includes the maximum torque according to the specifications of the motor 520. The performance information also includes the response speed according to the specifications of the motor 520. The performance information does not change according to the state of the robot 50 and the surrounding environment.

[0037] The individual robot information 510 also includes sensor detection information obtained by the sensor unit 53 of the robot 50. The individual robot information 510 also includes position information of an object to be worked on by the robot 50. The sensor detection information is information indicating the state of the robot 50. The information indicating the state of the robot 50 is, for example, position information or operating status of each part of the robot 50. The state of the robot 50 also changes depending on the position of the object to be worked on held by the robot 50. Therefore, the sensor detection information and the position information of the object to be worked on can be said to be state identification information for identifying the state of the robot 50. The state identification information changes depending on the state of the robot 50.

[0038] The individual robot information 510 also includes the maximum range in which the robot 50 can move without interfering with surrounding obstacles (also referred to as the obstacle-free maximum movable range). The controller 51 can specify the obstacle-free maximum movable range based on, for example, the maximum movable range in the specifications and the camera image generated by the camera 54. The obstacle-free maximum movable range changes according to the surrounding environment of the robot 50, specifically, according to the positions and ranges of obstacles around the robot 50. Therefore, the obstacle-free maximum movable range can be said to be surrounding environment identification information for identifying the surrounding environment of the robot 50. The surrounding environment identification information changes according to the surrounding environment of the robot 50.

[0039] The individual robot information 510 may also include setting information for the robot 50. For example, when there is a first robot operated by a user and a second robot that operates in cooperation with the first robot, the first robot becomes the main robot and the second robot becomes the sub robot, and therefore a master-slave relationship is set between the first robot and the second robot. In this case, the individual robot information 510 for the main robot may include setting information indicating that it is a main robot, and the individual robot information 510 for the sub robot may include setting information indicating that it is a sub robot.

[0040] <Control device configuration example> FIG. 4 is a block diagram showing an example of the configuration of the control device 10. The control device 10 can detect, for example, a user's movement and make a robot 50 imitate the detected user's movement. The user can operate a robot 50 through the control device 10. The user can make a robot 50 imitate the user's movement through the control device 10. In this embodiment, the robot 50 that the control device 10 makes imitate the user's movement is a first robot. Note that in this disclosure, the first robot may be called a slave robot 50. The control device 10 that makes the slave robot 50 imitate the user's movement can be called, for example, a master device 10. The master device 10 has, for example, a mechanism equivalent to the slave robot 50, and the user can make the slave robot 50 imitate the user's movement by operating the mechanism.

[0041] As shown in Fig. 4, the control device 10 includes, for example, a control unit 12, a storage unit 13, a communication unit 14, a sensor unit 15, and a display unit 16. The communication unit 14 is connected to a network 80. The communication unit 14 can communicate with the communication unit 4 of the processing device 1 through the network 80. The communication unit 14 can also communicate with the controller 51 of each robot 50 through the network 80. The communication unit 14 can be, for example, a communication circuit, an interface, or an interface circuit. The communication unit 14 may communicate with the network 80 via wired communication or wireless communication.

[0042] The control unit 12 can generally manage the operation of the control unit 10 by controlling the other components of the control unit 10. The control unit 12 can be, for example, a control circuit. The control unit 12 includes at least one processor to provide control and processing power for performing various functions, as described in more detail below. The above description of the processor included in the control unit 2 of the processing device 1 can also be applied to the processor included in the control unit 12.

[0043] The control unit 12 may include, for example, a CPU as a processor. The storage unit 13 may include a non-transitory recording medium readable by the CPU of the control unit 12, such as a ROM and a RAM. The storage unit 13 stores, for example, a program 130 for controlling the control device 10. Various functions of the control unit 12 are realized, for example, by the CPU of the control unit 12 executing the program 130 in the storage unit 13.

[0044] The configuration of the control unit 12 is not limited to the above example. For example, the control unit 12 may include multiple CPUs. The control unit 12 may also include at least one DSP. All or some of the functions of the control unit 12 may be realized by a hardware circuit that does not require software to realize the function. Similarly to the storage unit 3, the storage unit 13 may include a computer-readable non-transitory recording medium other than ROM and RAM.

[0045] The display unit 16 is capable of displaying various types of information under the control of the control unit 12. The display unit 16 may be, for example, a liquid crystal display, an organic electro-luminescence (EL) display, or a plasma display. The control unit 12 can cause the display unit 16 to display a camera image received from the robot 50 by the communication unit 14. The camera image generated by the robot 50 is displayed on the display unit 16, allowing the user of the control device 10 to check the surroundings of the robot 50.

[0046] The sensor unit 15 can detect the user's movement. The sensor unit 15 includes, for example, at least one motion sensor. The motion sensor includes, for example, a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis geomagnetic sensor. The sensor unit 15 is attached to the user's body. The detection result of the sensor unit 15 is input to the control unit 12. The sensor unit 15 may include, for example, a camera. In this case, the sensor unit 15 may detect the user's movement based on an optical motion capture technique that uses a camera image obtained by the camera. The sensor unit 15 may also include a potentiometer and detect the user's movement using the potentiometer.

[0047] The user can check the surroundings of the slave robot 50, for example, by checking the camera image from the slave robot 50 displayed on the display unit 16. For example, the user performs a movement that the slave robot 50 is to imitate while checking the surroundings of the slave robot 50. For example, if the user confirms that there is an obstacle around the slave robot 50 based on the camera image displayed on the display unit 16, the user performs a movement that the slave robot 50 is to imitate so that the slave robot 50 does not interfere with the obstacle.

[0048] The control unit 12 generates operation command information 100 (see FIG. 5 described later) indicating an operation command for the slave robot 50, for example, based on the detection result by the sensor unit 15. The operation command information 100 can be said to be information for making the slave robot 50 (in other words, the first robot) imitate, for example, the user's operation.

[0049] In this example, the detection result by the sensor unit 15, which detects the movement of the user who operates the slave robot 50 through the control device 10, can be regarded as operation information indicating the user's operation on the slave robot 50. The control unit 12 acquires the operation information on the slave robot 50 by the user through the sensor unit 15, and generates operation command information 100 based on the acquired operation information. The operation command information 100 can be regarded as information based on the operation information of the first robot, for example.

[0050] The operation command information 100 generated by the control unit 12 includes, for example, position information of the destination of the work target object and the set torque of the motor 520 of the slave robot 50. The control unit 12 sequentially generates the operation command information 100 so that the slave robot 50 imitates the user's movements. The operation command information 100 generated by the control unit 12 is corrected by the processing device 1 as described below, and then input to the slave robot 50.

[0051] 5 is a schematic diagram showing an example of information stored in the memory unit 3 of the processing device 1 and an example of functional blocks provided in the control unit 2 of the processing device 1. Operation command information 100 generated by the control unit 12 of the control device 10 is transmitted to the processing device 1 from the communication unit 14. In the processing device 1, the control unit 2 stores the operation command information 100 received by the communication unit 4 in the memory unit 3. In addition, the control unit 2 stores multiple pieces of individual robot information 510 received by the communication unit 5 as overall robot information 500 in the memory unit 3.

[0052] The control unit 2 includes, for example, an acquisition unit 20 and a generation unit 21. The acquisition unit 20 and the generation unit 21 are functional blocks formed in the control unit 2 by the CPU of the control unit 2 executing a program 30 in the storage unit 3. Note that all or some of the functions of the acquisition unit 20 may be realized by a hardware circuit that does not require software to realize the function. The same applies to the generation unit 21.

[0053] The acquisition unit 20 acquires the operation command information 100 and the overall robot information 500 from the storage unit 3. The generation unit 21 generates control information for each robot 50 individually based on the operation command information 100 and the overall robot information 500 acquired by the acquisition unit 20.

[0054] For example, the generation unit 21 modifies the operation command information 100 based on the whole robot information 500, and sets the modified operation command information as control information for the slave robot 50 (in other words, the first robot). For example, the generation unit 21 may modify the operation command information 100 based on at least the individual robot information 510 of the first robot (also referred to as first individual robot information 510), and set the modified operation command information as the first control information for the first robot.

[0055] Furthermore, the generation unit 21 generates control information for a robot 50 other than the slave robot 50 (also referred to as a slave external robot 50) based on the operation command information 100 and the overall robot information 500. This control information can also be said to be, for example, operation command information indicating an operation command for the slave external robot 50. The slave external robot 50 is a second robot. For example, the generation unit 21 may generate second control information for the second robot based on the operation command information 100 and at least individual robot information 510 of the second robot (also referred to as second individual robot information 510).

[0056] The first control information of the first robot may be generated based on information including the first individual robot information 510 and the second individual robot information 510. The second control information of the second robot may be generated based on information including the first individual robot information 510 and the second individual robot information 510.

[0057] The control information for the slave robot 50 generated by the generation unit 21 is transmitted from the communication unit 5 to the slave robot 50. The slave robot 50 operates according to the control information from the processing device 1 (i.e., the corrected operation command information). In addition, the control information for the slave external robot 50 generated by the generation unit 21 is transmitted from the communication unit 5 to the slave external robot 50. The slave external robot 50 operates according to the control information from the processing device 1.

[0058] Thus, in this example, the slave robot 50 does not use the operation command information generated by the control device 10 as is, but operates according to the operation command information modified based on the robot information 500 related to the multiple robots 50. As a result, the slave robot 50 can imitate the user's movements, while also performing movements that are slightly different from the user's movements depending on the performance, state, and surrounding environment of the slave robot 50 and the non-slave robot 50.

[0059] Furthermore, in this example, the control information for the slave robot 50 is generated based on the operation command information indicating the operation command for the slave robot 50 and the robot information 500 regarding the multiple robots 50, so that the slave robot 50 can appropriately perform the work in accordance with the operation of the slave robot 50. Therefore, the multiple robots 50 can appropriately perform the work in cooperation with each other.

[0060] For example, unlike this example, consider a case in which the slave robot 50 simply imitates the user's movements using the motion command information generated by the control device 10 as is, and the non-slave robots 50 autonomously perform operations in accordance with the movements of the slave robot 50 without receiving control information from the control device 10 and the processing device 1. In this case, for example, depending on the performance, state and surrounding environment of each robot 50, multiple robots 50 may not be able to perform tasks appropriately.

[0061] For example, if the maximum rotation speed in the specifications of the motor 520 of at least one of the slave robot 50 and the slave external robot 50 is small, the rotation speed of the motor 520 may reach the maximum rotation speed in the specifications during work, and the multiple robots 50 may not be able to properly work on the work object. Also, if the maximum torque in the specifications of the motor 520 of at least one of the slave robot 50 and the slave external robot 50 is small, the torque applied to the motor 520 may reach the maximum torque in the specifications, and the multiple robots 50 may not be able to properly work on the work object.

[0062] Furthermore, if the response speed of the motor 520 of at least one of the slave robot 50 and the slave external robot 50 is slow, the multiple robots 50 may not be able to properly work on the work object. Depending on the destination of the work object, the destination position of at least one of the slave robot 50 and the slave external robot 50 may exceed the maximum movable range in the specifications, and the multiple robots 50 may not be able to properly work on the work object. Also, an abnormality may occur in at least one of the slave robot 50 and the slave external robot 50, and the multiple robots 50 may not be able to properly work on the work object.

[0063] In addition, during work, at least one of the slave robot 50, the non-slave robot 50, and the work object may interfere with an obstacle, and the multiple robots 50 may not be able to properly work on the work object. In this example, the user can check the surroundings of the slave robot 50 based on the camera image displayed on the display unit 16, but if an obstacle is present in the blind spot of the camera 54, the user may not notice the obstacle around the slave robot 50. In addition, if there is a large communication delay between the slave robot 50 and the control device 10, the obstacle may not be captured in the camera image displayed on the display unit 16 even though an obstacle actually exists around the slave robot 50. In this case, the user may not notice the obstacle around the slave robot 50. Therefore, the user may operate the slave robot 50 without noticing the obstacle around the slave robot 50, and as a result, the slave robot 50 may interfere with the obstacle.

[0064] In this example, since the processing device 1 generates the control information for each robot 50 based on the operation command information and the overall robot information 500, for example, the control information for each robot 50 can be generated according to the performance, state, and surrounding environment of each robot 50. Therefore, the processing device 1 can control each robot 50 according to the performance, state, and surrounding environment of each robot 50, and can make the multiple robots 50 perform the work appropriately. For example, when the original performance of a certain robot 50 is low, or when the performance of a certain robot 50 is reduced due to at least one of the state of the certain robot 50 and the surrounding environment, the processing device 1 can make the multiple robots 50 perform the work appropriately by increasing the load on the robots 50 other than the certain robot 50.

[0065] In this example, the overall robot information 500 includes, for each robot 50, for example, the maximum rotation speed according to the specifications of the motor 520 and the detected rotation speed of the motor 520 (in other words, the current rotation speed of the motor 520). Therefore, the processing device 1 can generate control information for each robot 50 so that the rotation speed of the motor 520 of each robot 50 during work does not become excessive. Therefore, the multiple robots 50 can cooperate with each other to appropriately perform work.

[0066] Furthermore, the overall robot information 500 includes, for each robot 50, the maximum torque according to the specifications of the motor 520, the detected torque of the motor 520 (in other words, the current torque of the motor 520), and the detected rotation speed, detected power supply voltage, and detected temperature of the motor 520, which affect the actual maximum torque of the motor 520. Therefore, the processing device 1 can generate control information for each robot 50 so that the torque of each robot 50 during work does not become excessive.

[0067] In this example, the overall robot information 500 includes the response speed in the specifications of the motor 520 for each robot 50, so the processing device 1 can generate control information for each robot 50 taking into consideration the response speed in the specifications of the motor 520 of each robot 50. Therefore, the multiple robots 50 can cooperate with each other to appropriately perform tasks.

[0068] Furthermore, in this example, the overall robot information 500 includes the maximum range of movement in the specifications for each robot 50 and position information of the work objects held by the multiple robots 50, so that the processing device 1 can operate each robot 50 within the maximum range of movement in the specifications while properly performing the work.

[0069] Furthermore, in this example, the overall robot information 500 includes the maximum obstacle-free movement range for each robot 50 and position information of the work objects held by the multiple robots 50, so that the processing device 1 can generate control information for each robot 50 so that each robot 50 and the work objects do not interfere with obstacles. For example, even if a user operates the slave robot 50 without noticing obstacles around the slave robot 50, the processing device 1 can control the movement of each robot 50 so that the movement of the slave robot 50 is smaller than the movement of the user, so that the slave robot 50 does not interfere with the obstacles.

[0070] Furthermore, in this example, the overall robot information 500 includes the detected current of the motor 520 (in other words, the current current of the motor 520) for each robot 50. As a result, even if an abnormality occurs in one robot 50 and the current of the motor 520 of that robot 50 becomes abnormal, the processing device 1 can appropriately control the robot 50 other than the robot 50 with the abnormality, and as a result, can cause the multiple robots 50 to appropriately perform tasks.

[0071] The overall robot information 500 may include position information of each robot 50. The position information of the robot 50 is position information indicating the overall position of the robots 50. This allows the robots 50 to maintain appropriate positional relationships with each other. Specifically, for example, when a work object is held by two robots 50, the two robots 50 can be controlled so that one robot 50 is positioned opposite the other robot 50, and the work object can be held effectively.

[0072] The overall robot information 500 may also include position information of the end effector 57 of each robot 50. This allows, for example, when two robots 50 are to hold a work target, the holding position can be set to an appropriate position. Specifically, for example, when the work of each robot 50 is viewed from above, the robot 50 can be controlled to be at a position where the distance between the end effectors 57 of each robot 50 is maximized within the range where the work target and the end effector 57 of each robot 50 come into contact, and the work target can be held effectively.

[0073] <Example of robot system operation> The following describes a detailed operation example of the robot system 200. Here, the following describes an operation example of the robot system 200 including two robots 50a and 50b shown in FIG.

[0074] 6, the robot 50a is a slave robot 50, and the robot 50b is a non-slave robot 50. Hereinafter, the robot 50a will be referred to as the slave robot 50a, and the robot 50b will be referred to as the non-slave robot 50b.

[0075] Each of the slave robot 50a and the non-slave robot 50b includes, for example, a mobile arm-type robot mechanism 52. The robot mechanism 52 includes, for example, a moving unit 55, an arm 56 attached to the moving unit 55, and an end effector 57 attached to the tip of the arm 56. The end effector 57 is also called a hand. The entire robot mechanism 52 moves as the moving unit 55 moves. The moving unit 55 is provided with a motor 520 for moving the moving unit 55.

[0076] 6, the end effector 57 (also referred to as end effector 57a) of the slave robot 50a and the end effector 57 (also referred to as end effector 57b) of the slave external robot 50b cooperate with each other to hold the work object 90. More specifically, the end effector 57a and the end effector 57b hold the work object 90 by sandwiching it from opposite sides. Then, the moving parts 55 of the slave robot 50a and the slave external robot 50b that hold the work object 90 move, whereby the work object 90 moves and is transported to a predetermined location.

[0077] In the example of FIG. 6, each moving part 55 can move on the same straight line. For example, each moving part 55 can move in the left-right direction of FIG. 6. When the slave robot 50a and the slave external robot 50b sandwich the work object 90, the holding force of the slave robot 50a and the slave external robot 50b for the work object 90 changes depending on the distance between the end effector 57a and the end effector 57b. The distance between the end effector 57a and the end effector 57b changes when at least one of the moving part 55 of the slave robot 50a and the moving part 55 of the slave external robot 50b moves. Hereinafter, the distance between the end effector 57a and the end effector 57b may be referred to as the inter-end effector distance.

[0078] In this example, the torque of the motor 520 of each moving part 55 changes according to the holding force of the slave robot 50a and the slave external robot 50b on the work object 90. When the distance between the end effectors becomes smaller, the holding force of the slave robot 50a and the slave external robot 50b on the work object 90 becomes larger, and the torque of each motor 520 becomes larger. On the other hand, when the distance between the end effectors becomes larger, the holding force of the slave robot 50a and the slave external robot 50b on the work object 90 becomes smaller, and the torque of each motor 520 becomes smaller. In this example, since the end effector 57a and the end effector 57b sandwich the work object 90 from opposite sides, the torque of the motor 520 of the slave robot 50a and the torque of the motor 520 of the slave external robot 50b are approximately the same. Hereinafter, the holding force of the work object 90 simply means the holding force of the slave robot 50a and the slave external robot 50b on the work object 90.

[0079] For example, the user can move the slave robot 50a in one direction by moving one hand in one direction. The control unit 12 of the control device 10 generates destination position information 101 (see FIG. 7 described later) indicating a destination position of the work object 90 held by the slave robot 50a together with the non-slave robot 50b based on the detection result of the sensor unit 15 that detects the user's movement. Then, the control unit 12 generates operation command information 100 including the destination position information 101 and a set torque 102 (see FIG. 7 described later) of the motor 520 of the slave robot 50a. The position of the slave robot 50a changes according to the position indicated by the destination position information 101. Therefore, the position of the end effector 57a changes according to the position indicated by the destination position information 101. Also, the holding force of the work object 90 changes according to the set torque 102 of the motor 520 of the slave robot 50a. The control unit 12 determines a set torque 102 for the motor 520 of the slave robot 50a so as to provide an appropriate force for holding the work object 90. The operation command information 100 generated by the control unit 12 is input to the processing device 1.

[0080] In this example, the position of the work object 90 is represented by an X coordinate on the positive side of the X axis set along the moving direction of the moving unit 55, as shown in FIG. 6. The unit of the X coordinate is, for example, mm (millimeters), and the position of the work object 90 is represented by, for example, a positive value. The slave robot 50a and the slave external robot 50b can move along the X axis. The slave robot 50a is located on the positive side of the X axis relative to the slave external robot 50b, and the slave external robot 50b is located on the negative side of the X axis relative to the slave robot 50a. The end effector 57a contacts the work object 90 from the positive side of the X axis, and the end effector 57b contacts the work object 90 from the negative side of the X axis. When the holding force of the work object 90 is to be increased, for example, the slave robot 50a moves to the negative side of the X axis, and the slave external robot 50b moves to the positive side of the X axis.

[0081] FIG. 7 is a schematic diagram showing an example of the configuration of the generating unit 21. The generating unit 21 includes, for example, an adjustment amount determining unit 210, a sharing determining unit 220, a first generating unit 230a, and a second generating unit 230b. The adjustment amount determining unit 210, the sharing determining unit 220, the first generating unit 230a, and the second generating unit 230b are functional blocks formed in the control unit 2 by the CPU of the control unit 2 executing the program 30 in the storage unit 3. Note that all of the functions of the adjustment amount determining unit 210 or some of the functions of the adjustment amount determining unit 210 may be realized by a hardware circuit that does not require software to realize the function. The same applies to the sharing determining unit 220, the first generating unit 230a, and the second generating unit 230b.

[0082] In this example, the processing device 1 performs an adjustment process to adjust the distance between the end effectors so that the holding force of the work object 90 becomes an appropriate value corresponding to the set torque 102 included in the operation command information 100. The adjustment amount determination unit 210 determines an adjustment amount α of the distance between the end effectors based on the set torque 102 and the detected torque 511 of the slave robot 50a and the non-slave robot 50b included in the entire robot information 500. It can be said that the adjustment amount determination unit 210 determines how much the distance between the end effectors should be changed from the current value so that the holding force of the work object 90 becomes an appropriate value corresponding to the set torque 102. The processing device 1 controls the positions of the slave robot 50a and the non-slave robot 50b while adjusting the distance between the end effectors by the adjustment amount α so that the work object 90 moves to a position indicated by the destination position information 101 included in the operation command information 100. This allows the slave robot 50a and the non-slave robot 50b to move the work object 90 to the position indicated by the destination position information 101 while holding the work object 90 with an appropriate holding force.

[0083] In this example, for example, when the adjustment amount α is a positive value, the distance between the end effectors is decreased by the absolute value of the adjustment amount α. Therefore, when the adjustment amount α is a positive value, the holding force of the work object 90 is increased by the adjustment process. On the other hand, when the adjustment amount α is a negative value, the distance between the end effectors is increased by the absolute value of the adjustment amount α. Therefore, when the adjustment amount α is a negative value, the holding force of the work object 90 is decreased by the adjustment process. The unit of the adjustment amount α is, for example, mm (millimeters).

[0084] The sharing determination unit 220 determines the sharing of the adjustment process between the slave robot 50a and the non-slave robot 50b based on the operation command information 100 and the overall robot information 500.

[0085] Here, the adjustment process of adjusting the end-effector distance by the adjustment amount α can be realized, for example, by the slave robot 50a taking on the entire adjustment amount α and the end effector 57a moving by the adjustment amount α relative to the end effector 57b. The adjustment process can also be realized by the slave robot 50b taking on the entire adjustment amount α and the end effector 57b moving by the adjustment amount α relative to the end effector 57a. The adjustment process can also be realized by the slave robot 50a taking on a portion α1 of the adjustment amount α and the end effector 57a moving by the portion α1 relative to the end effector 57b, and the slave robot 50b taking on the remaining portion α2 of the adjustment amount α and the end effector 57b moving by the portion α2 relative to the end effector 57a. The allocation determination unit 220 determines the allocation of the adjustment amount α for the slave robot 50a (referred to as the first allocation) and the allocation of the adjustment amount α for the slave external robot 50b (referred to as the second allocation) based on the operation command information 100 and the entire robot information 500. For example, if the first allocation is zero, the end effector 57b moves by the adjustment amount α relative to the end effector 57a. On the other hand, if the second allocation is zero, the end effector 57a moves by the adjustment amount α relative to the end effector 57b. It can also be said that the allocation determination unit 220 determines how far the slave robot 50a and the slave external robot 50b are to be moved in the adjustment process.

[0086] The first generating unit 230a generates control information 600a for the slave robot 50a based on the operation command information 100 and the allocation of the adjustment process to the slave robot 50a determined by the allocation determining unit 220. The first generating unit 230a generates control information 600a for the slave robot 50a based on the operation command information 100 and the first allocation amount.

[0087] The second generating unit 230b generates control information 600b for the slave external robot 50b based on the operation command information 100 and the allocation of the adjustment process to the slave external robot 50b determined by the allocation determining unit 220. The second generating unit 230b generates control information 600b for the slave external robot 50b based on the operation command information 100 and the second allocation amount.

[0088] An example of the operation of the adjustment amount determination unit 210, the share determination unit 220, the first generation unit 230a, and the second generation unit 230b will be described in detail below.

[0089] <Example of operation of adjustment amount determination unit> The adjustment amount determination unit 210, for example, determines the average value of the detected torques 511 of the slave robot 50a and the slave robot 50b included in the entire robot information 500. The average value of the detected torques 511 of the slave robot 50a and the slave robot 50b indicates the current torques of the motors 520 of the slave robot 50a and the slave robot 50b. Then, the adjustment amount determination unit 210 determines the adjustment amount α based on a torque difference value obtained by subtracting the average value of the detected torques 511 from the set torque 102. The torque difference value indicates how far the set torque 102 is from the current torque of the motor 520.

[0090] The adjustment amount determination unit 210 determines an adjustment amount α such that the torque of the motor 520 of the slave robot 50a changes by the torque difference value. For example, when the set torque 102 is greater than the average value of the detected torque 511 and the torque difference value is a positive value, the adjustment amount determination unit 210 determines an adjustment amount α such that the torque of the motor 520 of the slave robot 50a increases by the absolute value of the torque difference value. In this case, the adjustment amount α is a positive value. On the other hand, when the average value of the detected torque 511 is greater than the set torque 102 and the torque difference value is a negative value, the adjustment amount determination unit 210 determines an adjustment amount α such that the torque of the motor 520 of the slave robot 50a decreases by the absolute value of the torque difference value. In this case, the adjustment amount α is a negative value.

[0091] <Example of operation of the sharing decision unit> The allocation determination unit 220 includes, for example, a sharing rate determination unit 221, a first sharing amount calculation unit 222a, and a second sharing amount calculation unit 22b. The sharing rate determination unit 221 determines the sharing rate of the adjustment process in the slave robot 50a and the slave robot 50b based on the operation command information 100 and the entire robot information 500. For example, the sharing rate determination unit 221 determines the sharing rate of the adjustment amount α in the slave robot 50a (also called the first sharing rate) and the sharing rate of the adjustment amount α in the slave robot 50b (also called the second sharing rate) based on the operation command information 100 and the entire robot information 500. For example, each of the first sharing rate and the second sharing rate is a positive value of 1 or less, and the sum of the first sharing rate and the second sharing rate is "1". Hereinafter, the operation command information 100 and the entire robot information 500 may be collectively referred to as sharing determination information 550.

[0092] The sharing rate determination unit 221 uses machine learning such as deep learning to determine the first sharing rate and the second sharing rate based on the sharing determination information 550. The sharing rate determination unit 221 includes a trained neural network 221a that determines the first sharing rate and the second sharing rate based on the sharing determination information 550, for example.

[0093] Sharing determination information 550 is input to the input layer of the neural network 221a, and the first sharing rate and the second sharing rate are output from the output layer of the neural network 221a. The neural network 221a may be a convolutional neural network or another type of neural network.

[0094] In the learning stage (also called the training stage) of the neural network 221a, a large number of pieces of training allocation determination information 550 are prepared as input data for training the neural network 221a. In addition, a first allocation rate and a second allocation rate corresponding to each of the prepared training allocation determination information 550 are prepared as annotation data. Then, a data set consisting of a large number of combinations of the training allocation determination information 550 and the annotation data is used to learn (in other words, train) the neural network 221a. The annotation data is also called, for example, teacher data.

[0095] Here, an adjustment process executed when the operation command for the slave robot 50a is an operation command indicated by the operation command information 100 included in the training allocation determination information 550, and the performance, state and surrounding environment of the slave robot 50a and the non-slave robot 50b are the performance, state and surrounding environment specified from the overall robot information 500 included in the training allocation determination information 550, is called an adjustment process corresponding to the training allocation determination information 550. The first and second allocation rates to be shared by the slave robot 50a and the non-slave robot 50b in the adjustment process corresponding to the training allocation determination information 550 become annotation data corresponding to the training allocation determination information 550.

[0096] The first sharing amount calculation unit 222a calculates a first sharing amount of the adjustment amount α for the slave robot 50a. The first sharing amount calculation unit 222a sets a value obtained by multiplying the first sharing rate determined by the sharing rate determination unit 221 by the adjustment amount α as the first sharing amount.

[0097] The second allocation amount calculation unit 222b calculates a second allocation amount of the adjustment amount α for the slave non-slave robot 50b. The second allocation amount calculation unit 222b multiplies the second allocation rate determined by the allocation rate determination unit 221 by the adjustment amount α, and sets the value obtained as the second allocation amount.

[0098] The neural network 221a provided in the sharing rate determination unit 221 is trained to determine the first sharing rate and the second sharing rate that enable the slave robot 50a and the non-slave robot 50b to perform work appropriately in accordance with their performance, status, and surrounding environment.

[0099] For example, the neural network 221a is trained to determine a first sharing rate and a second sharing rate such that the rotation speeds of both the motors 520 of the slave robot 50a and the slave external robot 50b do not become excessively high when the slave robot 50a and the slave external robot 50b hold the work object 90 with an appropriate holding force and move it to a position indicated by the destination position information 101.

[0100] In addition, the neural network 221a is trained to determine the first and second sharing rates such that the torque of both the motors 520 of the slave robot 50a and the slave external robot 50b does not become excessive when the slave robot 50a and the slave external robot 50b hold the work object 90 with an appropriate holding force and move it to a position indicated by the destination position information 101.

[0101] In addition, the neural network 221a is trained to determine the first sharing rate and the second sharing rate that enable the slave robot 50a and the slave external robot 50b to perform the work appropriately regardless of the difference in response speed of the motors 520 of the slave robot 50a and the slave external robot 50b when the slave robot 50a and the slave external robot 50b hold the work object 90 with an appropriate holding force and move it to the position indicated by the destination position information 101.

[0102] In addition, the neural network 221a is trained to determine the first sharing rate and the second sharing rate that enable the slave robot 50a and the slave external robot 50b to appropriately perform the work while operating within the maximum movable range in the specifications, when the slave robot 50a and the slave external robot 50b hold the work object 90 with an appropriate holding force and move it to the position indicated by the destination position information 101.

[0103] In addition, the neural network 221a is trained to determine the first sharing rate and the second sharing rate such that the slave robot 50a, the slave robot 50b, and the work object 90 do not interfere with obstacles when the slave robot 50a and the slave robot 50b hold the work object 90 with an appropriate holding force and move it to a position indicated by the destination position information 101.

[0104] In addition, when the slave robot 50a and the slave external robot 50b hold the work object 90 with an appropriate holding force and move it to the position indicated by the destination position information 101, even if an abnormality occurs in one of the slave robot 50a and the slave external robot 50b and the current of the motor 520 of that robot 50 becomes abnormal, the neural network 221a is trained to determine the first sharing rate and the second sharing rate such that the slave robot 50a and the slave external robot 50b can perform the work appropriately.

[0105] <Example of operation of first generation unit and second generation unit> The first generating unit 230a corrects the destination position information 101 included in the operation command information 100 indicating the operation command of the slave robot 50a based on the first allocation amount determined by the allocation determining unit 220, and sets the corrected destination position information 101 as control information 600a for the slave robot 50a. For example, the first generating unit 230a sets a value obtained by subtracting the first allocation amount from the X coordinate indicating the destination position information 101 as the control information 600a. The slave robot 50a performs an operation in accordance with the control information 600a generated by the first generating unit 230a.

[0106] The second generating unit 230b generates control information 600b for the slave robot 50b based on the destination position information 101 included in the operation command information 100 indicating the operation command of the slave robot 50a and the second allocation amount determined by the allocation determining unit 220. For example, the second generating unit 230b sets a value obtained by adding the second allocation amount to the X coordinate indicating the destination position information 101 as the control information 600b. The slave robot 50b operates in accordance with the control information 600b generated by the second generating unit 230b.

[0107] For example, consider a case where the X coordinate indicated by the destination position information 101 is +1000 mm, the adjustment amount α is +10 mm, the first sharing rate of the slave robot 50a is 80%, and the second sharing rate of the slave robot 50b is 20%. For example, when there are few obstacles around the slave robot 50a and many obstacles around the slave robot 50b, the sharing rate determination unit 221 determines the first sharing rate to be 80% and the second sharing rate to be 20%. Alternatively, when the response speed of the motor 520 of the slave robot 50a is fast and the response speed of the motor 520 of the slave robot 50b is slow, the sharing rate determination unit 221 determines the first sharing rate to be 80% and the second sharing rate to be 20%. In this case, the first allocation amount is +8 mm and the second allocation amount is +2 mm, so the control information 600a indicates +992 mm and the control information 600b indicates +1002 mm. The slave robot 50a operating according to the control information 600a and the non-slave robot 50b operating according to the control information 600b move on the X axis so that the work object 90 held from opposite sides moves to the position of +1000 mm on the X coordinate and the distance between the end effectors becomes smaller by 10 mm. At this time, compared to when the slave robot 50a and the slave external robot 50b move the work object 90 to a position of +1000 mm on the X coordinate so that the distance between the end effectors does not change, the slave robot 50a, which is responsible for 80% of the adjustment process, moves 8 mm toward the slave external robot 50b, and the slave external robot 50b, which is responsible for 20% of the adjustment process, moves 2 mm toward the slave robot 50a, thereby reducing the distance between the end effectors of the slave robot 50a and the slave external robot 50b by 10 mm.

[0108] As another example, consider a case where the X coordinate indicated by the destination position information 101 is +1000 mm, the adjustment amount α is +6 mm, the first sharing rate of the slave robot 50a is 50%, and the second sharing rate of the slave robot 50b is 50%. For example, when there are no obstacles around the slave robot 50a and the slave robot 50b, the sharing rate determination unit 221 determines each of the first sharing rate and the second sharing rate to be 50%. Alternatively, when the response speed of the motor 520 of the slave robot 50a is approximately the same as the response speed of the motor 520 of the slave robot 50b, the sharing rate determination unit 221 determines each of the first sharing rate and the second sharing rate to be 50%. In such a case, since both the first sharing amount and the second sharing amount are +3 mm, the control information 600a indicates +997 mm, and the control information 600b indicates +1003 mm. The slave robot 50a operating according to the control information 600a and the slave external robot 50b operating according to the control information 600b move on the X axis so that the work object 90 held from the opposite side moves to the position of +1000 mm on the X coordinate and the distance between the end effectors becomes smaller by 6 mm. At this time, compared to the case where the slave robot 50a and the slave external robot 50b move the work object 90 to the position of +1000 mm on the X coordinate so that the distance between the end effectors does not change, the slave robot 50a which shares 50% of the adjustment process moves toward the slave external robot 50b by 3 mm, and the slave external robot 50b which shares 50% of the adjustment process moves toward the slave robot 50a by 3 mm, thereby reducing the distance between the end effectors of the slave robot 50a and the slave external robot 50b by 6 mm.

[0109] As another example, consider a case where the X coordinate indicated by the destination position information 101 is +1500 mm, the adjustment amount α is -10 mm, the first share of the slave robot 50a is 30%, and the second share of the slave robot 50b is 70%. In this case, since the first share is -3 mm and the second share is -7 mm, the control information 600a indicates +1503 mm and the control information 600b indicates +1493 mm. The slave robot 50a operating according to the control information 600a and the slave robot 50b operating according to the control information 600b move on the X axis so that the work object 90 held from the opposite side moves to the position of +1500 mm in the X coordinate and the distance between the end effectors increases by 10 mm. At this time, compared to when the slave robot 50a and the slave external robot 50b move the work object 90 to a position of +1500 mm on the X coordinate so that the distance between the end effectors does not change, the slave robot 50a, which is responsible for 30% of the adjustment process, moves 3 mm in a direction away from the slave external robot 50b, and the slave external robot 50b, which is responsible for 70% of the adjustment process, moves 7 mm in a direction away from the slave robot 50a, thereby increasing the distance between the end effectors of the slave robot 50a and the slave external robot 50b by 10 mm.

[0110] As another example, consider a case where the X coordinate indicated by the destination position information 101 is +2000 mm, the adjustment amount α is +10 mm, the first sharing rate of the slave robot 50a is 100%, and the second sharing rate of the slave robot 50b is 0%. For example, when there are no obstacles around the slave robot 50a and there are many obstacles around the slave robot 50b, the sharing rate determination unit 221 determines the first sharing rate to be 100% and the second sharing rate to be 0%. Alternatively, when the response speed of the motor 520 of the slave robot 50a is significantly faster than the response speed of the motor 520 of the slave robot 50b, the sharing rate determination unit 221 determines the first sharing rate to be 100% and the second sharing rate to be 0%. In this case, the first allocation amount is +10 mm and the second allocation amount is 0 mm, so the control information 600a indicates +1990 mm and the control information 600b indicates +2000 mm. The slave robot 50a operating according to the control information 600a and the non-slave robot 50b operating according to the control information 600b move on the X axis so that the work object 90 held from opposite sides moves to the position of +2000 mm on the X coordinate and the distance between the end effectors becomes smaller by 10 mm. At this time, compared to when the slave robot 50a and the slave external robot 50b move the work object 90 to a position of +2000 mm on the X coordinate so that the distance between the end effectors does not change, the slave robot 50a, which shares 100% of the adjustment process, moves 10 mm toward the slave external robot 50b, while the slave external robot 50b, which shares 0% of the adjustment process (i.e., the slave external robot 10b that does not participate in the adjustment process), does not change position, so that the slave robot 50a and the slave external robot 50b increase the distance between the end effectors by 10 mm.

[0111] As another example, consider a case where the X coordinate indicated by the destination position information 101 is +2000 mm, the adjustment amount α is -10 mm, the first sharing rate of the slave robot 50a is 0%, and the second sharing rate of the slave robot 50b is 100%. For example, when there are many obstacles around the slave robot 50a and no obstacles around the slave robot 50b, the sharing rate determination unit 221 determines the first sharing rate to be 0% and the second sharing rate to be 100%. Alternatively, when the response speed of the motor 520 of the slave robot 50a is significantly slower than the response speed of the motor 520 of the slave robot 50b, the sharing rate determination unit 221 determines the first sharing rate to be 0% and the second sharing rate to be 100%. In this case, the first allocation amount is 0 mm and the second allocation amount is -10 mm, so the control information 600a indicates +2000 mm and the control information 600b indicates +1990 mm. The slave robot 50a operating according to the control information 600a and the non-slave robot 50b operating according to the control information 600b move on the X axis so that the work object 90 held from opposite sides moves to the position of +2000 mm on the X coordinate and the distance between the end effectors increases by 10 mm. At this time, compared to when the slave robot 50a and the slave external robot 50b move the work object 90 to a position of +2000 mm on the X coordinate so that the distance between the end effectors does not change, the slave robot 50a, which is responsible for 0% of the adjustment process, does not change its position, and the slave external robot 50b, which is responsible for 100% of the adjustment process, moves 10 mm in a direction away from the slave robot 10a, thereby increasing the distance between the end effectors of the slave robot 50a and the slave external robot 50b by 10 mm.

[0112] As described above, in this example, control information for each of the multiple robots 50 is generated individually based on the operation command information related to the work performed by the multiple robots 50 in cooperation with each other and the robot information 500 related to the multiple robots 50. This makes it possible to appropriately control the multiple robots 50 that perform work in cooperation with each other.

[0113] In addition, in this example, since the processing device 1 is located in close proximity to the multiple robots 50, for example, it can immediately obtain sensor detection information from each robot 50. Therefore, the processing device 1 can accurately know the current state of each robot 50. This allows the processing device 1 to appropriately control each robot 50.

[0114] In the above example, the control information for each of the multiple robots 50 is individually generated based on the robot information 500 related to the multiple robots 50, but the present disclosure is not limited to this. For example, the control information for at least one robot 50 among the multiple robots 50 may be generated based on the individual robot information 510 related to at least one robot 50 among the multiple robots 50. Specifically, when the multiple robots 50 include a first robot and a second robot, the first control information for the first robot may be generated based on the operation command information, and the second control information for the second robot may be generated based on the operation command information and the individual robot information 510 of the second robot.

[0115] In the above example, the processing device 1 is provided separately from each robot 50, but the robot controller 51 of one robot 50 may function as the processing device 1. For example, the robot controller 51 of the slave robot 50a may function as the processing device 1. In this case, the acquisition unit 20 and the generation unit 21 of the processing device 1 are provided in the robot 50. For example, the robot controller 51 functions as the processing device 1 by executing a program stored in itself. By providing the robot 50 with the acquisition unit 20 and the generation unit 21, the acquisition unit 20 can immediately acquire, for example, sensor detection information from each robot 50. Therefore, the generation unit 21 can generate control information based on the sensor detection information that appropriately indicates the current state of each robot 50. As a result, the processing device 1 can appropriately control each robot 50.

[0116] Furthermore, the slave robot 50 may operate autonomously to a certain extent, rather than operating using the control information received from the processing device 1 as is. For example, the slave robot 50 may operate autonomously to a certain extent by correcting the control information received from the processing device 1 based on the sensor detection information obtained by the sensor unit 53 of the slave robot 50 itself and the sensor detection information obtained by the sensor unit 53 of the other robot 50, and operating according to the corrected control information.

[0117] In the above example, the control device 10 generates the operation command information indicating the operation command for the robot 50 based on the detection result of the user's movement, but the operation command information indicating the operation command for the robot 50 may be generated based on work information indicating the work content created in advance. In this case, the robot 50 that is the target of the operation command does not imitate the user's movement, but performs an operation according to the work content created in advance. Also, the control device 10 may generate operation command information indicating the operation command for multiple robots 50, rather than the operation command information indicating the operation command for one robot 50. In this case, the processing device 1 generates control information for each robot 50 based on the operation command information indicating the operation commands for the multiple robots 50 and the overall robot information 500.

[0118] The control device 10 may be located in close proximity to the multiple robots 50. The processing device 1 may be located remotely from the multiple robots 50. The processing device 1 may communicate with each robot 50 through a network 80. The control device 10 and the processing device 1 may communicate with each robot 50 directly without using the network 80. The control device 10 may communicate with each robot 50 directly without using the network 80.

[0119] In addition, in the above description, an example has been described in which the control device 10 generates the operation command information, but the processing device 1 may generate the operation command information based on the output of the control device 10. For example, some of the functions of the control device 10 described above may be executed by the acquisition unit 20 or the generation unit 21. Specifically, for example, the acquisition unit 20 may acquire the detection result of the sensor unit 15 from the control device 10, and the generation unit 21 may generate the operation command information based on the detection result acquired by the acquisition unit 20. In this case, in the above description, the "control device 10" may be appropriately read as the "processing device 1".

[0120] As described above, the processing device, the control system, and the robot system have been described in detail, but the above description is merely illustrative in all respects, and this disclosure is not limited thereto. In addition, the above-described various examples can be combined and applied as long as they are not mutually inconsistent. It is understood that countless examples not illustrated can be envisioned without departing from the scope of this disclosure.

[0121] This disclosure includes the following:

[0122] In one embodiment, (1) the processing device includes an acquisition unit that acquires operation command information regarding work performed by multiple robots in cooperation with each other and robot information regarding at least one of the multiple robots, and a generation unit that generates control information for at least one of the multiple robots based on the operation command information and the robot information.

[0123] (2) In the processing device of (1) above, the plurality of robots includes a first robot, and the operation command information indicates an operation command for only the first robot.

[0124] (3) In the processing device of (2) above, the motion command information is based on operation information of the first robot.

[0125] (4) In the processing device of (2) or (3) above, the action command information is information output from a control device located in a location different from the first robot, and causes the first robot to imitate the action of a user.

[0126] (5) In the processing apparatus according to any one of (2) to (4) above, the plurality of robots includes a second robot having specifications or settings different from those of the first robot.

[0127] (6) In any one of the processing devices described above in (1) to (5), the robot information includes a detection result from at least one sensor unit that detects a state of at least one robot among the plurality of robots.

[0128] (7) In any one of the processing devices described above in (1) to (6), the generation unit determines a processing load among the multiple robots based on the operation command information and the robot information, and generates the control information for each of the multiple robots individually based on the processing load.

[0129] (8) In any one of the processing devices described above in (1) to (7), the acquisition unit and the generation unit are provided in any one of the plurality of robots.

[0130] (9) In any one of the processing devices described above in (1) to (7), a communication unit is provided that communicates with the plurality of robots, and the communication unit transmits the control information to at least one of the plurality of robots.

[0131] (10) The control system includes any one of the processing devices described above in (1) to (9) and a control device that transmits the operation command information to the processing device.

[0132] (11) The program is a program for causing a computer device to function as any one of the processing devices described above in (1) to (9). [Explanation of symbols]

[0133] 1 Processing equipment 10 Control device 20 Acquisition Department 21 Generation part 30 Programs 50,50a,50b Robot 53 Sensor section 100 Operation command information 250 Control System 500 Robot Information

Claims

1. an acquisition unit that acquires operation command information related to a task performed by a plurality of robots in cooperation with each other and robot information related to at least one of the plurality of robots; a generation unit that generates control information for at least one of the plurality of robots based on the operation command information and the robot information; A processing device comprising:

2. 2. The processing device according to claim 1, The plurality of robots includes a first robot, A processing device, wherein the operation command information indicates an operation command for only the first robot.

3. 3. The processing device according to claim 2, A processing device, wherein the operation command information is based on operation information of the first robot.

4. The processing apparatus according to claim 2 or 3, A processing device, wherein the action command information is information output from a control device disposed in a location different from the first robot, and causes the first robot to imitate the action of a user.

5. The processing apparatus according to claim 2 or 3, A processing apparatus, wherein the plurality of robots include a second robot having different specifications or settings than the first robot.

6. 4. The processing apparatus according to claim 1, A processing device in which the robot information includes detection results from at least one sensor unit that detects the state of at least one of the multiple robots.

7. 4. The processing apparatus according to claim 1, The generation unit is determining a processing division among the plurality of robots based on the operation command information and the robot information; A processing device that individually generates the control information for each of the plurality of robots based on the processing allocation.

8. 4. The processing apparatus according to claim 1, A processing device, wherein the acquisition unit and the generation unit are provided in any one of the plurality of robots.

9. 4. The processing apparatus according to claim 1, A communication unit that communicates with the plurality of robots, A processing device, wherein the communication unit transmits the control information to at least one of the plurality of robots.

10. A processing device according to any one of claims 1 to 3, a control device that transmits the operation command information to the processing device; A control system comprising:

11. A program for causing a computer device to function as the processing device according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • Robot control device, robot control method, and robot control system

    JP2020091894A