Control system, control method and control unit

By virtually setting the cooperative work area of ​​the control system and controlling the robot based on three-dimensional position information, the problem of difficulty in improving safety and productivity in the shared work area between the collaborative robot and the operator is solved, and safe and efficient collaborative work is achieved.

CN113557108BActive Publication Date: 2024-12-06OMRON CORP
View PDF 17 Cites 0 Cited by

Patent Information

Application Number
CN202080020262.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-03-28
Filing Date
2020-02-12
Publication Date
2024-12-06
Estimated Expiration
2040-02-12

AI Technical Summary

Technical Problem

In the production site where collaborative robots share the operating area with operators, it is difficult to improve safety and productivity at the same time, and fail to effectively follow safety standards.

Method used

Using a control system including control components, three-dimensional sensor components and setting support components, by obtaining the three-dimensional position information of the operator and the robot, virtually set the cooperative work area, and control the stop or speed of the robot according to the position relationship.

Benefits of technology

It achieves safety and productivity improvements at the collaborative operation site, ensuring safe interaction between operators and robots, and improving productivity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113557108B_ABST
    Figure CN113557108B_ABST
Patent Text Reader

Abstract

The present invention provides a control system, a control method and a control unit. The control system (1) comprises: a control device (100) for controlling a robot (200); a three-dimensional sensor (300) for acquiring position information of an operator and a robot (200) within a field of view of a three-dimensional space; and a support device (400) for controlling the stopping or speed of the robot (200) through a user interface (411) for virtually setting a collaborative work area allowing the operator and the robot (200) to work. The control device (100) controls the stopping or speed of the robot (200) according to whether the position of the operator or the robot (200) calculated based on the position information is included in the collaborative work area set using the user interface (411) and the relative position relationship between the operator and the robot (200) calculated based on the position information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a control system, a control method and a control unit, and more particularly to a control system, a control method and a control unit for controlling a robot. Background Art

[0002] In most production sites, robots are frequently operated while cooperating with operators. In order to ensure the safety of operators in such production sites, various efforts are being made. For example, Japanese Patent Publication No. 2003-222295 (Patent Document 1) discloses a device that separates a dangerous area where a machine operates from a non-dangerous area where an operator operates by a safety protection boundary, and controls an emergency stop function when an operator crosses the safety protection boundary.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2003-222295 Summary of the invention

[0006] Problems to be solved by the invention

[0007] Furthermore, in recent years, safety standards have been established for constructing a system in which workers and robots share a working area without being separated by safety measures, etc., at production sites using robots as described above. For example, International Organization for Standardization (ISO) 10218-1, ISO 10218-2, and ISO / TS 15066 define safety requirements for collaborative robots that can work in collaboration with workers or robot systems using collaborative robots.

[0008] The construction of production sites using collaborative robots is still on the way to progress, and technologies that improve both safety and productivity are particularly desired. However, in the system disclosed in Patent Document 1, the area where the machine works and the area where the operator works are completely separated, and no consideration is given to the system complying with the safety standards described above.

[0009] The present invention aims to solve the above-mentioned problems and to provide a technology for improving both safety and productivity at a production site where a robot and an operator collaborate.

[0010] Technical means of solving problems

[0011] According to an example of the present disclosure, a control system for controlling a robot is provided. The control system includes: a control unit for controlling the robot; a three-dimensional sensor unit for acquiring position information of an operator and a robot within a field of view of a three-dimensional space; and a setting support unit for providing a user interface for virtually setting a collaborative work area that allows the operator and the robot to work. The control unit controls the stop or speed of the robot according to whether the position of the operator or the robot calculated based on the position information is included in the collaborative work area set using the user interface, and the relative position relationship between the operator and the robot calculated based on the position information.

[0012] According to the present disclosure, the user can virtually set a collaborative work area that allows the operation of the operator and the robot, and can control the stop or speed of the robot based on whether the positions of the operator and the robot in the three-dimensional space are included in the virtually set collaborative work area and the relative position relationship between the operator and the robot in the three-dimensional space. Thus, the user can improve safety and productivity at the same time in the production site where the robot and the operator collaborate.

[0013] In the disclosure, the control unit controls the stop or speed of the robot based on whether the worker or the robot crosses a virtual boundary virtually set at the end of the cooperative work area.

[0014] According to the present disclosure, the user can appropriately control the stop or speed of the robot using the virtual boundary virtually set at the end of the collaborative work area, thereby improving both safety and productivity at the production site where the robot and the worker collaborate.

[0015] In the disclosure described above, the virtual boundary is switched depending on whether the position of the robot is included in the cooperative work area.

[0016] According to the present disclosure, the user can set an appropriate virtual boundary according to the position of the robot, thereby further improving both safety and productivity.

[0017] In the disclosure, the control system includes a realization component, which can visually realize the virtual boundary in the working space.

[0018] According to the present disclosure, the user can perform work while confirming the virtual boundary that can be visually realized in the work space, so it is possible to further improve both safety and productivity.

[0019] In the disclosure, the control unit controls the stop or speed of the robot based on whether an object including an operator or a robot intrudes into the cooperative working area from the operator side or whether an object intrudes into the cooperative working area from the robot side.

[0020] According to the present disclosure, the user can appropriately control the stopping or speed of the robot based on whether an object including an operator or a robot invades the collaborative work area, or from which direction the object invades the collaborative work area from the operator side and the robot side. Therefore, there is no need to set a virtual boundary, which can improve safety and productivity at the same time.

[0021] In the disclosure, the setting support component provides a user interface for setting a plurality of areas including a collaborative work area as areas where the worker and the robot perform work respectively.

[0022] According to the present disclosure, the user can set a desired area including the cooperative work area as an area where the worker and the robot each perform work, thereby further improving both safety and productivity.

[0023] In the disclosure, the control system includes a control content setting component, which provides a user interface for setting the control content of the robot corresponding to the relative position relationship between the operator and the robot.

[0024] According to the present disclosure, the user can freely set the control content of the robot according to the relative positional relationship between the operator and the robot, so that safety and productivity can be further improved at the same time.

[0025] In the disclosure, the setting support component provides a user interface for virtually setting a cooperative work area based on an image corresponding to a field of view of the three-dimensional sensor component.

[0026] According to the present disclosure, a user can virtually set a cooperative work area based on an image corresponding to the field of view of a three-dimensional sensor component, thereby further improving both safety and productivity.

[0027] In the disclosure, the control system includes a prohibition component that prohibits the control component from controlling the stop or speed of the robot based on the position of a workpiece related to the operation.

[0028] According to the present disclosure, the robot does not stop or its speed is not controlled due to the detection of the position of the workpiece, so that safety and productivity can be further improved at the same time.

[0029] According to another example of the present disclosure, a control method for controlling a robot is provided. A collaborative work area that allows operations of an operator and a robot is virtually set through a user interface. The control method includes the following steps: controlling the robot; and obtaining position information of the operator and the robot contained in a field of view of a three-dimensional space. The step of controlling the robot includes the following steps: controlling the stop or speed of the robot according to whether the position of the operator or the robot calculated based on the position information is included in the collaborative work area, and the relative position relationship between the operator and the robot calculated based on the position information.

[0030] According to the present disclosure, the user can virtually set a collaborative work area that allows the operation of the operator and the robot, and can control the stop or speed of the robot based on whether the positions of the operator and the robot in the three-dimensional space are included in the virtually set collaborative work area and the relative position relationship between the operator and the robot in the three-dimensional space. Thus, the user can improve safety and productivity at the same time in the production site where the robot and the operator collaborate.

[0031] According to another example of the present disclosure, a control unit for controlling a robot is provided. The control unit includes: a control unit for controlling the robot; and a setting support tool for providing a user interface for virtually setting a collaborative work area that allows operations of an operator and a robot. The control unit controls the stop or speed of the robot based on whether the position of the operator or the robot calculated based on position information acquired by a three-dimensional sensor is included in the collaborative work area set using the user interface, and the relative positional relationship between the operator and the robot.

[0032] According to the present disclosure, the user can virtually set a collaborative work area that allows the operation of the operator and the robot, and can control the stop or speed of the robot based on whether the positions of the operator and the robot in the three-dimensional space are included in the virtually set collaborative work area and the relative position relationship between the operator and the robot in the three-dimensional space. Thus, the user can improve safety and productivity at the same time in the production site where the robot and the operator collaborate. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a schematic diagram showing an application example of the control system of this embodiment.

[0034] Figure 2 It is a schematic diagram showing a control system of a comparative example.

[0035] Figure 3 It is a schematic diagram showing a hardware configuration example of the control device according to the present embodiment.

[0036] Figure 4 It is a schematic diagram showing a hardware configuration example of a support device according to the present embodiment.

[0037] Figure 5 It is a schematic diagram showing a hardware configuration example of the three-dimensional sensor according to the present embodiment.

[0038] Figure 6 This is a schematic diagram showing an example of various areas that can be set in the control system of this embodiment.

[0039] Figure 7 This is a schematic diagram showing an example of various areas that can be set in the control system of this embodiment.

[0040] Figure 8 This is a schematic diagram showing an example of a robot control table used in the control system of this embodiment.

[0041] Fig. 9 It is a schematic diagram showing an example of area setting in the support device according to the present embodiment.

[0042] Fig.10 It is a schematic diagram showing an example of stop / speed setting in the support device according to the present embodiment.

[0043] Fig.11 It is a schematic diagram showing an example of workpiece non-detection setting in the support device according to the present embodiment.

[0044] Fig.12 It is a schematic diagram showing an example of the safety control process executed in the control system of this embodiment.

[0045] Fig.13 It is a schematic diagram showing an example of the safety control process executed in the control system of this embodiment.

[0046] Fig.14 Detailed Description of the Invention This is a flowchart showing a safety control process executed by the control system of the present embodiment.

[0047] Fig.15 It is a schematic diagram showing a control system of a modified example.

[0048] Fig.16 It is a schematic diagram showing a control system of a modified example.

[0049] Explanation of symbols

[0050] 1.1a.1000: Control system

[0051] 100, 1100: Control device

[0052] 100a: Control unit

[0053] 102, 302, 402: Processor

[0054] 104, 304, 404: Main memory

[0055] 106, 306, 406: Storage

[0056] 108: Robot Controller

[0057] 110, 416: Network controller

[0058] 114, 316: IO controller

[0059] 116: Memory card interface

[0060] 118: Memory Card

[0061] 120: Local bus controller

[0062] 130, 318, 418: Processor bus

[0063] 140: Control Program

[0064] 150, 1062: Safety procedures

[0065] 200: Robot

[0066] 250: Guardrail

[0067] 300: 3D sensor

[0068] 311, 312: Camera interface

[0069] 351, 352: Camera

[0070] 400: Support device

[0071] 408: Input

[0072] 410: Display unit

[0073] 411, 412, 413: User interface

[0074] 411a, 412a: Pointer

[0075] 414: Recording Media

[0076] 415: Frame Image

[0077] 417: Optical Drive

[0078] 500: Setting support tools

[0079] 600: Projector

[0080] 900: Control unit

[0081] 1060: System Program

[0082] 1064: Robot Control Table

[0083] 1300: 2D sensor

[0084] 1400: Safety light curtain

[0085] 3062: Monitoring Procedure

[0086] 3064: Monitoring data

[0087] 4062: Support Program DETAILED DESCRIPTION

[0088] Regarding the embodiments of the present invention, Figure 1 In addition, the same or corresponding parts in the drawings are denoted by the same reference numerals and their description will not be repeated.

[0089] <A. Application examples>

[0090] An example of a scenario to which the present invention is applicable will be described.

[0091] Figure 1 Schematic diagram showing an application example of the control system 1 of this embodiment. Figure 1 As shown, the control system 1 of the present embodiment is a system in which an operator and a robot 200 share a working area at a production site without being separated by safety measures or the like.

[0092] For example, Figure 1 In the example shown, a robot 200 is installed on a workbench installed on the floor, and an operator holds a workpiece (illustrated as "W") facing the robot 200. A collaborative work area (collaborative workspace) is allocated between the operator and the robot 200 as a virtual area. In addition, the "collaborative work area" is also called a "collaborative work space".

[0093] The control system 1 of the present embodiment is constructed in accordance with the prescribed safety standards (ISO 10218-1, ISO 10218-2, and ISO / TS 15066), and the collaborative work area is an area where the operator and the robot 200 are allowed to work. That is, the robot 200 of the present embodiment is a collaborative robot that has been considered in terms of safety functions so that it can directly interact with a person ("operator" in this specification) in the prescribed collaborative work area. In other words, the robot 200 of the present embodiment is designed to meet the safety requirements specified in the safety standards in terms of collaborative work with a person.

[0094] The control system 1 includes: a control device 100 for controlling the robot 200 ; a three-dimensional sensor 300 for acquiring position information of an operator and the robot 200 ; and a support device 400 for supporting the control of the robot 200 in the control device 100 .

[0095] The control device 100 includes the "control component" of the present disclosure, and controls the robot 200 by outputting control instructions for specifying the speed of driving, stopping, and moving the robot 200 to the robot 200. The robot 200 is driven based on the control instructions from the control device 100, runs at a specified speed, and stops as needed. In addition, in the present embodiment, the control device 100 is a programmable controller (Programmable Logic Controller (PLC)) as a processing body for executing a control program (which may include sequence control and motion control), but is not limited to a PLC, and any device may be used as long as it is a device for controlling the robot 200.

[0096] The three-dimensional sensor 300 includes the "three-dimensional sensor component" of the present disclosure, and obtains the position information of the operator and the robot 200 within the field of view of the three-dimensional space. Figure 5 While explaining.

[0097] The support device 400 includes the “setting support means” of the present disclosure, and provides a user interface for virtually setting a cooperative work area in which the work of the operator and the robot 200 is permitted.

[0098] In the control system 1 having the above-described structure, first, the user (operator and manager of the control system 1, etc.) virtually sets the size (e.g., area) of the cooperative work area in the three-dimensional space of the work site using the user interface provided by the support device 400. Data for determining the cooperative work area set by the support device 400 is input to the control device 100. In addition, the data for determining the cooperative work area set by the support device 400 may also be output to the three-dimensional sensor 300 via the control device 100 or directly from the support device 400.

[0099] During the operation, the position information of the operator and the robot 200 in the three-dimensional space is obtained by the three-dimensional sensor 300. In addition, the position coordinates (e.g., X coordinate, Y coordinate, and Z coordinate) in the three-dimensional space processed by the support device 400 and the position coordinates (e.g., X coordinate, Y coordinate, and Z coordinate) in the three-dimensional space processed by the three-dimensional sensor 300 are calibrated in advance to be consistent with each other.

[0100] The current positions of the operator and the robot 200 are calculated based on the position information of the operator and the robot 200 respectively obtained by the three-dimensional sensor 300. In addition, the processing of calculating the current positions of the operator and the robot 200 respectively can be executed by the three-dimensional sensor 300 and the result can be output to the control device 100, or it can be executed by the control device 100 based on the position information obtained from the three-dimensional sensor 300.

[0101] When the current positions of the operator and the robot 200 are calculated, it is determined whether the position of the operator or the robot 200 is included in the cooperative operation area set by the support device 400, and then the relative position relationship between the operator and the robot 200 is determined. Here, the so-called "position" of the operator is assumed to be the position of each point of the operator detected in the three-dimensional space. For example, the "position" of the operator may include the position of the operator's head, body, hands or feet. Moreover, the so-called "position" of the robot 200 is assumed to be the position of each point of the robot 200 detected in the three-dimensional space. For example, the "position" of the robot 200 may include the position of the main body (body), arm (arm), joint or end effector of the robot 200.

[0102] In the control system 1, it is determined whether the position of the operator is included in the cooperative work area and whether the position of the robot 200 is included in the cooperative work area, and the area including the positions of the operator and the robot 200 is determined among various areas included in the three-dimensional space of the work site. In addition, such a process of determining whether the position of the operator or the robot 200 is included in the cooperative work area and the process of determining the relative positional relationship between the operator and the robot 200 may be executed by the three-dimensional sensor 300 and the result thereof may be output to the control device 100, or may be executed by the control device 100 based on the position information acquired from the three-dimensional sensor 300.

[0103] The control device 100 outputs a predetermined control command to the robot 200 based on whether the position of the operator or the robot 200 is included in the cooperative work area and the relative positional relationship between the operator and the robot, thereby controlling the robot 200 .

[0104] Please refer to the specific Fig.12 as well as Fig.13While explaining, for example, the farther the operator is from the robot 200, the robot 200 is controlled to run at a higher speed, and the closer the operator is to the robot 200, the robot 200 is controlled to run at a lower speed or stop. Furthermore, if the operator is in the collaborative work area and the robot 200 leaves the collaborative work area, the robot 200 is controlled to run. On the contrary, if the robot 200 is in the collaborative work area and the operator leaves the collaborative work area, the robot 200 is controlled to run in the collaborative work area. Furthermore, when the operator and the robot 200 are in the collaborative work area at the same time, the robot 200 is controlled to stop.

[0105] Here, Figure 2 is a schematic diagram showing a control system 1000 of a comparative example. Figure 2 As shown, in the control system 1000 of the comparative example, the control device 1100 determines the position of the operator based on the position information of the operator acquired by the two-dimensional sensor 1300. That is, the control system 1000 of the comparative example does not detect the positions of the operator and the robot 200 in a three-dimensional space as in the control system 1 of the present embodiment, but detects the position of the operator two-dimensionally (for example, the X-axis and the Y-axis on a plane parallel to the floor).

[0106] Furthermore, the control system 1000 ensures the safety of the operator by installing a safety light curtain 1400 between the robot 200 and the operator. When the operator or the robot 200 crosses the safety light curtain 1400, the control device 1100 stops the robot 200. Thus, the robot 200 stops while the operator is working in the cooperative working area.

[0107] The control system 1000 configured in this way detects the position of the operator two-dimensionally, and thus can determine the current position of the operator by detecting the movement of the operator's lower body, such as the operator's feet, for example. However, the control system 1000 cannot detect the movement of the operator's upper body, such as the operator's hands or arms, through the two-dimensional sensor 1300, so if the robot 200 is to be operated at a high speed, the operator must retreat to a position sufficiently far away from the robot 200. That is, when the robot 200 is controlled only by detecting the movement of the operator's lower body, a sufficient margin must be considered for the operator's detected position, which is a trigger for switching from low-speed operation to high-speed operation.

[0108] In contrast, the control device 100 of this embodiment is as follows Figure 1As shown, the movement of the upper body such as the hands or arms of the operator can also be detected by the three-dimensional sensor 300. Therefore, for example, even if the operator does not step back, as long as the operator lets go of the hands, the control device 100 can determine that there is a sufficient distance between the operator and the robot 200, thereby enabling the robot 200 to switch from low-speed operation to high-speed operation.

[0109] Thus, the relative positional relationship between the operator and the robot in the three-dimensional space is identified based on the position information obtained by the three-dimensional sensor 300, thereby ensuring safety and minimizing the distance between the operator and the high-speed robot 200. In other words, the time that the robot 200 can run at high speed can be ensured longer.

[0110] Furthermore, according to the control system 1 of the present embodiment, the user can virtually set a cooperative operation area that allows the operation of the operator and the robot 200, and can control the stop or speed of the robot 200 based on whether the positions of the operator and the robot 200 in the three-dimensional space are included in the virtually set cooperative operation area and the relative positional relationship between the operator and the robot 200 in the three-dimensional space. That is, the user can set a desired area as a cooperative operation area, and further, can control the stop or speed of the robot 200 based on the relative positional relationship between the operator and the robot 200 using the set cooperative operation area as a reference. Thus, the user can improve safety and productivity at the same time at the production site where the robot 200 and the operator cooperate.

[0111] <B. Hardware Configuration of Each Device Included in Control System 1>

[0112] Next, an example of the hardware configuration of each device included in the control system 1 will be described.

[0113] (b1: control device 100)

[0114] Figure 3 1 is a schematic diagram showing an example of the hardware configuration of the control device 100 of the present embodiment. Although the description is omitted here, the control device 100 of the present embodiment has functional safety. Figure 3 As shown, the control device 100 includes a processor 102, a main memory 104, a storage 106, a local bus controller 120, a robot controller 108, a network controller 110, an IO controller 114, and a memory card interface 116. These components are connected via a processor bus 130.

[0115] The processor 102 is a computing unit that mainly performs control operations, etc., and includes, for example, a central processing unit (CPU) or a graphics processing unit (GPU). Specifically, the processor 102 reads a program (for example, a control program 140, a system program 1060, and a safety program 150) stored in the storage 106, and expands and executes it in the main memory 104, thereby realizing a prescribed control corresponding to the control object (for example, the robot 200).

[0116] Figure 3 In the example, a structural example is shown in which the processor 102 executes a specified program to provide the functions required as the control device 100, but part or all of these provided functions can also be implemented using a dedicated hardware circuit (such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA), etc.).

[0117] The main memory 104 includes, for example, a volatile storage device such as a dynamic random access memory (DRAM) or a static random access memory (SRAM).

[0118] The storage 106 includes, for example, a non-volatile storage device such as a solid state drive (SSD) or a hard disk drive (HDD). In the storage 106, in addition to the system program 1060 for realizing basic functions, there are also stored a control program 140 created according to a control object such as a machine or equipment including the robot 200, a safety program 1062 executed to ensure the safety of the operator in the collaborative work between the operator and the robot 200, and a robot control table 1064 referred to when the safety program 1062 is executed.

[0119] The robot control table 1064 stores, for example, instruction information for controlling the stop or speed of the robot 200 according to whether the position of the operator or the robot 200 is included in the cooperative operation area and the relative position relationship between the operator and the robot 200. Figure 8 While explaining.

[0120] The processor 102 controls the main routine of the production of the control object such as machinery or equipment including the robot 200 by executing the control program 140. In addition, the processor 102 executes the safety program 1062 in parallel with the control program 140, thereby performing safety control processing to control the stop or speed of the robot 200 based on the position information of the operator and the robot 200 obtained by the three-dimensional sensor 300. Specifically, the processor 102 performs safety control processing to determine the area where the operator or robot 200 is located based on the position of the operator or robot 200 determined by the three-dimensional sensor 300 and various predetermined areas such as the collaborative work area, and controls the stop or speed of the robot 200 based on the determination result. For the specific content of the specific process of the safety control processing, refer to Fig.14 While explaining.

[0121] The local bus controller 120 exchanges data with any unit connected to the control device 100 via the local bus.

[0122] The robot controller 108 exchanges data with the robot 200 via a predetermined network. In particular, in this embodiment, the control device 100 outputs control instructions to the robot 200 via the robot controller 108, and the control instructions are used to specify the speed of the robot 200 when driving, stopping, and operating.

[0123] The network controller 110 exchanges data with the support device 400 via the network. In particular, in the present embodiment, the control device 100 obtains data for determining the cooperative work area set by the user from the support device 400 via the network controller 110. Furthermore, the control device 100 obtains data for determining the control content of the robot 200 set by the user from the support device 400 via the network controller 110. The data for determining the control content of the robot 200 obtained via the network controller 110 is included in the robot control table 1064 and stored in the storage 106.

[0124] The IO controller 114 exchanges data with the three-dimensional sensor 300 via a predetermined network. In particular, in the present embodiment, the control device 100 obtains the position information of the operator and the robot 200 via the IO controller 114, or obtains the determination result of the area where the operator or the robot 200 is located based on the position information. In addition, when the control device 100 is a PLC, in order to minimize the amount of information in the PLC, the determination of the area where the operator or the robot 200 is located can also be entrusted to the three-dimensional sensor 300, and the control device 100 only obtains its determination result from the three-dimensional sensor 300.

[0125] The memory card interface 116 receives a memory card 118 as an example of a removable recording medium. The memory card interface 116 can write data to the memory card 118 and read various data (log or trace data, etc.) from the memory card 118.

[0126] (b2: Support device 400)

[0127] Figure 4 2 is a schematic diagram showing an example of a hardware configuration of the support device 400 of the present embodiment. As an example, the support device 400 is implemented by a computer that complies with a general-purpose architecture executing a program.

[0128] like Figure 4 As shown, the support device 400 includes a processor 402, a main memory 404, a storage 406, an input unit 408, a display unit 410, an optical drive 417, and a network controller 416. These components are communicatively connected to each other via a processor bus 418.

[0129] The processor 402 includes a CPU or a GPU, etc., reads out a program (for example, an OS 4060 and a support program 4062 ) stored in the storage 406 , expands it in the main memory 404 , and executes it, thereby realizing various processes.

[0130] Figure 4 In the example of , a structural example is shown in which the functions required as a support device 400 are provided by executing a specified program by the processor 402, but part or all of these provided functions can also be implemented using a dedicated hardware circuit (such as ASIC or FPGA, etc.).

[0131] The main memory 404 includes, for example, a volatile storage device such as DRAM or SRAM.

[0132] The storage 406 includes, for example, a nonvolatile storage device such as a HDD or SSD. In addition to the OS 4060 for realizing basic functions, the storage 406 also stores a support program 4062 for providing the function of the support device 400. The support program 4062 includes commands for supporting the control device 100 to control the robot 200.

[0133] The processor 402 executes the support program 4062 to provide a user interface for virtually setting a cooperative work area that allows the operator and the robot 200 to work. Fig. 9 The data for specifying the cooperative work area set by the support device 400 is transmitted to the control device 100 via the network controller 416 .

[0134] Furthermore, the processor 402 executes the support program 4062 to provide a user interface for setting the control content of the robot 200 according to the relative positional relationship between the operator and the robot 200. For specific contents of the user interface for setting the control content of the robot 200, refer to Fig.10 The data for determining the control content of the robot 200 set by the support device 400 is transmitted to the control device 100 via the network controller 416 .

[0135] The input unit 408 includes a keyboard, a mouse, etc., and receives user operations. The display unit 410 includes a display, various indicators, a printer, etc., and outputs processing results from the processor 402, etc.

[0136] The network controller 416 exchanges data with any external device such as the control device 100 via the network.

[0137] The optical drive 417 receives a recording medium 414 (eg, an optical recording medium such as a digital versatile disc (DVD)) that stores a computer-readable program in a non-disposable manner. The program stored in the recording medium 414 is installed in the storage 406 or the like.

[0138] The support program 4062 etc. executed by the support device 400 may be installed via the computer-readable recording medium 414, or may be installed by downloading from a server device on the network etc. In addition, the functions provided by the support device 400 of this embodiment may also be implemented in the form of using a part of the modules provided by the OS 4060.

[0139] (b3: three-dimensional sensor 300)

[0140] Figure 5 300 of the present embodiment is a schematic diagram showing an example of the hardware configuration of the three-dimensional sensor 300 of the present embodiment. Although the description is omitted here, the three-dimensional sensor 300 of the present embodiment is functionally safe in the same manner as the control device 100. The three-dimensional sensor 300 of the present embodiment is a so-called passive stereo camera, which is configured to obtain position information of objects contained in the field of view of the camera in the three-dimensional space by photographing the same space from different positions using multiple (for example, two) cameras.

[0141] like Figure 5As shown, the three-dimensional sensor 300 includes a processor 302, a main memory 304, a storage 306, a camera interface 311, a camera interface 312, a camera 351, a camera 352, and an IO controller 316. These components are connected to each other via a processor bus 318 so as to be communicable with each other.

[0142] The processor 302 includes a CPU or a GPU, etc., and realizes various processes by reading a program (for example, a monitoring program 3062 ) stored in the storage 306 , expanding it in the main memory 304 , and executing it.

[0143] Figure 5 In the example, a structural example is shown in which the functions required as a three-dimensional sensor 300 are provided by executing a specified program by the processor 302, but part or all of these provided functions can also be implemented using a dedicated hardware circuit (such as ASIC or FPGA, etc.).

[0144] The main memory 304 includes, for example, a volatile storage device such as DRAM or SRAM.

[0145] The storage 306 includes, for example, a nonvolatile storage device such as a HDD or SSD, etc. The storage 306 stores a monitoring program 3062 for monitoring the operator and the robot 200 , and monitoring data 3064 referenced when the monitoring program 3062 is executed.

[0146] The camera interface 311 exchanges data between the processor 302 and the camera 351. The camera interface 312 exchanges data between the processor 302 and the camera 352.

[0147] The IO controller 316 exchanges data with the control device 100 via a predetermined network. In particular, in the present embodiment, the three-dimensional sensor 300 transmits position information of the operator and the robot 200, or a determination result of the area where the operator or the robot 200 is located based on the position information, to the control device 100 via the IO controller 316.

[0148] In the three-dimensional sensor 300 having such a structure, images of objects included in the field of view are acquired by the cameras 351 and 352. The cameras 351 and 352 are arranged so as to capture images of the objects from different viewpoints, and the distance to each point of the object is calculated based on the images captured from different viewpoints. In this way, the position information (X coordinate, Y coordinate, Z coordinate) of each point of the object (operator, robot 200, workpiece, etc.) included in the field of view in the three-dimensional space is acquired.

[0149] The three-dimensional sensor 300 of this embodiment determines the position of each point of the operator, robot 200 or workpiece based on the position information obtained by shooting with the cameras 351 and 352. For example, in the three-dimensional sensor 300, as an initial setting, the position information of each point in the three-dimensional space of only the background is set in a state where there is no operator, robot 200 and workpiece. The position information of only the background is included in the monitoring data 3064 stored in the storage 306. When the processor 302 obtains the position information of the operator, robot 200 or workpiece during operation, it calculates the difference between the obtained position information and the pre-prepared position information of only the background, and determines the position of each point of the operator, robot 200 or workpiece based on the calculation result. The determination result is sent to the control device 100.

[0150] In addition, the three-dimensional sensor 300 is not limited to determining the position of each point of the operator, robot 200, or workpiece based on the difference between the position information of the background only as described above, and other methods may be used. For example, the three-dimensional sensor 300 may also include feature quantities of each object such as the operator, robot 200, and workpiece in the monitoring data 3064, and the processor 302 extracts the feature quantity of the object based on the position information obtained by shooting with the cameras 351 and 352, compares the extracted feature quantity of the object with the feature quantity of the object included in the monitoring data 3064, and determines the position of each point of the operator, robot 200, or workpiece based on the comparison result.

[0151] Furthermore, the three-dimensional sensor 300 of this embodiment acquires the position information of the object in the three-dimensional space using a passive stereo camera including two cameras, but the position information of the object in the three-dimensional space may be acquired using other components.

[0152] For example, the three-dimensional sensor 300 may be a so-called active stereo camera including a set of a projector and a camera, and acquires position information of an object photographed by the camera based on a pattern projected from the projector.

[0153] Moreover, the three-dimensional sensor 300 can also use the so-called Time Of Flight (TOF) technology to obtain the position information of the object in the three-dimensional space. The TOF technology is to irradiate light to the object through a light output component such as a laser radar (Light Detection and Ranging (LIDAR), Laser Imaging Detection and Ranging (LIDAR)) and calculate the distance to each point of the object based on the time required for the reflected light from the object to return.

[0154] Furthermore, the three-dimensional sensor 300 may irradiate radio waves to an object through a radio wave output component such as a radar, and calculate the distance to each point of the object based on the time required for the radio waves from the object to return, thereby obtaining position information of the object in three-dimensional space.

[0155] <C. Various areas>

[0156] Next, various areas set by the support device 400 will be described. Figure 6 as well as Figure 7 1 is a schematic diagram showing an example of various areas that can be set in the control system 1 of this embodiment. In particular, Figure 6 In the figure, various areas of the work site in three-dimensional space are shown when viewed from above. Figure 7 In the figure, it is shown that the Figure 6 In addition, in the following description, the side where the robot 200 is located when viewed from the collaborative work area is referred to as the "robot side", and the side where the operator is located when viewed from the collaborative work area is referred to as the "operator side".

[0157] like Figure 6 as well as Figure 7 As shown, the virtual areas managed in the control system 1 of the present embodiment include an operation area, a cooperative operation area, an area A, and an area B.

[0158] The operating area is the area where the robot 200 operates, and a guardrail 250 is provided to surround the operating area for safety. When the robot 200 meets the safety standards, the size (e.g., area) of the operating area only needs to be preset. In addition, the size (e.g., area) of the operating area can also be pre-specified based on the size of the main body (main body) or the maximum length of the arm (arm) of the robot 200. It is pre-specified that only the robot 200 operates in the operating area, and once an operator invades the operating area, the robot 200 is stopped by the stop control of the control device 100. Moreover, when the robot 200 deviates from the preset maximum operating area, the robot 200 is stopped by the stop control of the control device 100.

[0159] As described above, the collaborative work area is an area where the operator and the robot 200 are allowed to work. The size (e.g., area) of the collaborative work area is determined by the user using the support device 400. The operator and the robot 200 can each invade the collaborative work area. That is, in the collaborative work area, the operator can also work, and the robot 200 can also work. For example, when the operator invades the collaborative work area and places the workpiece in the collaborative work area, and then the operator leaves the collaborative work area, this time a collaborative work will be performed in which the robot 200 invades the collaborative work area and moves the workpiece from the collaborative work area. In addition, the trigger for the robot 200 to invade the collaborative work area can be either a button operation performed by the operator after placing the workpiece in the collaborative work area, or it can be the three-dimensional sensor 300 detecting that the workpiece is placed in the collaborative work area and the operator has left the collaborative work area.

[0160] Area A is an area facing the collaborative work area and located on the operator side, and is set in a manner to surround the outside of the collaborative work area. The size (e.g., area) of area A is determined by the user using the support device 400. In addition, the size of area A can also be automatically determined depending on predetermined factors such as the size of the collaborative work area, the operating speed of the robot, and the time required for the robot to stop after receiving a stop command. Area A is predefined as only an operator can operate. Once a robot 200 invades area A, the robot 200 stops by the stop control of the control device 100.

[0161] Area B is an area located further on the operator side than area A, and is set to surround the outside of area A. The size (e.g., area) of area B is determined by the user using the support device 400. In addition, the size of area B may also be automatically determined depending on predetermined factors such as the size of the cooperative operation area, the operating speed of the robot, and the time required for the robot to stop after receiving a stop command. Area B is predetermined to be operated only by the operator, and once the robot 200 enters area B, the robot 200 stops by the stop control of the control device 100.

[0162] In each area set up in this way, a virtual boundary surface or boundary line (hereinafter also referred to as a "virtual boundary") is provided between the operation area and the cooperative operation area, and between the cooperative operation area and area A. Specifically, the virtual boundary between the operation area and the cooperative operation area is referred to as a virtual boundary A, and the virtual boundary between the cooperative operation area and area A is referred to as a virtual boundary B. In this embodiment, the virtual boundary is a boundary surface (or boundary line) for ensuring the safety of the operator, and when the robot 200 or the operator crosses the virtual boundary, the robot 200 is stopped by the stop control of the control device 100.

[0163] The virtual boundary is switched according to whether the position of the robot 200 is included in the collaborative work area. Specifically, when the robot 200 is not in the collaborative work area but in the operating area, the virtual boundary A between the operating area and the collaborative work area is used as the virtual boundary, and when the robot 200 is in the collaborative work area, the virtual boundary B between the collaborative work area and area A is used as the virtual boundary.

[0164] <D. Robot control table>

[0165] Next, refer to Figure 8 , while explaining the robot control table 1064 stored in the memory 106 of the control device 100. Figure 8 1 is a schematic diagram showing an example of the robot control table 1064 used in the control system 1 of the present embodiment.

[0166] like Figure 8 As shown, in the robot control table 1064 , instruction information is stored, and the instruction information is used to control the stop or speed of the robot 200 according to whether the position of the operator or the robot 200 is included in the cooperative operation area and the relative position relationship between the operator and the robot 200 .

[0167] Specifically, when the operator crosses the virtual boundary and is located in the area on the robot side, or when the robot 200 crosses the virtual boundary and is located in the area on the operator side, since both are located in the same area and are close to each other, the control of the robot 200 is set so that the robot 200 stops through the stop control of the control device 100.

[0168] When the operator is in the cooperative work area and the robot 200 is in the operation area, since the two are located in different areas but adjacent areas, the robot 200 is controlled so that the robot 200 runs at a low speed (e.g., 250 mm / sec) through the low speed control of the control device 100. In this way, the productivity can be minimized and safety can be ensured.

[0169] When the worker is in the cooperative work area and the robot 200 is in the cooperative work area, since both are in the same area and close to each other, the robot 200 is controlled so that the robot 200 stops by the stop control of the control device 100 .

[0170] When the operator is in area A and the robot 200 is in the operating area, since the two are located in different but close areas, the robot 200 is controlled so that the robot 200 operates at a low speed (e.g., 250 mm / sec) through the low speed control of the control device 100. In this way, productivity can be minimized and safety can be ensured.

[0171] When the operator is in area A and the robot 200 is in the collaborative work area, since the two are located in different but adjacent areas and the robot 200 is working in the collaborative work area, the control of the robot 200 is set so that the robot 200 stops through the stop control of the control device 100.

[0172] When the operator is in area B and the robot 200 is in the operating area, since the two are in different and distant areas, the robot 200 is controlled so that the robot 200 operates at a medium speed (e.g., 750 mm / sec) by the medium speed control of the control device 100. Thus, productivity is not reduced.

[0173] When the operator is in area B and the robot 200 is in the cooperative work area, since the two are in different areas, the robot 200 is controlled so that the robot 200 runs at a low speed (e.g., 250 mm / sec) through the low speed control of the control device 100. This can minimize the reduction in productivity and ensure safety.

[0174] When the operator is located in another area (e.g., an area further to the operator's side than area B) and the robot 200 is located in the operating area, since the two are located in different areas and are greatly separated from each other, the control of the robot 200 is set so that the robot 200 operates at a high speed (e.g., 1500 mm / sec) through the high-speed control of the control device 100. This can improve productivity.

[0175] When the operator is located in another area (e.g., an area further to the operator's side than area B) and the robot 200 is located in the cooperative work area, since the two are located in different areas and far away from each other, the control of the robot 200 is set so that the robot 200 runs at a medium speed (e.g., 750 mm / sec) through the medium speed control of the control device 100. Thus, productivity is not reduced.

[0176] In this way, instruction information is saved in the robot control table 1064, and the instruction information is used to control the stop or speed of the robot 200 in the following manner, that is, the farther the operator is from the robot 200, the faster the robot 200 is controlled to run, and the closer the operator is to the robot 200, the slower the robot 200 runs or stops.

[0177] <E. User interface for region settings>

[0178] Next, refer to Fig. 9 , while explaining the user interface 411 for setting the collaborative work area provided by the support device 400. Fig. 9 It is a schematic diagram showing an example of area setting in the support device 400 according to the present embodiment.

[0179] like Fig. 9 As shown, in the area setting user interface 411 provided by the support device 400, screens for setting the operation area, the cooperative work area, the area A, and the area B are prepared in advance. Fig. 9 The screen shown may directly use the images captured by the cameras 351 and 352 of the three-dimensional sensor 300. That is, the images corresponding to the field of view of the cameras 351 and 352 may be directly used. Alternatively, Fig. 9 The image shown may also be produced based on the position information of the object acquired by the three-dimensional sensor 300. For example, when the three-dimensional sensor 300 acquires the position information of the object in the three-dimensional space using the TOF technology, the image may be produced using a dot matrix that visually materializes the set of acquired position information. Fig. 9 The screen shown.

[0180] The user can move the pointer 411 a on the screen using a mouse (not shown) or the like, and can enlarge or reduce each area by placing the pointer 411 a at an end of each area.

[0181] For example, Fig. 9 In the example shown, if the pointer 411a is aligned with the upper right end of the collaborative work area and the user drags (drags) the pointer 411a toward the upper right of the screen, the size (area) of the collaborative work area will be enlarged corresponding to the movement of the pointer 411a. If the user drags the pointer 411a toward the lower left of the screen, the size (area) of the collaborative work area will be reduced corresponding to the movement of the pointer 411a.

[0182] in addition, Fig. 9 In the illustrated example, the expansion and reduction of the cooperative work area is described, but the user can also expand or reduce the size (area) of the operation area, area A, and area B in accordance with the movement amount of the pointer 411 a.

[0183] Moreover, in this embodiment, area A and area B are prepared in advance, but it is also possible to delete area A or area B through user operation, or add other areas different from area A and area B (for example, area C located outside area B on the operator side).

[0184] In this way, the support device 400 provides the user interface 411 for setting various areas including the cooperative work area as areas where the worker and the robot 200 perform work respectively.

[0185] Furthermore, the support device 400 provides a user interface 411 for virtually setting a collaborative work area based on an image corresponding to the field of view of the three-dimensional sensor 300 .

[0186] in addition, Fig. 9 The illustrated user interface 411 for region setting is an example, and the support device 400 may provide a user interface for region setting in other forms.

[0187] <F. Stop / Speed ​​Setting User Interface>

[0188] Next, refer to Fig.10 , while explaining the user interface 412 provided by the support device 400, the user interface 412 is used to set the control content of the robot 200 according to the relative positional relationship between the operator and the robot 200. Fig.10 It is a schematic diagram showing an example of stop / speed setting in the support device 400 according to the present embodiment.

[0189] like Fig.10As shown, in the stop / speed setting user interface 412 provided by the support device 400, a screen for setting whether to stop the robot 200 or the speed when operating is prepared in advance according to the current position of the operator and the current position of the robot 200. The user can move a pointer 412a on the screen using a mouse (not shown) or the like, and by aligning the pointer 412a with a frame of a matrix defined by a combination of the current position of the operator and the current position of the robot 200, a drop-down list showing options of control contents prepared in advance can be displayed.

[0190] That is, in this embodiment, when the user uses Fig. 9 When the user interface 411 shown in FIG. 1 is used to set each area including the cooperative work area, the selection options are automatically calculated based on the size (area) or number of each area, and the specifications of the robot 200 (e.g., the length or operating angle of each part such as the arm, the maximum operating speed, and the time required for the robot to stop after receiving a stop command). Furthermore, the calculation of such selection options is based on the viewpoint of risk assessment, and no matter which option is selected by the user, the robot 200 will be controlled to ensure the safety of the operator.

[0191] In addition, the options are not limited to being automatically calculated as described above, and all options prepared in advance by the user may be displayed, and the options prepared in advance by the user may be displayed in a frame of each matrix specified by the combination of the current position of the operator and the current position of the robot 200.

[0192] The user can select desired control content of the robot 200 by designating one option using the pointer 412 a from among the options shown in the drop-down list.

[0193] For example, Fig.10 In the example shown, a drop-down list is displayed when the operator is in the cooperative work area and the robot 200 is in the operating area, and the user selects "Slow Speed" from "Stop", "Ultra-Low Speed" and "Low Speed". Figure 8 As shown, in the robot control table 1064 , when the worker is in the cooperative work area and the robot 200 is in the operating area, the control of the robot 200 is set so that the robot 200 operates at a low speed by the low speed control of the control device 100 .

[0194] In this way, the support device 400 provides the user interface 412 for setting the control content of the robot 200 according to the relative positional relationship between the operator and the robot 200. That is, the support device 400 includes the "control content setting means" of the present disclosure.

[0195] in addition, Fig.10 The stop / speed setting user interface 412 shown is an example, and the support device 400 may provide a stop / speed setting user interface in other forms.

[0196] <G. User interface for workpiece non-detection setting>

[0197] Next, refer to Fig.11 , while explaining the user interface 413 for workpiece non-detection setting provided by the support device 400. Fig.11 1 is a schematic diagram showing an example of workpiece non-detection setting in the support device 400 according to the present embodiment.

[0198] like Fig.11 As shown, in the user interface 413 for setting the workpiece non-detection provided by the support device 400, a screen for setting the detection of the workpiece by the three-dimensional sensor 300 to be invalid is prepared. When the workpiece is no longer detected by the three-dimensional sensor 300, the control device 100 controls the stop or speed of the robot 200 without considering the position information of the workpiece, so the stop or speed of the robot 200 will not be erroneously controlled due to the detection of the position of the workpiece. In addition, even if the workpiece is not set to non-detection, the shape of the workpiece can be taught to the control device 100 in advance, thereby avoiding the stop or speed of the robot 200 being controlled due to the detection of the position of the workpiece.

[0199] Fig.11 In the example shown, first, the user aligns the frame image 415 so as to surround the workpiece, thereby causing the three-dimensional sensor 300 to read the shape of the workpiece. Next, the user selects "Yes" or "No" to decide whether to set the read workpiece as non-detection. If the user selects "Yes", the workpiece is set as non-detection.

[0200] In this way, the support device 400 provides a user interface 413 for prohibiting the control device 100 from controlling the stop or speed of the robot 200 based on the position of the workpiece related to the operation. In addition, the control device 100 prohibits the stop or speed control of the robot 200 caused by the workpiece set as non-detection by the support device 400. That is, the control device 100 includes the "prohibition means" of the present disclosure.

[0201] in addition, Fig.11 The user interface 413 for the workpiece non-detection setting shown is an example, and the support device 400 may provide a user interface for the workpiece non-detection setting in other forms.

[0202] <H. Example of safety control processing>

[0203] Next, refer to Fig.12 as well as Fig.13, while explaining the safety control performed in the control system 1 of this embodiment. Fig.12 as well as Fig.13 : is a schematic diagram showing an example of a safety control process executed in the control system 1 of the present embodiment. Fig.12 as well as Fig.13 The example of the safety control process shown is that the control device 100 refers to Figure 8 The robot control table 1064 shown is performed while executing the safety program 1062.

[0204] like Fig.12 As shown, when the worker holding the workpiece is located in another area (for example, an area closer to the worker than area B) and the robot 200 is located in the operation area, the robot 200 operates at high speed due to high-speed control by the control device 100 .

[0205] Then, when the worker moves and intrudes into the area B, since the worker is in the area B and the robot 200 is in the operating area, the robot 200 operates at the medium speed due to the medium speed control of the control device 100 .

[0206] Then, if Fig.13 As shown, when the operator places the workpiece on the workbench and the operator's hand intrudes into the area A, the robot 200 operates at a low speed due to the low speed control of the control device 100 because the operator is located in the area A and the robot 200 is located in the operation area.

[0207] Subsequently, after the operator places the workpiece in the collaborative work area, when the robot 200 invades the collaborative work area to transport the workpiece from the collaborative work area, if the operator mistakenly invades the collaborative work area, since the operator is located in the collaborative work area and the robot 200 is located in the collaborative work area, the robot 200 stops through the stop control of the control device 100.

[0208] As described above, according to the control system 1 of this embodiment, the farther the operator is from the robot 200 , the higher the speed of the robot 200 is controlled to operate, and the closer the operator is to the robot 200 , the lower the speed of the robot 200 is controlled to operate or stop.

[0209] <I. Flow of security control processing>

[0210] Next, refer to Fig.14 , while explaining the flow of the safety control process executed by the control system 1 of this embodiment. Fig.14 : is a flowchart of the safety control process executed by the control system 1 of this embodiment. Fig.14 The safety control process shown is performed by the processor 102 of the control device 100 while referring to Figure 8The robot control table 1064 shown is performed while executing the safety program 1062.

[0211] First, the control device 100 obtains the position information of the operator and the robot 200 from the three-dimensional sensor 300 (S1). Next, the control device 100 determines whether the operator has crossed the virtual boundary and is located in the area on the robot side (S2). If the operator has crossed the virtual boundary and is located in the area on the robot side (Yes in S2), the control device 100 stops the robot 200 by stopping control (S3), and returns to the process of S1.

[0212] On the other hand, if the operator does not cross the virtual boundary and is located in the area on the robot side (No in S2), the control device 100 determines whether the operator is located in the cooperative work area or area A (S4). If the operator is located in the cooperative work area or area A (Yes in S4), the control device 100 determines whether the robot 200 is located in the operating area (S5).

[0213] If the robot 200 is not located in the operating area (No in S5), the control device 100 stops the robot 200 by stop control (S3), and returns to the process of S1. On the other hand, if the robot 200 is located in the operating area (Yes in S5), the control device 100 operates the robot 200 at a low speed by low speed control (S6), and returns to the process of S1.

[0214] If the operator is not in the cooperative work area or area A in S4 (No in S4), the control device 100 determines whether the operator is in area B (S7). If the operator is in area B (Yes in S7), the control device 100 determines whether the robot 200 is in the operating area (S8).

[0215] If the robot 200 is not located in the operation area (No in S8), the control device 100 determines whether the robot 200 is located in the cooperative operation area (S9). If the robot 200 is not located in the cooperative operation area (No in S9), the control device 100 stops the robot 200 by stop control (S3), and returns to the process of S1. On the other hand, if the robot 200 is located in the cooperative operation area (Yes in S9), the control device 100 causes the robot 200 to operate at a low speed by low speed control (S6), and returns to the process of S1.

[0216] If the robot 200 is located in the operation area in S8 (Yes in S8 ), the control device 100 operates the robot 200 at the medium speed through the medium speed control ( S11 ), and the process returns to S1 .

[0217] If the operator is not in area B in S7 (No in S7), the control device 100 determines whether the robot 200 is in the operating area (S12). If the robot 200 is not in the operating area (No in S12), the control device 100 determines whether the robot 200 is in the cooperative operation area (S13). If the robot 200 is not in the cooperative operation area (No in S13), the control device 100 stops the robot 200 by stop control (S3), and returns to the processing of S1. On the other hand, if the robot 200 is in the cooperative operation area (Yes in S13), the control device 100 causes the robot 200 to run at a medium speed by medium speed control (S14), and returns to the processing of S1.

[0218] If the robot 200 is located in the operation area in S12 (YES in S12 ), the control device 100 operates the robot 200 at a high speed by high-speed control ( S15 ), and the process returns to S1 .

[0219] Thus, according to the control method (safety control processing) of the control system 1 of the present embodiment, the user can virtually set a cooperative operation area that allows the operation of the operator and the robot 200, and can control the stop or speed of the robot 200 based on whether the positions of the operator and the robot 200 in the three-dimensional space are included in the virtually set cooperative operation area and the relative positional relationship between the operator and the robot 200 in the three-dimensional space. Thus, the user can improve safety and productivity at the same time at the production site where the robot 200 and the operator cooperate.

[0220] <J. Modification>

[0221] The present disclosure is not limited to the embodiments described above, and various modifications and applications can be further performed. The following describes the modified examples applicable to the present disclosure. In addition, the control system of the modified examples shown below has the same structure or function as the control system 1 of the present embodiment except for the parts that are different from the control system 1 of the present embodiment.

[0222] One side reference Fig.15 as well as Fig.16 , while explaining the control system 1a of the modified example. Fig.15 as well as Fig.16 1 is a schematic diagram showing a control system 1 a according to a modified example.

[0223] like Fig.15 as well as Fig.16 As shown, the control system 1a of the modified example may also include a projector 600. The projector 600 includes the "reality means" of the present disclosure, and realizes the virtual boundary in the work space of the operator and the robot 200 so that it can be visually seen.

[0224] For example, Fig.15 As shown in FIG. 1 , when the robot 200 is not located in the cooperative work area but in the operating area, the image representing the virtual boundary A and the cooperative work area is projected onto the workbench by the projector 600. Fig.16 As shown, when the robot 200 is located in the cooperative work area, an image representing the virtual boundary B and the cooperative work area is projected onto the work table by the projector 600 .

[0225] As described above, in the control system 1 a of the modified example, the user can perform work while checking the virtual boundary that is visually realized in the work space by the projector 600 , and thus safety and productivity can be further improved at the same time.

[0226] Moreover, if Fig.15 as well as Fig.16 As shown, the control system 1a of the modified example may also include a control unit 900, wherein the control unit 900 is a combination of a setting support tool 500 having the function of supporting the device 400 and a control unit 100a having the function of controlling the device 100. That is, the user may also use the user interface ( Figures 9 to 11 The control unit 100a can also output control instructions to the robot 200 based on the setting contents set by the setting support tool and the position information of the operator and the robot 200 acquired by the three-dimensional sensor 300, and the control instructions are used to specify the speed of the robot 200 when driving, stopping, and running.

[0227] In this way, according to the control unit 900 of the modified example, the user can virtually set a cooperative work area that allows the work of the operator and the robot 200, and can control the stop or speed of the robot 200 based on whether the positions of the operator and the robot 200 in the three-dimensional space are included in the virtually set cooperative work area and the relative positional relationship between the operator and the robot 200 in the three-dimensional space. As a result, the user can improve safety and productivity at the same time at the production site where the robot 200 and the operator cooperate.

[0228] Moreover, in the control system 1 of the present embodiment and the control system 1a of the modified example, a virtual boundary is provided, but a virtual boundary may not necessarily be provided. Specifically, the control system may also be configured to monitor whether the object intruding the collaborative work area is intruding the collaborative work area from the operator side or from the robot side. If the object intrudes the collaborative work area from the operator side, the control device only needs to determine that the operator has intruded the collaborative work area, and if the object intrudes the collaborative work area from the robot side, the control device only needs to determine that the robot 200 has intruded the collaborative work area. Furthermore, the control device only needs to control the stop or speed of the robot 200 based on whether the object intrudes the collaborative work area from the operator side or from the robot side.

[0229] In this way, the user can appropriately control the stopping or speed of the robot 200 based on whether an object including an operator or the robot 200 invades the collaborative work area, or from which direction the object invades the collaborative work area from the operator side and the robot side. Therefore, there is no need to set a virtual boundary, which can improve safety and productivity at the same time.

[0230] Furthermore, in the control system 1 of the present embodiment and the control system 1a of the modified example, when the robot 200 and the operator are both in the collaborative work area, the robot 200 is stopped by the stop control of the control device 100, but the present invention is not limited to this. For example, when the robot 200 is controlled to run at a low speed that does not cause danger to the operator, or when the robot 200 is configured to be covered with a buffer material so that the operator will not be injured even if it comes into contact with the operator, the operator and the robot 200 can work in the collaborative work area at the same time. In this case, the robot 200 can be stopped by the control device 100. Fig.10 The user interface 412 shown is used to set the control content of the robot 200. The user can select the control content of the robot 200 from options such as "stop", "ultra-low speed", and "slow speed" in the box of the matrix when the operator is located in the collaborative work area and the robot 200 is located in the collaborative work area.

[0231] <K. Notes>

[0232] As described above, the present embodiment includes the following disclosure.

[0233] (Structure 1)

[0234] A control system 1 is used to control a robot 200, and the control system includes:

[0235] A control component 100 controls the robot;

[0236] A three-dimensional sensor component 300 acquires position information of the operator and the robot within a field of view of the three-dimensional space; and

[0237] The setting support component 400 provides a user interface 411 for virtually setting a collaborative work area that allows the operator and the robot to work.

[0238] The control component controls the stop or speed of the robot according to whether the position of the operator or the robot calculated based on the position information is included in the collaborative work area set using the user interface, and the relative position relationship between the operator and the robot calculated based on the position information.

[0239] (Structure 2)

[0240] The control system according to structure 1, wherein

[0241] The control unit controls the stop or speed of the robot based on whether the worker or the robot crosses virtual boundaries A and B virtually set at the ends of the cooperative work area.

[0242] (Structure 3)

[0243] The control system according to structure 2, wherein

[0244] The virtual boundary is switched according to whether the position of the robot is included in the cooperative work area.

[0245] (Structure 4)

[0246] The control system according to Structure 2 or Structure 3 comprises:

[0247] The realization component 600 can realize the virtual boundary visually in the work space.

[0248] (Structure 5)

[0249] The control system according to structure 1, wherein

[0250] The control unit controls the stop or speed of the robot based on whether an object including the operator or the robot intrudes into the cooperative work area from the operator side or whether an object intrudes into the cooperative work area from the robot side.

[0251] (Structure 6)

[0252] A control system according to any one of Structures 1 to 5, wherein

[0253] The setting support unit provides a user interface 411 for setting a plurality of areas including the cooperative working area as areas where the worker and the robot perform work respectively.

[0254] (Structure 7)

[0255] A control system according to any one of Structures 1 to 6, comprising:

[0256] The control content setting component 400 provides a user interface 412 for setting the control content of the robot according to the relative position relationship between the operator and the robot.

[0257] (Structure 8)

[0258] A control system according to any one of Structures 1 to 7, wherein

[0259] The setting support unit provides a user interface 411 for virtually setting the cooperative work area based on an image corresponding to the field of view of the three-dimensional sensor unit.

[0260] (Structure 9)

[0261] A control system according to any one of Structures 1 to 8, comprising:

[0262] The prohibition component 100 prohibits the control component from controlling the stop or speed of the robot based on the position of the workpiece related to the operation.

[0263] (Structure 10)

[0264] A control method for controlling a robot 200, wherein

[0265] The user interface 411 virtually sets a collaborative work area that allows the operator and the robot to work.

[0266] The control method comprises:

[0267] Steps S2 to S15, controlling the robot; and

[0268] Step S1, obtaining the position information of the operator and the robot within the field of view of the three-dimensional space,

[0269] The steps for controlling the robot include steps S2 to S15: controlling the stop or speed of the robot according to whether the position of the operator or the robot calculated based on the position information is included in the collaborative work area, and the relative position relationship between the operator and the robot calculated based on the position information.

[0270] (Structure 11)

[0271] A control unit 900 controls the robot 200, and the control unit 900 includes:

[0272] A control unit 100a controls the robot; and

[0273] The setting support tool 500 provides a user interface 411 for virtually setting a collaborative work area that allows the operator and the robot to work.

[0274] The control unit controls the stop or speed of the robot according to whether the position of the operator or the robot calculated based on the position information obtained by the three-dimensional sensor is included in the collaborative work area set using the user interface, and the relative position relationship between the operator and the robot.

[0275] <L. Advantages>

[0276] According to the control system 1 of this embodiment, the user can virtually set a cooperative operation area that allows the operation of the operator and the robot 200, and can control the stop or speed of the robot 200 based on whether the positions of the operator and the robot 200 in the three-dimensional space are included in the virtually set cooperative operation area and the relative position relationship between the operator and the robot in the three-dimensional space. As a result, the user can improve safety and productivity at the same time at the production site where the robot 200 and the operator cooperate.

[0277] The embodiments disclosed this time should be considered as illustrative in all aspects and not restrictive. The scope of the present invention is indicated by the claims rather than the above description, and is intended to include all modifications within the meaning and scope equivalent to the claims.

Claims

1. A control system for controlling a robot, the control system comprising: A control component for controlling the robot; A three-dimensional sensor component for acquiring position information of the operator and the robot within a field of view of the three-dimensional space; a setting support component that provides a user interface for virtually setting a collaborative work area that allows the operator and the robot to work; as well as a control content setting component, providing a user interface, wherein the user interface is used to set the control content of the robot corresponding to the relative position relationship between the operator and the robot, The control unit controls the stop or speed of the robot according to whether the position of the operator or the robot calculated based on the position information is included in the cooperative working area, and the relative position relationship between the operator and the robot calculated based on the position information and the control content, The control unit controls the stop or speed of the robot based on whether the worker or the robot crosses a virtual boundary virtually set at an end of the cooperative work area. The virtual boundary is switched according to whether the position of the robot is included in the cooperative work area.

2. The control system according to claim 1, comprising: The realization component can realize the virtual boundary visually in the work space.

3. The control system according to claim 1, wherein The control unit controls the stop or speed of the robot based on whether an object including the operator or the robot intrudes into the cooperative work area from the operator side or whether an object intrudes into the cooperative work area from the robot side.

4. The control system according to claim 1, wherein The setting support unit provides a user interface for setting a plurality of areas including the cooperative working area as areas where the worker and the robot perform work respectively.

5. The control system according to claim 1, wherein The setting support unit provides a user interface for virtually setting the cooperative work area based on an image corresponding to a field of view of the three-dimensional sensor unit.

6. The control system according to claim 1, comprising: The prohibition means prohibits the control means from controlling the stop or speed of the robot based on the position of the workpiece related to the operation.

7. A control method for controlling a robot, wherein The control method comprises the following steps: controlling the robot; Acquire position information of the operator and the robot within the field of view of the three-dimensional space; providing a user interface for virtually setting a collaborative work area in which the work of the operator and the robot is permitted; and providing a user interface for setting control contents of the robot corresponding to the relative position relationship between the operator and the robot, The step of controlling the robot comprises the following steps: Controlling the stop or speed of the robot according to whether the position of the operator or the robot calculated based on the position information is included in the cooperative work area, and the relative position relationship between the operator and the robot calculated based on the position information and the control content; and controlling the stop or speed of the robot based on whether the worker or the robot crosses a virtual boundary virtually set at an end of the collaborative work area, The virtual boundary is switched according to whether the position of the robot is included in the cooperative work area.

8. A control unit for controlling a robot, the control unit comprising: A control unit, for controlling the robot; as well as Set up support tools to: providing a user interface for virtually setting a collaborative work area that allows work by an operator and the robot; as well as providing a user interface for setting control contents of the robot corresponding to the relative position relationship between the operator and the robot, The control unit controls the stop or speed of the robot according to whether the position of the operator or the robot calculated based on the position information obtained by the three-dimensional sensor is included in the cooperative work area set using the user interface, the relative position relationship between the operator and the robot, and the control content, The control unit controls the stop or speed of the robot based on whether the worker or the robot crosses a virtual boundary virtually set at an end of the cooperative work area. The virtual boundary is switched according to whether the position of the robot is included in the cooperative work area.

Citation Information

Patent Citations

  • Method and device for controlling safety-related function of machine

    JP2003222295A

  • Safety management system for worker

    CN101142063A

  • Method for operating a safety apparatus for a handling device, safety apparatus for a handling device, and handling device

    CN103249530A

  • Establishing and interference early warning method for auxiliary assembly safety working space of spacecraft mechanical arm

    CN104626208A

  • Monitoring System, Monitoring Device, And Monitoring Method

    CN108008663A