Operating system, processing system, switching device, operating method, program, and storage medium

Abstract

To provide an operating system, a processing system, a switching device, an operating method, a program, and a storage medium that can more appropriately operate a device to be operated.SOLUTION: A processing system according to an embodiment comprises an arithmetic unit, a receiving unit, a generating unit, a first switching unit, and a second switching unit. The arithmetic unit acquires output from a first device to be operated, and generates a first operating instruction for operating the first device according to the output. The receiving unit receives a second operating instruction for operating the first device input via a network. The generating unit generates a first operating signal corresponding to the first device on the basis of one of the first operating instruction and the second operating instruction. The first switching unit inputs one of the first operating instruction and the second operating instruction to the generating unit. The second switching unit inputs, to the first device, one of the first operating signal and a second operating signal input from an input device to the first device for operating the first device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] An embodiment of the present invention relates to an operation system, a processing system, a switching device, an operation method, a program, and a storage medium. [Background technology]

[0002] There are systems that automatically operate devices. There is a demand for technology that enables these systems to operate the devices more appropriately. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-014215 Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide an operation system, a processing system, a switching device, an operation method, a program, and a storage medium that are capable of more appropriately operating a device to be operated. [Means for solving the problem]

[0005] The processing system according to the embodiment includes a calculation unit, a receiving unit, a generating unit, a first switching unit, and a second switching unit. The calculation unit acquires an output from a first device to be operated, and generates a first operation command for operating the first device according to the output. The receiving unit receives a second operation command for operating the first device input via a network. The generating unit generates a first operation signal corresponding to the first device based on one of the first operation command and the second operation command. The first switching unit inputs one of the first operation command and the second operation command to the generating unit. The second switching unit inputs one of the first operation signal and the second operation signal input from an input device to the first device to operate the first device, to the first device. [Brief description of the drawings]

[0006] [Figure 1] FIG. 1 is a schematic diagram showing an operation system according to an embodiment. [Diagram 2] FIG. 2 is a flowchart showing the processing performed by the processing system according to the embodiment. [Diagram 3] FIG. 3 is an example of a table in which error codes are registered. [Figure 4] 4(a) and 4(b) are schematic diagrams illustrating examples of screens of display devices. [Diagram 5] 5(a) and 5(b) are schematic diagrams illustrating examples of screens of display devices. [Figure 6] Fig. 6(a) is a schematic diagram illustrating a portion of a first file, Fig. 6(b) is a schematic diagram illustrating a portion of a second file, and Fig. 6(c) is a schematic diagram illustrating a portion of a setting file. [Figure 7] 7(a) and 7(b) are schematic diagrams illustrating examples of screens of display devices. [Figure 8] FIG. 8 is a schematic diagram showing a hardware configuration. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this specification and the drawings, elements similar to those already described are designated by the same reference numerals, and detailed description thereof will be omitted as appropriate.

[0008] FIG. 1 is a schematic diagram showing an operation system according to an embodiment. 1, the processing system 1 includes an operation system 10, a processing device 21 (first device), and a terminal device 30. The operation system 10 includes an acquisition unit 11, a calculation unit 12, a generation unit 13, a reception unit 14, a switching control unit 15, a first switching unit 15a, a second switching unit 15b, a storage device 19a, an input device 19b, and a display device 19c. The operation system 10 is used to automatically operate the processing device 21.

[0009] The processing device 21 executes any process. For example, the processing device 21 is a production device that processes a workpiece. The process includes transportation, processing, cleaning, heating, cooling, drying, etc. The process includes film formation, etching, polishing, lithography, bonding, etc. The processing device 21 executes at least one selected from transportation, processing, cleaning, heating, cooling, and drying.

[0010] The processing device 21 includes a control unit 21a. Each component of the processing device 21 operates based on an instruction sent from the control unit 21a to process a work. The control unit 21a includes, for example, a central processing unit (CPU), a read-only memory (ROM), a random access memory (RAM), a storage device, an input interface, an output interface, a communication interface, and a bus connecting these. The control unit 21a may be a dedicated computer for the processing device 21, or may be a general-purpose computer. The function of the control unit 21a may be realized by cooperation of multiple computers.

[0011] The input device 22 is used by a user to input data to the processing device 21. The user is, for example, an operator in charge of the processing executed by the processing device 21. The input device 22 is provided at a location where the processing device 21 is installed. The input device 22 transmits an operation signal to the processing device 21 by wired communication or wireless communication without going through a network. The input device 22 may be provided integrally with the processing device 21. The input device 22 includes, for example, at least one selected from a keyboard, a mouse, a touchpad, and a microphone (voice input).

[0012] The display device 23 displays the video signal output from the processing device 21 so that the user can visually confirm the video signal. The display device 23 includes a monitor.

[0013] The acquisition unit 11 acquires an output from the processing device 21 to the display device 23 and transmits the output to the display device 23. The acquisition unit 11 includes, for example, a distributor and a capture unit for a video signal. The acquisition unit 11 transmits the acquired video signal to the calculation unit 12.

[0014] The calculation unit 12 recognizes the result obtained by the acquisition unit 11. For example, the calculation unit 12 recognizes an image included in a video signal. In the image recognition, processes such as pattern matching, character recognition, and color matching are executed.

[0015] The calculation unit 12 also refers to an operation file created in advance. The operation file includes a first file and a second file. The first file describes a generation operation for generating an operation command. For example, the first file is a program file describing an operation sequence for generating an operation command and transmitting the operation command to the generation unit 13. The second file is referred to when the generation operation is executed. The second file includes information used in identifying an output signal and generating an operation signal, which will be described later. For example, the second file includes information on coordinates selected by the input device 22, data referenced during image recognition, and the like.

[0016] The calculation unit 12 executes an operation of generating the first file while referring to the information included in the second file based on the acquisition result by the acquisition unit 11. This generates a first operation command for operating the processing device 21. The calculation unit 12 transmits the first operation command to the generation unit 13.

[0017] Furthermore, the calculation unit 12 accepts an operation (input operation) input by a user using the input device 19b. The calculation unit 12 causes the display device 19c to display a screen based on the received video signal.

[0018] The calculation unit 12 includes, for example, a CPU, a ROM, a RAM, a storage device, an input interface, an output interface, a communication interface, and a bus connecting these. The calculation unit 12 is a dedicated or general-purpose computer. The functions of the calculation unit 12 may be realized by cooperation of multiple computers.

[0019] The terminal device 30 is a terminal for remotely operating the processing device 21. The terminal device 30 transmits a second operation command for operating the processing device 21. The receiving unit 14 receives the second operation command via the network. The receiving unit 14 transmits the second operation command to the generating unit 13.

[0020] The first switching unit 15a inputs one of the first operation command and the second operation command transmitted to the generation unit 13 to the generation unit 13. The first switching unit 15a does not input the other of the first operation command and the second operation command to the generation unit 13.

[0021] The generating unit 13 receives one of the first operation command and the second operation command. The generating unit 13 generates a first operation signal corresponding to the processing device 21 based on the received operation command. The generating unit 13 transmits the first operation signal toward the processing device 21 (control unit 21a) that is the operation target. In addition, when the input device 22 is operated by the user, the input device 22 transmits a second operation signal toward the processing device 21.

[0022] When the input device 22 is operated by the user, the input device 22 transmits a second operation signal to the processing device 21. When the input device 22 includes a mouse or a keyboard, the operation signal corresponds to a signal transmitted from the mouse or the keyboard. When the processing device 21 receives the operation signal, it executes the movement of a pointer, the input of characters, and the like in accordance with the operation signal. For example, the generation unit 13 includes a microcomputer programmed to generate an operation signal corresponding to the signal transmitted from the input device 22.

[0023] The second switching unit 15b inputs one of the first operation signal transmitted from the generation unit 13 to the processing device 21 and the second operation signal transmitted from the input device 22 to the processing device 21 to the processing device 21. The second switching unit 15b prevents the other of the first operation signal and the second operation signal from being input to the processing device 21.

[0024] The switching control unit 15 communicates with the calculation unit 12 and the receiving unit 14. When the calculation unit 12 generates a first operation command, the switching control unit 15 controls the first switching unit 15a so that the first operation command is transmitted to the generating unit 13. When the receiving unit 14 receives a second operation command, the switching control unit 15 controls the first switching unit 15a so that the second operation command is transmitted to the generating unit 13.

[0025] When the receiving unit 14 receives the second operation command, the switching control unit 15 controls the first switching unit 15a so that the second operation command is transmitted to the generating unit 13 regardless of whether the first operation command has been generated. That is, the switching control unit 15 controls the first switching unit 15a so that the second operation command is transmitted to the generating unit 13 with priority over the first operation command.

[0026] The switching control unit 15 also communicates with the generation unit 13 and the detector 16. The detector 16 is provided to directly or indirectly detect the presence or absence of a user using the input device 22. As an example, the input device 22 includes a keyboard and a mouse, and the detector 16 is a weight sensor installed near the keyboard and the mouse. When a user uses the input device 22, the user stands on the weight sensor. The weight sensor detects the user from a change in weight. Detection by the weight sensor indicates the presence of a user using the input device 22. Instead of a weight sensor, the detector 16 may include an infrared sensor, a light curtain, a camera, or the like. The infrared sensor, the light curtain, the camera, and the like can also be used to detect a user using the input device 22.

[0027] Alternatively, the switching control unit 15 may receive a second operation signal output from the input device 22. Receipt of the second operation signal indicates that the user is using the input device 22. In this case, the detector 16 can be omitted. The switching control unit 15 controls the second switching unit 15b in response to the reception of the second operation signal.

[0028] When the generation unit 13 generates a first operation signal, the switching control unit 15 controls the second switching unit 15b to transmit the first operation signal to the processing device 21. When the input device 22 transmits a second operation signal, the switching control unit 15 controls the second switching unit 15b to transmit the second operation signal to the processing device 21.

[0029] When a second operation signal is transmitted from the input device 22, the switching control unit 15 controls the second switching unit 15b so that the second operation signal is transmitted to the processing device 21 regardless of whether the first operation signal is generated or not. That is, the switching control unit 15 controls the second switching unit 15b so that the second operation signal is transmitted to the processing device 21 with priority over the first operation signal.

[0030] As an example, the switching control unit 15 is a multiplexer circuit, a relay circuit, a microcomputer, etc. The receiving unit 14 is an input / output interface (I / F) provided in the switching control unit 15. The first switching unit 15a includes a switch. The calculation unit 12 and the receiving unit 14 are communicably connected to the generating unit 13 via the switch. The operation of the switch switches between a state in which the calculation unit 12 can communicate with the generating unit 13 and a state in which the receiving unit 14 can communicate with the generating unit 13. Alternatively, the function of the first switching unit 15a may be realized by software. For example, the software switches between a state in which the first operation command from the calculation unit 12 is prioritized and a state in which the second operation command from the receiving unit 14 is prioritized.

[0031] The second switching unit 15b includes, for example, a switch. The generation unit 13 and the input device 22 are communicably connected to the processing device 21 via the switch. The operation of the switch switches between a state in which a signal can be transmitted from the generation unit 13 to the processing device 21 and a state in which a signal can be transmitted from the input device 22 to the processing device 21. Alternatively, the function of the second switching unit 15b may be realized by software. For example, a software program switches between a state in which a first operation signal from the generation unit 13 is prioritized and a state in which a second operation signal from the input device 22 is prioritized.

[0032] When the processor 21 receives an operation signal, it executes operations such as moving a pointer, selecting an icon, and inputting characters in accordance with the operation signal.

[0033] The storage device 19a stores various data necessary for the operation of the processing device 21. For example, the storage device 19a stores the resolution, coordinates of the origin, coordinate system, and the like of each of the display device 19c and the display device 23. The storage device 19a includes a hard disk drive (HDD), a solid state drive (SSD), a network attached hard disk (NAS), or the like.

[0034] Data required for recognizing the operation file and the acquired results is prepared in advance by the user using the input device 19b and the display device 19c, and is stored in the storage device 19a. The input device 19b is used by the user to input information to the calculation unit 12. The input device 22 includes at least one selected from, for example, a keyboard, a mouse, a touch pad, and a microphone. The display device 19c displays a signal output from the calculation unit 12 so that the user can visually recognize it. The display device 19c includes a monitor.

[0035] FIG. 2 is a flowchart showing the processing performed by the processing system according to the embodiment. First, the acquisition unit 11 acquires an output from the processing device 21 (step S1). The calculation unit 12 recognizes the output content and generates a first operation command (step S2). The calculation unit 12 transmits the first operation command to the generation unit 13. The switching control unit 15 judges whether the receiving unit 14 has received a second operation command (step S3). If the second operation command has not been received, the switching control unit 15 inputs the first operation command to the generation unit 13 (step S4a). If the second operation command has been received, the switching control unit 15 inputs the second operation command to the generation unit 13 (step S4b). The generation unit 13 generates a first operation signal based on the input operation command (step S5). The switching control unit 15 judges whether the detector 16 has detected a user operating the input device 22 (step S6). If the detector 16 has not detected a user, the switching control unit 15 inputs the first operation signal from the generation unit 13 to the processing device 21 (step S7a). When the detector 16 detects a user, the switching control unit 15 inputs the second operation signal from the input device 22 to the processing device 21 (step S7b). The processing device 21 is operated by the first operation signal or the second operation signal (step S8). After that, the process shown in FIG. 2 is executed again based on the output when the processing device 21 is operated.

[0036] Advantages of the embodiment will be described. In the processing system 1 according to the embodiment, in addition to the input device 22, the operation system 10 can operate the processing device 21. According to the operation system 10, a first operation command is generated according to the output from the processing device 21. Then, a first operation signal corresponding to the processing device 21 is generated based on the first operation command. By using the operation system 10, it is possible to automatically operate the processing device 21. In addition, it is preferable that the processing device 21 can be remotely operated by the terminal device 30. Even if a problem occurs with the processing device 21, it is possible to operate the processing device 21 remotely using the terminal device 30 and solve the problem. Since an operator who deals with the problem does not need to go to the place where the processing device 21 is installed, the convenience of the processing system 1 can be improved. In addition, by using the terminal device 30, one operator can deal with problems of multiple processing devices 21.

[0037] On the other hand, in the processing system 1, three elements, namely, the calculation unit 12, the input device 22, and the terminal device 30, can operate the processing device 21. When making the processing device 21 execute a specific process, if instructions from these three elements are mixed, it may be difficult to operate the processing device 21 normally.

[0038] Regarding this problem, the operation system 10 includes a first switching unit 15a and a second switching unit 15b so as to operate the processing device 21 more appropriately. The first switching unit 15a inputs one of the first operation command from the calculation unit 12 and the second operation command from the terminal device 30 to the generation unit 13. The second switching unit 15b inputs one of the first operation signal from the generation unit 13 and the second operation signal from the input device 22 to the processing device 21. By providing the first switching unit 15a and the second switching unit 15b, one of the multiple operation signals is input to the processing device 21. As a result, even when instructions are simultaneously transmitted from two or more of the calculation unit 12, the input device 22, and the terminal device 30, it is possible to operate the processing device 21 more appropriately based on any of the instructions.

[0039] When the calculation unit 12 transmits the first operation command and the receiving unit 14 receives the second operation command, it is preferable that the first switching unit 15a inputs the second operation command to the generating unit 13. That is, it is preferable that the second operation command is prioritized over the first operation command. Only a specific operation command registered in advance is automatically transmitted from the calculation unit 12 in response to the output from the processing device 21. For this reason, when the output from the processing device 21 is different from normal, the operation command from the calculation unit 12 may not be able to operate the processing device 21 appropriately. On the other hand, the terminal device 30 is a terminal operated by a user. The user can operate the processing device 21 more appropriately via the terminal device 30 in response to the output from the processing device 21. By prioritizing the second operation command over the first operation command, it is possible to operate the processing device 21 more appropriately.

[0040] When the first operation signal is generated by the generation unit 13 and the input device 22 is used (the second operation signal is transmitted), it is preferable that the second switching unit 15b inputs the second operation signal to the processing device 21. In other words, it is preferable that the second operation signal is prioritized over the first operation signal. The input device 22 is used by an operator who can directly check the processing device 21. An operator who uses the input device 22 can check the state of the processing device 21 in more detail than an operator who uses the terminal device 30. By giving priority to the second operation signal over the first operation signal, it is possible to operate the processing device 21 more appropriately.

[0041] When the detector 16 detects a user operating the input device 22, the switching control unit 15 causes the second switching unit 15b to input the second operation signal to the generation unit 13. As a result, regardless of whether the first operation signal has been transmitted to the generation unit 13, the second operation signal is prioritized over the first operation signal.

[0042] When an abnormality occurs in the processing device 21, the calculation unit 12 may identify the content of the abnormality. When an abnormality occurs, the processing device 21 outputs error information. For example, the processing device 21 causes the display device 23 to display an error code. The calculation unit 12 recognizes the error code from the image. The error code includes a character string for identifying the error. The calculation unit 12 recognizes the character string included in the error code.

[0043] FIG. 3 is an example of a table in which error codes are registered. A database including a table 100 shown in Fig. 3, for example, is registered in the storage device 19a. The table 100 includes an error code 101, a device code 102, a device name 103, an error content 104, and a class 105. The error code 101 is a character string for identifying the content of each error. The device code 102 is a character string for identifying a device in which an error may occur. The error content 104 is the content of the error indicated by the error code. The class 105 indicates the classification of each error and indicates the severity of the abnormality. The table 100 is created in advance and registered in the storage device 19a.

[0044] If the processing device 21 is a production facility, the greater the impact of the abnormality on production, the more serious the abnormality is. For example, an abnormality that leads to the production of workpieces (defective products) with inferior characteristics compared to normal, an abnormality that may hinder normal operation of the production facility, etc. are set to be more serious. When the calculation unit 12 recognizes an error code, it searches for the character string and identifies the class (seriousness) of the error code output from the processing device 21.

[0045] As an example, the processing device 21 outputs a first error code (an example of first error information). The first error code is classified as a first class, and indicates that a minor abnormality has occurred in the processing device 21. In this case, the calculation unit 12 generates a recovery operation command for recovering from the abnormality, and transmits it to the generation unit 13. By automating the recovery from the abnormality, it becomes unnecessary for an operator to check the processing device 21 when an abnormality occurs. This can improve the convenience of the operation system 10 and the operating efficiency of the processing system 1.

[0046] As another example, the processing device 21 outputs a second error code (an example of second error information) different from the first error code. The second error code is classified into a second class and indicates that a serious abnormality has occurred in the processing device 21. In this case, automatic recovery by the calculation unit 12 is difficult or undesirable, and an operator needs to deal with the abnormality. The calculation unit 12 transmits the recognized error code to the switching control unit 15. The switching control unit 15 may switch the first switching unit 15a in advance so that the second operation command from the receiving unit 14 has priority over the first operation command from the calculation unit 12. Thereby, when the receiving unit 14 receives the second operation command from the terminal device 30, the second operation command is transmitted to the generating unit 13 more quickly. The calculation unit 12 may be configured not to generate an operation command when a serious abnormality has occurred.

[0047] The error information output from the processing device 21 may include a specific image, a one-dimensional code, or a two-dimensional code instead of a character string. The calculation unit 12 recognizes these pieces of information from the video signal output from the processing device 21 and identifies the error information. In response to the identified error information, the switching control unit 15 controls the first switching unit 15a and the second switching unit 15b.

[0048] Specific examples of embodiments of the present invention will be described below.

[0049] The calculation unit 12 executes image recognition on the video signal output from the processing device 21. In the image recognition, at least one selected from template matching, character recognition, and color recognition is executed. The user prepares reference data required for these processes in advance and stores it in the storage device 19a.

[0050] In preparing a template image, the acquisition unit 11 acquires a video signal from the processing device 21 to the display device 23 when performing image recognition. The calculation unit 12 causes the display device 19c to display an image based on the video signal. The user uses the input device 19b to select a part of the displayed image. The selected image is stored in the storage device 19a as a template image. The user also writes the file name of the template image to be referenced in the second file. Template images are prepared for all screens on which automatic operations are performed by the operation system 10.

[0051] When the processing device 21 is operated, a change occurs on the screen. For example, the displayed screen transitions to another screen, or a window is displayed. A partial image that is not included in the screen before the change but is included in the screen after the change is used as a template image.

[0052] In preparing the character recognition range, the acquisition unit 11 acquires a video signal from the processing device 21 to the display device 23 when a character needs to be recognized. The calculation unit 12 causes the display device 19c to display an image based on the video signal. The user uses the input device 19b to check the range in which character recognition is to be performed in the displayed image. The user describes the range in the second file.

[0053] In preparation for color recognition, the acquisition unit 11 acquires a video signal from the processing device 21 to the display device 23 when color needs to be recognized. The calculation unit 12 causes the display device 19c to display an image based on the video signal. The user uses the input device 19b to select a range in the displayed image where color recognition is to be performed. The image of the selected range is stored in the storage device 19a. The user also describes the range in a second file.

[0054] In image recognition using a template image, the calculation unit 12 determines whether an image based on a video signal contains an image similar to the template image. In character recognition, the calculation unit 12 cuts out an image of a pre-stored range. The calculation unit 12 executes character recognition processing such as Optical Character Recognition (OCR) on the image. In color recognition, the calculation unit 12 cuts out an image of a pre-stored range. The calculation unit 12 determines whether the colors of each part match between the pre-stored image and the cut-out image. By recognizing the image through these processes, the calculation unit 12 determines whether the operation to the processing device 21 by the operation signal has been completed.

[0055] In preparing the operation file, a first file and a second file are created. The first file is written in a general-purpose programming language such as C. The second file is written in text format with the selected coordinates of the pointing device, the template image to be referenced, the characters to be input, and the like.

[0056] With respect to a pointing device such as a mouse, the user writes the coordinates of the selection (click) in the second file and stores them in the storage device 19a. For example, the acquisition unit 11 acquires a video signal from the processing device 21 to the display device 23 when the pointing device is operated. The calculation unit 12 causes the display device 19c to display an image based on the video signal. The user places the pointer on the portion to be selected in the displayed image and checks the coordinates. The user writes the coordinates in the second file.

[0057] Regarding the keyboard, the acquisition unit 11 acquires a video signal from the processing device 21 to the display device 23 when characters are inputted via the keyboard. The calculation unit 12 causes the display device 19c to display an image based on the video signal. In the displayed image, the user places a pointer on a text box in which characters are to be inputted and confirms the coordinates. The user writes the coordinates and one or more characters to be inputted into the text box in the second file.

[0058] After an operation signal is sent to the processing device 21, the calculation unit 12 performs image recognition to determine whether the processing device 21 has been operated in response to the operation signal. If it is determined that the processing device 21 has not been operated, the calculation unit 12 may transmit a notice to the display device 19c or another terminal device that the processing device 21 cannot be operated. The file name of the template image used for image recognition, the range used for character recognition, the image and range used for color recognition, etc. are described in the second file as described above.

[0059] The switching control unit 15 refers to a setting file. In the setting file, a priority relationship between the first operation command and the second operation command and a priority relationship between the first operation signal and the second operation signal are described. The switching control unit 15 controls the first switching unit 15a and the second switching unit 15b according to the priority relationships described in the setting file. The setting file is preferably written in a text format so that even a person without specialized knowledge of programming can edit the setting file. The setting file may be stored in a memory provided in the switching control unit 15 or in the storage device 19a.

[0060] FIGS. 4(a), 4(b), 5(a), 5(b), 7(a), and 7(b) are schematic diagrams illustrating examples of screens of display devices. Fig. 6(a) is a schematic diagram illustrating a portion of a first file, Fig. 6(b) is a schematic diagram illustrating a portion of a second file, and Fig. 6(c) is a schematic diagram illustrating a portion of a setting file.

[0061] In a part of the processing process by the processing device 21, the screens shown in Fig. 4(a) to Fig. 5(b) are displayed on the display device 23 based on the video signal output from the processing device 21. The screen A1 shown in Fig. 4(a) displays icons B1 to B7 and information C1 related to the workpiece being processed by the processing device 21. The screen A2 shown in Fig. 4(b) displays icons B1 to B4, icons B11 to B14, and a schematic diagram D of the processing device 21. The screen A3 shown in Fig. 5(a) displays icons B1 to B4, icons B21 to B24, and a schematic diagram D. The screen A4 shown in Fig. 5(b) displays icons B1 to B4, icons B21 to B24, and information C2 related to the processing conditions by the processing device 21.

[0062] For example, when the operation system 10 is not used, the user moves the pointer to icon B3 on screen A1 shown in FIG. 4(a) and selects icon B3. A screen A2 shown in FIG. 4(b) is displayed on the display device 23. The user moves the pointer to icon B14 on screen A2 and selects icon B14. A screen A3 shown in FIG. 5(a) is displayed on the display device 23. The user moves the pointer to icon B21 on screen A3 and selects icon B21. A screen A4 shown in FIG. 5(b) is displayed on the display device 23.

[0063] When the processing device 21 is operated by the operation system 10, the calculation unit 12 causes the display device 19c to display the screen A1. The user checks the coordinates of the icon B3 on the screen A1 and writes them in the second file. Next, the calculation unit 12 causes the display device 19c to display the screen A2. The user cuts out a template image from the screen A2 for determining the transition from the screen A1 to the screen A2. For example, the schematic diagram D and any of the icons B11 to B14 are used as the template image. The user stores the cut-out template image in the storage device 19a as image data. The template image is referred to when determining the transition from the screen A1 to the screen A2. The user writes the file name of the template image in the second file.

[0064] Thereafter, the process of storing the template image and writing the file name in the second file is repeated in the same manner. For example, when screen A3 is displayed on display device 19c, the user cuts out a template image from screen A3 for determining the screen transition. The user stores the cut-out image data in storage device 19a. The user writes the file name of the template image in the second file.

[0065] As shown in Fig. 6(a) to Fig. 6(c), a first file, a second file, and a setting file are prepared for automatic operation by the operation system 10. The first file shown in Fig. 6(a) describes operations to be executed by the calculation unit 12, such as the generation of an operation command for selecting a specific icon and reference to a template image, as described above. The second file shown in Fig. 6(b) describes the coordinates to be selected, the file name of the template image to be referenced, and the like. The setting file shown in Fig. 6(c) describes a priority relationship (mode) for each status. In each mode, it is described which command, the first operation command or the second operation command, is to be prioritized, or which signal, the first operation signal or the second operation signal, is to be prioritized.

[0066] The trigger for starting an operation by the operation system 10 is arbitrary. For example, the operation may be started based on a signal input to the processing device 21, or a signal sent from another sensor, measuring instrument, or the like. The operation may be started in response to a signal transmitted from another operation system 10, or a signal transmitted from another processing device 21 operated by the other operation system 10. The signal may be transmitted during operation by the other operation system 10, or may be transmitted at a time other than when operation is performed by the other operation system 10. The operation may be started when a specific screen is displayed on the display device 23. The operation may be started when a user inputs a specific command to the calculation unit 12.

[0067] When an abnormality occurs in the processing device 21, an error message E1 and an error message E2 are displayed as shown in Fig. 7(a) and Fig. 7(b). The error message E1 and the error message E2 each include an error code. The calculation unit 12 recognizes the error code included in the error message.

[0068] As an example, the processing device 21 transports and processes a plurality of workpieces. The processing device 21 is equipped with a first sensor that detects the presence or absence of each workpiece. A photoelectric sensor or the like is used as the first sensor. If the processing device 21 determines from the detection result of the first sensor that any of the workpieces is not present, an error message E1 shown in FIG. 7(a) is displayed. The error message E1 indicates a minor abnormality, and is displayed for the user's confirmation. In this case, the processing by the processing device 21 can be resumed by selecting an icon F1 included in the error message E1.

[0069] When the calculation unit 12 recognizes the error message E1, it generates a recovery operation command to select the icon F1 in order to recover from the state shown in Fig. 7(a). A first operation signal is generated based on the recovery operation command, and the icon F1 is automatically selected. This causes the processing device 21 to automatically resume processing from the state in which the processing device 21 was stopped.

[0070] The processing device 21 is provided with a second sensor that detects a value that affects the characteristics of the workpiece. The second sensor is, for example, a sensor for detecting the position of the workpiece, a sensor for detecting the conditions when processing the workpiece, etc. The "conditions" are current, voltage, pressure, flow rate, etc. If the processing device 21 determines from the detection result of the second sensor that some abnormality has occurred in the processing device 21, an error message E2 shown in FIG. 7(b) is displayed. The error message E2 indicates a serious abnormality and is displayed to request the user to take action. However, even in this case, the processing by the processing device 21 can be resumed by selecting an icon F2 included in the error message E2.

[0071] In particular, in a production facility, if a workpiece with inferior characteristics is produced and sent to a later process, a large loss will occur. Even if the abnormality can be resolved by a simple operation, it is preferable to stop the processing device 21 until the abnormality is resolved. For this reason, it is preferable that the recovery operation command by the calculation unit 12 is not generated.

[0072] In addition, when a serious abnormality occurs, a person with specialized knowledge may be required to deal with it. It is preferable that an operator with specialized knowledge diagnoses the contents of the abnormality and deals with it appropriately. On the other hand, the number of operators with specialized knowledge is not large. For this reason, one operator may use the terminal device 30 to remotely operate multiple processing devices 21 installed at different locations. When the terminal device 30 is operated and the second operation command is received by the receiving unit 14, the second operation command takes precedence over the first operation command generated by the calculation unit 12. In general, an operator who operates the processing device 21 is present at the site where the processing device 21 is installed. When a serious abnormality occurs in the processing device 21, if an operator at the site with little specialized knowledge operates the processing device 21 and recovers the processing device 21 from the abnormal state, a workpiece with inferior characteristics may be produced.

[0073] Therefore, when a serious abnormality occurs, the switching control unit 15 may switch the second switching unit 15b in advance so that the first operation signal from the generation unit 13 has priority over the second operation signal from the input device 22. That is, during normal operation of the processing device 21, even if a second operation command is transmitted from the terminal device 30 to the receiving unit 14, the second operation signal from the input device 22 has priority over the first operation signal based on the second operation command. When a serious abnormality occurs in the processing device 21, even if the second operation signal is generated by the input device 22, the first operation signal based on the second operation command has priority over the second operation signal.

[0074] For example, when an error occurs in the processing device 21, the calculation unit 12 classifies the error. When the error is classified as a minor abnormality (first class), the second switching unit 15b prioritizes the first operation signal over the second operation signal. When the error is classified as a second class, which is more serious than the first class, the second switching unit 15b prioritizes the second operation signal over the first operation signal.

[0075] More preferably, the switching control unit 15 switches the second switching unit 15b so that the second operation signal from the input device 22 is not input to the processing device 21. This makes it impossible for an operator at the site to operate the processing device 21 using the input device 22. As a result, it becomes possible to more appropriately respond to an abnormality in the processing device 21.

[0076] FIG. 8 is a schematic diagram showing a hardware configuration. 8 is used as the calculation unit 12, the generation unit 13, the control unit 21a, and the terminal device 30. The computer 90 includes a CPU 91, a ROM 92, a RAM 93, a storage device 94, an input I / F 95, an output I / F 96, and a communication I / F 97.

[0077] The ROM 92 stores a program for controlling the operation of the computer 90. The ROM 92 stores a program necessary for causing the computer 90 to realize each of the above-mentioned processes. The RAM 93 functions as a storage area in which the programs stored in the ROM 92 are expanded.

[0078] The CPU 91 includes a processing circuit. The CPU 91 uses a RAM 93 as a working memory and executes a program stored in at least one of a ROM 92 and a storage device 94. During execution of the program, the CPU 91 controls each component via a system bus 98 and executes various processes.

[0079] The storage device 94 stores data necessary for executing the programs and data obtained by executing the programs.

[0080] The input I / F 95 can connect the computer 90 to the input device 95a. The input I / F 95 is, for example, a serial bus interface such as USB. The CPU 91 can read various data from the input device 95a via the input I / F 95.

[0081] The output I / F 96 can connect the computer 90 and the output device 96a. The output I / F 96 is, for example, a video output interface such as a Digital Visual Interface (DVI) or a High-Definition Multimedia Interface (HPMI (registered trademark)). The CPU 91 can transmit data to the output device 96a via the output I / F 96 and cause the output device 96a to display an image.

[0082] The communication I / F 97 can connect the computer 90 to a server 97a outside the computer 90. The communication I / F 97 is, for example, a network card such as a LAN card. The CPU 91 can read various data from the server 97a via the communication I / F 97.

[0083] The storage device 94 includes one or more selected from a hard disk drive (HDD) and a solid state drive (SSD). The input device 95a includes one or more selected from a mouse, a keyboard, a microphone (audio input), and a touch pad. The output device 96a includes one or more selected from a monitor, a projector, a printer, and a speaker. A device having the functions of both the input device 95a and the output device 96a, such as a touch panel, may be used.

[0084] The processes executed by the calculation unit 12, the generation unit 13, the control unit 21a, and the terminal device 30 may be realized by one computer 90 or by a plurality of computers 90 working together.

[0085] The various data processing operations described above may be recorded as a program that can be executed by a computer on a magnetic disk (such as a flexible disk or a hard disk), an optical disk (such as a CD-ROM, CD-R, CD-RW, DVD-ROM, DVD±R, DVD±RW), a semiconductor memory, or other non-transitory computer-readable storage medium.

[0086] For example, information recorded on a recording medium can be read by a computer (or an embedded system). The recording medium may have any recording format (storage format). For example, the computer reads a program from the recording medium and causes a CPU to execute instructions described in the program based on the program. The computer may acquire (or read) the program via a network.

[0087] Embodiments of the invention include the following features. (Feature 1) a calculation unit that acquires an output from a first device that is an operation target, and generates a first operation command for operating the first device in response to the output; a receiving unit that receives a second operation command for operating the first device, the second operation command being input via a network; a generation unit that generates a first operation signal corresponding to the first device based on one of the first operation command and the second operation command; a first switching unit that inputs one of the first operation command and the second operation command to the generating unit; an operation system including a second switching unit that inputs, to the first device, one of the first operation signal and a second operation signal input from an input device to the first device in order to operate the first device. (Feature 2) 2. The operation system according to feature 1, wherein when the first operation command is generated by the calculation unit and the second operation command is received by the receiving unit, the first switching unit inputs the second operation command to the generation unit. (Feature 3) 3. The operation system according to feature 1 or 2, wherein when the first operation signal is generated by the generation unit and the input device is used, the second switching unit inputs the second operation signal to the first device. (Feature 4) A switching control unit that controls the second switching unit is further provided. The operation system according to any one of features 1 to 3, wherein the switching control unit, when a detector detects a user operating the input device, causes the second switching unit to input the second operation signal to the generation unit. (Feature 5) A switching control unit that controls the first switching unit and the second switching unit, The calculation unit recognizes error information included in the output, 4. The operation system according to any one of features 1 to 3, wherein the switching control unit controls the first switching unit and the second switching unit in response to the recognized error information. (Feature 6) When the output includes first error information, the calculation unit generates a recovery operation command for recovering from an abnormality corresponding to the first error information; The operation system according to feature 5, wherein, when the output includes second error information, the switching control unit controls the second switching unit so that the second operation signal is not input to the generation unit. (Feature 7) The calculation unit classifies the error information, When the error information is classified into a first class, the second switching unit prioritizes the first operation signal over the second operation signal; The operation system according to feature 5, wherein, when the error information is classified into a second class which is more serious than the first class, the second switching unit prioritizes the second operation signal over the first operation signal. (Feature 8) A switching control unit is further provided, The operation system according to any one of features 1 to 3, wherein the switching control unit refers to a setting file in which a priority relationship between the first operation command and the second operation command and a priority relationship between the first operation signal and the second operation signal are described, and controls the first switching unit and the second switching unit based on the setting file. (Feature 9) The operating system according to feature 8, wherein the configuration file is written in text format. (Feature 10) 10. The operation system according to any one of features 1 to 9, wherein the first device is a processing device that processes a workpiece. (Feature 11) An operation system according to any one of features 1 to 10, The first device; A processing system comprising the input device. (Feature 12) a first switching unit that inputs one of a first operation command for operating a first device that is an operation target and a second operation command for operating the first device, the second operation command being transmitted via a network, to a generating unit that generates a first operation signal corresponding to the first device based on the operation command; a second switching unit that inputs, to the first device, one of the first operation signal generated by the generation unit and a second operation signal input from an input device to the first device in order to operate the first device; A switching device comprising: (Feature 13) causing a calculation unit to acquire an output from a first device that is an operation target, and to generate a first operation command for operating the first device in response to the output; causing a receiving unit to receive a second operation command for operating the first device, the second operation command being input via a network; causing a generation unit to generate a first operation signal corresponding to the first device based on one of the first operation command and the second operation command; causing a first switching unit to input one of the first operation command and the second operation command to the generating unit; An operating method comprising causing a second switching unit to input to the first device one of the first operation signal and a second operation signal input from an input device to the first device in order to operate the first device. (Feature 14) causing the computing unit to recognize errors in the output and classify the errors; When the error is classified into a first class, the second switching unit is caused to give priority to the first operation signal over the second operation signal; The operating method according to feature 13, further comprising causing the second switching unit to prioritize the second operating signal over the first operating signal when the error is classified into a second class that is more serious than the first class. (Feature 15) To your computer controlling a first switching unit to input one of a first operation command for operating a first device that is an operation target and a second operation command for operating the first device, the second operation command being transmitted via a network, to a generating unit that generates a first operation signal corresponding to the first device based on the operation command; controlling a second switching unit to input, to the first device, one of the first operation signal generated by the generation unit and a second operation signal input from an input device to the first device in order to operate the first device; program. (Feature 16) A storage medium storing the program according to feature 15.

[0088] According to the embodiment described above, an operation system, a processing system, and an operation method are provided that can operate the device to be operated more appropriately. In addition, by using a switching device including the first switching unit 15a and the second switching unit 15b, it becomes possible to operate the processing device 21 more appropriately based on any instruction. The same effect can be obtained by using a program that can operate a computer as a switching control device that controls the switching device.

[0089] Although some embodiments of the present invention have been illustrated above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, etc. can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims. In addition, the above-mentioned embodiments can be implemented in combination with each other. [Explanation of symbols]

[0090] 1: processing system, 10: operation system, 11: acquisition unit, 12: calculation unit, 13: generation unit, 14: reception unit, 15: switching control unit, 15a: first switching unit, 15b: second switching unit, 16: detector, 19a: storage device, 19b: input device, 19c: display device, 21: processing device, 21a: control unit, 22: input device, 23: display device, 30: terminal device, 90: computer, 91: CPU, 92: ROM, 93: RAM, 94: storage device, 95: input interface, 95a: input device, 96: output interface, 96a: output device, 97: communication interface, 97a: server, 98: system bus, 100: table, 101: error code, 102: device code, 103: device name, 104: Error content, 105: Class

Claims

1. a calculation unit that acquires an output from a first device that is an operation target, and generates a first operation command for operating the first device in response to the output; a receiving unit that receives a second operation command for operating the first device, the second operation command being input via a network; a generation unit that generates a first operation signal corresponding to the first device based on one of the first operation command and the second operation command; a first switching unit that inputs one of the first operation command and the second operation command to the generating unit; An operation system comprising: a second switching unit that inputs, to the first device, one of the first operation signal and a second operation signal input from an input device to the first device to operate the first device.

2. The operation system according to claim 1 , wherein when the first operation command is generated by the calculation unit and the second operation command is received by the receiving unit, the first switching unit inputs the second operation command to the generating unit.

3. The operation system according to claim 1 , wherein when the first operation signal is generated by the generation unit and the input device is used, the second switching unit inputs the second operation signal to the first device.

4. A switching control unit that controls the second switching unit is further provided. The operation system according to claim 1 , wherein the switching control unit causes the second switching unit to input the second operation signal to the generation unit when a detector detects a user operating the input device.

5. A switching control unit that controls the first switching unit and the second switching unit, The calculation unit recognizes error information included in the output, The operation system according to claim 1 , wherein the switching control unit controls the first switching unit and the second switching unit in response to the recognized error information.

6. When the output includes first error information, the calculation unit generates a recovery operation command for recovering from an abnormality corresponding to the first error information; The operation system according to claim 5 , wherein, when the output includes second error information, the switching control unit controls the second switching unit so that the second operation signal is not input to the generating unit.

7. The calculation unit classifies the error information, When the error information is classified into a first class, the second switching unit prioritizes the first operation signal over the second operation signal; The operation system according to claim 5 , wherein, when the error information is classified into a second class that is more serious than the first class, the second switching unit prioritizes the second operation signal over the first operation signal.

8. A switching control unit is further provided, 3. The operation system according to claim 1, wherein the switching control unit refers to a setting file in which a priority relationship between the first operation command and the second operation command and a priority relationship between the first operation signal and the second operation signal are described, and controls the first switching unit and the second switching unit based on the setting file.

9. The operation system according to claim 8 , wherein the setting file is written in a text format.

10. The operation system according to claim 1 or 2, wherein the first device is a processing device that processes a workpiece.

11. An operation system according to claim 1 or 2; The first device; and A processing system comprising the input device.

12. a first switching unit that inputs one of a first operation command for operating a first device that is an operation target and a second operation command for operating the first device, the second operation command being transmitted via a network, to a generating unit that generates a first operation signal corresponding to the first device based on the operation command; a second switching unit that inputs, to the first device, one of the first operation signal generated by the generation unit and a second operation signal input from an input device to the first device in order to operate the first device; A switching device comprising:

13. causing a calculation unit to acquire an output from a first device that is an operation target, and to generate a first operation command for operating the first device in response to the output; causing a receiving unit to receive a second operation command for operating the first device, the second operation command being input via a network; causing a generation unit to generate a first operation signal corresponding to the first device based on one of the first operation command and the second operation command; causing a first switching unit to input one of the first operation command and the second operation command to the generating unit; An operation method comprising causing a second switching unit to input to the first device one of the first operation signal and a second operation signal input from an input device to the first device to operate the first device.

14. causing the computing unit to recognize errors in the output and classify the errors; When the error is classified into a first class, the second switching unit is caused to give priority to the first operation signal over the second operation signal; The operating method according to claim 13 , further comprising causing the second switching unit to prioritize the second operating signal over the first operating signal when the error is classified into a second class that is more serious than the first class.

15. To your computer controlling a first switching unit to input one of a first operation command for operating a first device that is an operation target and a second operation command for operating the first device, the second operation command being transmitted via a network, to a generating unit that generates a first operation signal corresponding to the first device based on the operation command; controlling a second switching unit to input, to the first device, one of the first operation signal generated by the generation unit and a second operation signal input from an input device to the first device in order to operate the first device; program.

16. A storage medium storing the program according to claim 15.

Images