Apparatus, system, and method

Abstract

The present invention relates to an apparatus, a system, a method, and a program.SOLUTION: An operation detection unit configured to detect a first operation by an operator of a facility, and an execution instruction unit configured to output, in response to detection of the first operation by the operation detection unit, an execution instruction for a second operation to be performed in the facility, the second operation being associated in advance with the first operation, to a terminal that is a destination of the execution instruction, the execution instruction unit outputs the execution instruction for the second operation including work to be performed in the facility to the terminal used in the facility.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an apparatus, a system, a method and a program. [Background technology]

[0002] Patent documents 1 to 8 state that "Commands input by a human user are processed by the input terminal and transmitted to the remote-controlled robot 110 via the control center 130...the remote-controlled robot 110 is caused to move around an area of ​​interest along a fixed path, change its operating mode, change its moving speed, change its operating speed, etc..." (paragraph 0030 of Patent document 1). [Prior art document] [Patent documents] [Patent Document 1] Special Publication No. 2022-527029 [Patent Document 2] JP 2022-035526 A [Patent Document 3] JP 2014-072803 A [Patent Document 4] JP 2014-106888 A [Patent Document 5] JP 2014-072803 A [Patent Document 6] JP ​​2014-106888 A [Patent Document 7] Special Publication No. 2020-52164 [Patent Document 8] JP 2011-034180 A Summary of the Invention

[0003] In a first aspect of the present invention, there is provided an apparatus including: an action detection unit that detects a first action by an operator of a facility; and an execution instruction unit that, in response to the first action being detected by the action detection unit, outputs an execution instruction for a second action to be performed within the facility, which is pre-associated with the first action, to a terminal that is the destination of the execution instruction.

[0004] In the above device, the first operation may include work to be performed by the operator within the facility, and the execution instruction unit may output the execution instruction for the second operation, including work to be performed within the facility, to the terminal used within the facility.

[0005] In any of the above devices, the terminal may be provided movably within the facility.

[0006] In the above device, the second operation includes movement to a work site within the facility that is pre-associated with the first operation, and the device may further include an arrival detection unit that detects that the terminal has arrived at the work site, and a display control unit that displays to the operator that the terminal has not yet arrived at the work site until the arrival detection unit detects that the terminal has arrived at the work site.

[0007] In the above device, the display control unit may further display to the operator that the terminal has arrived at the work site in response to the arrival detection unit detecting that the terminal has arrived at the work site.

[0008] In any of the above devices that are equipped with an arrival detection unit, the second action may include work at the work site, the action detection unit may further detect a third action by the operator, and the execution instruction unit may cancel the execution instruction for the second action in response to the third action being detected by the action detection unit before the arrival detection unit detects that the terminal has arrived at the work site.

[0009] In any of the above devices in which the terminal is movably installed within the facility, the second action may include moving sequentially through a plurality of work sites within the facility that are pre-associated with the first action.

[0010] In any of the above devices in which the terminal is movably installed within the facility, the execution instruction unit may output execution instructions for multiple types of second actions that are pre-associated with multiple types of first actions to the multiple terminals, and each of the multiple types of second actions may include moving to a different work site within the facility.

[0011] In any of the above devices, the action detection unit can detect multiple types of the first action, and the execution instruction unit outputs to the terminal, for each type of first action detected by the action detection unit, an execution instruction for a different type of second action that is pre-associated with that type of first action, and the device may further include a completion detection unit that detects that the second action has been completed, and a display control unit that displays to the operator information indicating types of second actions that have not yet been executed, among the second actions for which execution instructions have been output to the terminal.

[0012] Any of the above devices may further include a status data acquisition unit that acquires status data indicating the status of the facility, and the execution instruction unit may output an instruction to execute the second action in response to the first action being detected by the action detection unit and the status data satisfying a reference condition.

[0013] In a second aspect of the present invention, there is provided a system comprising the device of the first aspect and a terminal that receives an instruction to execute the second operation output from the execution instruction unit in the device.

[0014] In the above system, the terminal may interrupt the execution of the second action and execute another action that has been set in advance in response to detecting an abnormality in the facility.

[0015] In a third aspect of the present invention, there is provided a method comprising: an action detection step of detecting a first action by an operator of a facility; and an execution instruction step of, in response to the first action being detected by the action detection step, outputting an execution instruction for a second action to be performed within the facility, which is pre-associated with the first action, to a terminal to which the execution instruction is addressed.

[0016] In a fourth aspect of the present invention, there is provided a program that, when executed by a computer, causes the computer to function as an action detection unit that detects a first action by an operator of a facility, and an execution instruction unit that, in response to the first action being detected by the action detection unit, outputs an execution instruction for a second action to be performed within the facility, which is pre-associated with the first action, to a terminal that is the destination of the execution instruction.

[0017] The above summary of the invention does not list all of the necessary features of the present invention, and subcombinations of these features may also constitute inventions. [Brief explanation of the drawings]

[0018] [Figure 1] 1 shows a system 1 according to an embodiment. [Figure 2] The operation of device 3 is shown. [Figure 3] Another operation of the device 3 is shown. [Figure 4] The correspondence table 330 is shown. [Figure 5] 1 shows a display area of ​​an incomplete action displayed on the display unit 37. [Figure 6] 12 illustrates an example computer 1200 in which aspects of the present invention may be embodied, in whole or in part. DETAILED DESCRIPTION OF THE INVENTION

[0019] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0020] (System 1) 1 shows a system 1 according to this embodiment. The system 1 supports the operation of a facility, and includes one or more terminals 2 and a device 3.

[0021] The facility whose operation is supported by the system 1 may be a plant. Examples of the plant include industrial plants such as chemical and bio plants, plants that manage and control wellheads and surrounding areas of gas and oil fields, plants that manage and control power generation such as hydroelectric, thermal, and nuclear power, plants that manage and control environmental power generation such as solar and wind power, and plants that manage and control water supply and sewage systems, dams, etc.

[0022] The facility may be equipped with one or more devices (not shown). Each device may be an instrument, machine, or device, and may be a so-called field device. For example, the device may be a sensor or meter that measures status data, a valve such as a flow control valve or an on-off valve, an actuator such as a fan, a motor, a pump, or a compressor, or a transmitter that transmits a signal. The status data may indicate the status of the facility. The status of the facility may include pressure, temperature, pH, speed, flow rate, etc., or may include the production rate of a product by the facility or the percentage of impurities mixed into the product.

[0023] ((2 on each terminal)) Each terminal 2 is installed within the facility. Each terminal 2 may be used within the facility, or may be installed to be movable within the facility. Each terminal 2 may be capable of communicating with the device 3. For example, each terminal 2 may receive an instruction to perform a second operation, which will be described later, output from the device 3. Unique identification information (also referred to as a terminal ID) may be set in advance in each terminal 2.

[0024] Terminal 2 may be a robot capable of moving within the facility (for example, a maintenance robot, a patrol robot, or a monitoring robot). The robot may automatically perform a preset operation. If terminal 2 is a robot, in response to an execution instruction from device 3, terminal 2 itself may operate or perform maintenance on equipment at a predetermined location within the facility, check measurements using instruments, take images, etc., or may move within the facility.

[0025] Terminal 2 may be a portable terminal carried by a worker stationed within the facility. The worker may be a person performing at least one of the following tasks within the facility: work, monitoring, or patrolling, and may be a patrol officer or security guard. Terminal 2 may be a wearable terminal worn by the worker. As an example, terminal 2 may be an AR device and may have a see-through display that displays various information superimposed on the facility in real space as viewed by the worker. When terminal 2 is a portable terminal, terminal 2 may output various information to the worker in response to an execution instruction from device 3, allowing the worker to operate or maintain equipment, check measurements using instruments, capture images, etc. at a predetermined location within the facility, or may move terminal 2 within the facility.

[0026] At least one of the above terminals 2 may be placed at a predetermined location within the facility (also referred to as a home position) when not in use. The home position may be a standby location or storage location for the terminal 2, or a charging location.

[0027] ((Device 3)) The device 3 may be placed in a control room or a central management room of the facility, and is operated by an operator of the facility. The operator may be a person who monitors and / or controls the entire facility, and may be, for example, a central operator, a control operator, or a monitoring operator. The device 3 has an operation detection unit 31, a status data acquisition unit 32, a memory unit 33, an execution instruction unit 34, a status detection unit 35, a display control unit 36, and a display unit 37.

[0028] (((Movement detection unit 31))) The action detection unit 31 detects a first action by the operator. The action detection unit 31 may be capable of detecting multiple types of first actions. Each first action may be an action that causes a second action corresponding to the first action to be performed within the facility via the terminal 2. The first action may include a task performed by the operator within the facility. The task performed by the operator may, for example, be operating equipment located in a control room or a central control room, or checking measurement values ​​using an instrument. The first action may include an input action to an input device such as a keyboard or a mouse, or may include a gesture action detected via a conventionally known motion capture system.

[0029] In response to detecting any type of first motion, the motion detection section 31 may supply the execution instruction section 34 with identification information (also referred to as a motion ID) corresponding to the type of the first motion.

[0030] (((Status data acquisition unit 32))) The status data acquisition unit 32 acquires status data indicating the status of the facility. The status data acquisition unit 32 may acquire the status data from one or more sensors installed in the facility, or may acquire the status data from an operator. The acquired status data may indicate, for example, whether the status of the facility is normal or abnormal. The status data acquisition unit 32 may supply the acquired status data to the execution instruction unit 34.

[0031] (((storage unit 33))) The storage unit 33 stores various types of information. The storage unit 33 may store a correspondence table 330.

[0032] The correspondence table 330 associates in advance the first actions detected by the action detection unit 31 with the second actions to be performed in the facility. The correspondence table 330 may associate multiple types of second actions with multiple types of first actions. The correspondence table 330 may associate the content of the second action with each action ID of the first action.

[0033] Here, the second operation may include one or more operations (also referred to as configuration operations). For example, the configuration operation may be work to be performed within a facility (for example, work at a work site within the facility). The work may include operating equipment, checking measurement values ​​using instruments, taking images of the facility, and maintaining equipment. Operating equipment may include increasing or decreasing a manipulated variable by a preset value. The measurement value checking operation may include transmitting the checked measurement value to the device 3 together with the time of checking, or may include transmitting an alert signal to the device 3 in response to the measurement value being outside the reference range. The imaging operation may include transmitting captured image data to the device 3 together with the time of taking the image. The maintenance operation may include at least one of inspecting, initializing, or replacing equipment.

[0034] The configuration operation may be movement within a facility. As an example, the configuration operation may be movement to a work site within the facility, or movement from the work site to a home position. The second operation may include sequential movement through multiple work sites within the facility. The work site may be a location within the facility where work is to be performed that is pre-associated with the first operation. The movement to the home position may be the final configuration operation among multiple configuration operations included in the second operation.

[0035] The second actions may differ from one another in at least one constituent action, or in the number or order of constituent actions. Different constituent actions may mean that at least a portion of the content of the constituent action (for example, the target of the constituent action or the location where the constituent action is performed) is different. The multiple types of second actions may each include moving to a different work site within the facility.

[0036] The correspondence table 330 may store the content of each constituent action included in the second action as the content of the second action. The correspondence table 330 may further store the name and action ID of the second action as the content of the second action.

[0037] The correspondence table 330 may further associate, with each second action, information (also referred to as destination identification information) for identifying a destination terminal 2 (also referred to as a destination terminal 2) to which an instruction to perform the second action should be sent. The destination identification information may include the terminal IDs of one or more terminals 2. When the destination identification information includes multiple terminal IDs, the terminals 2 corresponding to the respective terminal IDs may have the same functions, or may use the same location within the facility as their home positions. The destination identification information may include location information of a work site where the second action is performed. The location information of the work site may be used to identify a terminal 2 that is closest to the location information as the destination terminal 2.

[0038] (((Execution instruction unit 34))) In response to the detection of a first action by the action detection unit 31, the execution instruction unit 34 outputs an instruction to execute a second action that is pre-associated with the first action. In the present embodiment, as an example, the execution instruction unit 34 may output an instruction to execute a second action in response to the detection of a first action by the action detection unit 31 and the status data acquired by the status data acquisition unit 32 satisfying a reference condition. The reference condition may be arbitrarily set in advance. For example, the reference condition may be a condition that is met when the facility is normal and not satisfied when the facility is abnormal. Alternatively, the reference condition may be a condition that is met when the facility is abnormal and not satisfied when the facility is normal.

[0039] The execution instruction unit 34 may output to the terminal 2, for each type of first action detected by the action detection unit 31, an execution instruction for a different type of second action that is pre-associated with the type of first action. The execution instruction unit 34 may output, for the detected first action, an execution instruction for a second action that is associated in the correspondence table 330. The execution instruction for the second action may include the content of the second action. The execution instruction unit 34 may output the execution instruction by including the content of the second action stored in the correspondence table 330.

[0040] The execution instruction unit 34 may output an instruction to execute the second operation to the destination terminal 2 of the execution instruction. In the present embodiment, as an example, for each second operation for which an execution instruction is to be output, the execution instruction unit 34 may refer to the destination identification information associated with the second operation in the correspondence table 330, and determine the terminal 2 identified by the destination identification information as the destination terminal 2.

[0041] When the destination identification information includes a single terminal ID, the execution instruction unit 34 may determine the terminal 2 indicated by the terminal ID as the destination terminal 2. When the destination identification information includes multiple terminal IDs, the execution instruction unit 34 may determine any one of the multiple terminals 2 indicated by the multiple terminal IDs as the destination terminal 2. The execution instruction unit 34 may acquire, for each terminal 2, at least one of location information indicating the current location and operation information indicating whether the terminal is in operation from the state detection unit 35 described below, and may determine any one of the multiple terminals 2 as the destination terminal 2 based on the location information and operation information. As an example, the execution instruction unit 34 may determine, as the destination terminal 2, the terminal 2 closest to the work site indicated by the location information included in the destination identification information, among the multiple terminals 2 indicated by the multiple terminal IDs included in the destination identification information. The execution instruction unit 34 may determine, as the destination terminal 2, the terminal 2 that is not in operation, among the multiple terminals 2 indicated by the multiple terminal IDs included in the destination identification information. When outputting an instruction to execute the second operation to the destination terminal 2, the execution instruction unit 34 may supply the content of the second operation to the state detection unit 35 in association with the terminal ID of the destination terminal 2.

[0042] (((Status detection unit 35))) The state detection unit 35 detects the state of each terminal 2. The state detection unit 35 may communicate with each terminal 2 to obtain, for each terminal 2, location information indicating the current location of the terminal 2 and operation information indicating whether the terminal 2 is in operation.

[0043] The state detection unit 35 may be an example of an arrival detection unit, and may detect that a terminal 2 to which an instruction to perform a second operation including movement to a work site has been output has arrived at the work site. For example, when the execution instruction unit 34 supplies the terminal ID of the terminal 2 performing the second operation in association with the operation content of the second operation including movement to the work site, the state detection unit 35 may determine whether the terminal 2 has arrived at the work site based on location information acquired from the terminal 2 and location information of the work site included in the operation content. When the terminal 2 is an AR device, the state detection unit 35 may detect that the terminal 2 has arrived at the work site in response to the worker wearing the terminal 2. The state detection unit 35 may receive a completion report for each constituent operation of the second operation from the terminal 2 performing the second operation, and may detect that the terminal 2 has arrived at the work site in response to receiving a completion report for the movement operation included in the second operation.

[0044] The state detection unit 35 may be an example of a completion detection unit and may detect that the second operation has been completed. For example, if the second operation is completed by moving to the work site, that is, if the final component operation of the second operation is moving to the work site, the state detection unit 35 may detect that the second operation has been completed by detecting that the terminal 2 has arrived at the work site, as described above. If the second operation is completed by moving to a home position, the state detection unit 35 may determine whether the terminal 2 has arrived at the home position based on location information acquired from the terminal 2 and location information of the home position of the terminal 2. The state detection unit 35 may receive a completion report for each component operation of the second operation from the terminal 2 performing the second operation, and may detect that the second operation has been completed in response to receiving a completion report for the final component operation of the second operation.

[0045] The state detection unit 35 may supply the position information and operation information of each terminal 2 to the execution instruction unit 34 and the display control unit 36 ​​in association with the terminal ID of the terminal 2. For each terminal 2 to which an instruction to execute the second operation has been output, the state detection unit 35 may supply progress information indicating the progress of the second operation to the display control unit 36 ​​in association with the terminal ID of the terminal 2. The progress information may include information indicating each of the constituent operations included in the second operation that has not yet been completed.

[0046] (((Display Control 36))) The display control unit 36 ​​causes the display unit 37 to display various information.

[0047] For example, the display control unit 36 ​​displays to the operator information indicating second operations of a type that have not yet been executed among the second operations output to one or more terminals 2. In the present embodiment, the fact that a second operation has not yet been executed means, as an example, that the execution of the second operation has not been completed, but it may also mean that the execution of the second operation has not yet been started. The display control unit 36 ​​may display the details of the second operation as information indicating the second operation. Based on the progress information supplied from the state detection unit 35, the display control unit 36 ​​may display the details of each incomplete component operation among the component operations included in the unexecuted second operation.

[0048] The display control unit 36 ​​may cause the operator to see that the terminal 2 that executes the second operation including movement to the work site has not yet arrived at the work site until the state detection unit 35 detects that the terminal 2 has arrived at the work site. The display control unit 36 ​​may cause the operator to see that the terminal 2 has not yet arrived at the work site for each second operation. The display control unit 36 ​​may cause the operator to see that the terminal 2 has not yet arrived from the time the execution instruction is output to the terminal 2 until the arrival at the work site is detected. In response to the state detection unit 35 detecting that the terminal 2 has arrived at the work site, the display control unit 36 ​​may further cause the operator to see that the terminal 2 has arrived at the work site.

[0049] (((display section 37))) The display unit 37 displays information to the operator in accordance with the control of the display control unit 36. The display unit 37 may be any type of display device.

[0050] According to the above system 1, in response to detection of a first action by an operator, an instruction to perform a second action that is associated in advance with the first action and is to be performed within the facility is output to the destination terminal 2. Therefore, when the operator performs the first action, the second action can be performed within the facility.

[0051] Furthermore, since the system 1 is equipped with the device 3 and the terminal 2, an operator can have the device 3 detect the first action, and then have the second action performed within the facility via the terminal 2 of the system 1.

[0052] Furthermore, the first action includes a task performed by an operator within the facility, and in response to detection of the first action, an instruction to perform a second action including the task is output to a terminal 2 used within the facility. Therefore, when the operator performs the first action within the facility, the second action is performed within the facility, so that the tasks that should be performed in sequence within the facility can be performed efficiently.

[0053] Furthermore, since the terminal 2 is provided so as to be movable within the facility, the terminal 2 can be moved to perform the second operation.

[0054] The second action includes moving sequentially through a plurality of work sites within the facility. Therefore, when the operator performs the first action, the terminal 2 can move through a plurality of work sites within the facility.

[0055] Furthermore, the second operation includes movement to the work site, and until it is detected that terminal 2 has arrived at the work site, a message indicating that terminal 2 has not yet arrived is displayed to the operator. Therefore, it is possible to inform the operator that, among one or more constituent operations included in the second operation, the constituent operation of moving to the work site is incomplete. Therefore, even if the first operation has been performed, if the second operation is not completed because terminal 2 is moving, it is possible to prevent the operator from performing the first operation again.

[0056] Furthermore, in response to detection of the arrival of the terminal 2 at the work site, a message indicating the arrival is displayed to the operator. Therefore, it is possible to notify the operator that the constituent action of moving to the work site, among one or more constituent actions included in the second action, has been completed and work at the work site has begun.

[0057] Furthermore, for each type of detected first action, an instruction to execute a different type of second action is output to the terminal 2, and information indicating the types of second actions that have not yet been executed among the second actions for which an execution instruction has been output is displayed to the operator. Therefore, it is possible to inform the operator of the second actions that have not yet been executed among the multiple types of second actions for which an execution instruction has been output. This makes it possible to prevent the operator from performing the first action again in order to execute the second action that has not yet been executed.

[0058] Furthermore, when the first action is detected and the status data indicating the status of the facility satisfies the reference condition, an instruction to perform the second action is output, thereby preventing the second action from being performed by mistake in a state in which the second action should not be performed.

[0059] (operation) 2 shows the operation of the device 3. The device 3 performs the processes of steps S11 to S23 to output an execution instruction corresponding to the first action of the operator. The operation shown in this figure may be started by starting up the device 3.

[0060] In step S11, the motion detection unit 31 of the device 3 detects a first motion by an operator of the facility. The first motion may include a task by the operator (for example, operating equipment) or a gesture motion. For example, when the first motion includes a gesture motion, the display control unit 36 ​​may display a virtual space in which the facility is a three-dimensional model to the operator via a head-mounted display (not shown), and the operator may perform a gesture motion on equipment in the virtual space. The gesture motion may be a virtual operation on equipment installed in a control room or central management room in the virtual space, or may be a virtual operation on equipment installed at a work site in the virtual space. When a second motion is performed that includes, as a constituent motion, an operation of equipment that changes a manipulated variable, the first motion may include an action indicating the magnitude by which the manipulated variable is increased or decreased.

[0061] In step S13, the status data acquisition unit 32 acquires status data of the facility. The status data acquisition unit 32 may acquire the status data from one or more sensors provided in the facility.

[0062] In step S15, the execution instruction unit 34 determines whether the status data acquired in step S13 satisfies the standard condition. If it is determined that the status data does not satisfy the standard condition (step S15; No), the process may proceed to step S17. If it is determined that the status data satisfies the standard condition (step S15; Yes), the process may proceed to step S19.

[0063] In step S17, the display control unit 36 ​​displays an error message via the display unit 37. The error message may include a message indicating that the status data does not satisfy the reference condition, or may include a message indicating that the second action corresponding to the first action cannot be performed within the facility. When the processing of step S17 is completed, the processing may proceed to step S11 described above.

[0064] In step S19, the execution instruction unit 34 identifies a second action that is previously associated with the first action detected in step S11. The execution instruction unit 34 may identify a second action that is associated in the correspondence table 330 with the detected first action.

[0065] In step S21, the execution instruction unit 34 selects the destination terminal 2 to which the execution instruction for the identified second operation is to be output. The execution instruction unit 34 may select the destination terminal 2 by referring to the destination identification information in the correspondence table.

[0066] In step S23, the execution instruction unit 34 outputs an instruction to execute the second operation identified in step S19 to the destination terminal 2 selected in step S21. As a result, the second operation is executed by the destination terminal 2 or by the worker carrying the destination terminal 2. If the destination terminal 2 is an AR device worn by the worker, the content of the second operation may be displayed on a transparent display to prompt the worker to perform the second operation. Each time a configuration operation is completed, the destination terminal 2 may transmit a completion report to the device 3 automatically or in response to an operation by the worker.

[0067] When step S23 is completed, the process may proceed to step S11 described above. As a result, when the process of step S11 is performed multiple times and multiple types of first actions are detected, instructions to perform multiple types of second actions that are pre-associated with the multiple types of first actions may be output to multiple destination terminals 2. These multiple types of second actions may each include traveling to a different work site within the facility.

[0068] According to the above operation, instructions to perform multiple types of second operations associated with the first operation are output to multiple terminals 2, and the multiple types of second operations each include moving to a different work site within the facility. Therefore, by the operator performing multiple types of first operations, it is possible to move the multiple terminals 2 to different work sites within the facility.

[0069] 3 shows another operation of the device 3. By performing the processes of steps S41 to S55, the device 3 displays to the operator the progress of the second operation for which an execution instruction has been output. Note that the operation in this figure may be started in response to an execution instruction for the second operation being output to the destination terminal 2 by the process of step S23 described above, and may be performed in parallel with the operation in FIG. 2 for each second operation.

[0070] In step S41, the display control unit 36 ​​displays, via the display unit 37, information indicating the second action (also referred to as the target second action) for which an execution instruction was output in step S23. In the present embodiment, as an example, the display control unit 36 ​​may display the content of each constituent action included in the target second action in an area displaying each incomplete second action (also referred to as the display area for incomplete actions). When information indicating the second action is already displayed in the display area for the incomplete action, the display control unit 36 ​​may display information about the target second action in addition to the already displayed information.

[0071] In step S43, the state detection unit 35 determines whether the target second action includes movement of the destination terminal 2 to the work site. If it is determined that the second action includes movement to the work site (step S43; Yes), the process may proceed to step S45. If it is determined that the second action does not include movement to the work site (step S43; No), the process may proceed to step S47.

[0072] In step S45, the display control unit 36 ​​displays, via the display unit 37, that the terminal 2 has not yet arrived at the work site. In the present embodiment, as an example, the display control unit 36 ​​may add a mark indicating that the terminal 2 has not yet arrived (also referred to as a not-arrived mark) to each movement action to the work site among the contents of each constituent action of the target second action displayed in the display area for the uncompleted action.

[0073] In step S47, the state detection unit 35 receives a completion report for the constituent operations of the second operation from the destination terminal 2. The state detection unit 35 may wait until it receives the completion report from the destination terminal 2.

[0074] In step S49, the display control unit 36 ​​determines whether the movement to the work site has been completed. The display control unit 36 ​​may determine that the movement has been completed in response to the fact that the completion report received in step S47 is for the movement to the work site. If it is determined that the movement to the work site has been completed (step S49: Yes), the process may proceed to step S51. If it is determined that the movement to the work site has not been completed (step S49: No), the process may proceed to step S53.

[0075] In step S51, the display control unit 36 ​​deletes the not-yet-arrived mark for the relevant movement operation from among the not-yet-arrived marks attached to each movement operation to the work site in the display area for uncompleted operations. The display control unit 36 ​​may delete the not-yet-arrived mark attached to the movement operation corresponding to the completion report received in step S47.

[0076] In step S53, the display control unit 36 ​​determines whether the entire second operation has been completed. The display control unit 36 ​​may determine that the second operation has been completed if the completion report received in step S47 is for the last constituent operation of the second operation. If it is determined that the second operation has not been completed (step S53: No), the process may proceed to step S47 described above. If it is determined that the second operation has been completed (step S53: Yes), the process may proceed to step S55.

[0077] In step S55, the display control unit 36 ​​deletes the entire content of the second action displayed in step S41 from the content of each second action displayed in the display area for the uncompleted action. When the processing of step S55 is completed, the processing of this figure for the second action may end.

[0078] (Example of operation) 4 shows a correspondence table 330. The correspondence table 330 may store an action ID of a first action, the content of a second action, and destination identification information for selecting a destination terminal 2, in association with each other. In the correspondence table 330 shown in this figure, as an example, a first action with an action ID of "1-0001" is associated with a second action with an action ID of "2-0011" and an action name of "starting device X," and destination identification information including terminal IDs such as "terminal I," "terminal II," and so on, and the second action has constituent actions of "move to position A," "start device X," and "move to home position." In addition, a first action with an action ID of "1-0002" is associated with a second action with an action ID of "2-0012" and an action name of "take an image at position B," and destination identification information of "position B," and the second action has constituent actions of "move to position B," "take an image," and so on.

[0079] FIG. 5 shows a display area for uncompleted actions displayed on the display unit 37. The display area for uncompleted actions may display the details of each second action that has not been completed after an execution instruction has been output. As an example, the display area in this figure displays the details of the second action with action ID "2-0011" and the second action with action ID "2-0012" in FIG. 4. Furthermore, among the constituent actions of these second actions, the movement action to the work site, "movement to position B," is marked with a not-yet-arrived mark M. Note that in this figure, the terminal ID of the terminal 2 in charge of the second action, i.e., the destination terminal 2 of the execution instruction, is displayed for each second action.

[0080] (Variation) In the above embodiment, the second operation is executed when an instruction to execute the second operation is output to the destination terminal 2. However, the destination terminal 2 may suspend execution of the second operation when it detects an abnormality in the facility. The destination terminal 2 may detect an abnormality when it receives an alert signal from the facility, the device 3, or another terminal, or when a measurement value acquired within the facility falls outside a reference range. If the destination terminal 2 is a robot, the destination terminal 2 may suspend execution of the second operation and execute another preset operation. If the destination terminal 2 is a portable terminal carried by a worker, the destination terminal 2 may prompt the worker to suspend execution of the second operation and execute another preset operation. The other operation executed instead of the second operation may be an operation that must be performed urgently, such as an operation to resolve the abnormality, an operation to shut down at least a portion of the facility, or an operation to capture an image of the location where the abnormality occurred. This allows the emergency operation to be performed with priority when an abnormality occurs.

[0081] Additionally or alternatively, when an instruction to execute a second action is output, the instruction to execute the second action may be canceled. For example, the action detection unit 31 may further detect a third action (also referred to as a cancel action) by the operator. In response to detecting the cancel action, the action detection unit 31 may provide the execution instruction unit 34 with information indicating this (for example, identification information unique to the cancel action). After an instruction to execute a second action including movement to a work site is output, the execution instruction unit 34 may cancel the instruction to execute the second action in response to the action detection unit 31 detecting the cancel action before detecting that the terminal 2 has arrived at the work site. The execution instruction unit 34 may output a cancellation signal to the destination terminal 2 that output the instruction to execute the second action. The cancellation signal may include an instruction to stop the second action and may further include an instruction for the destination terminal 2 to move to the home position. When the instruction to execute the second action is canceled after the content of the second action is displayed in the display area for the incomplete action, the display control unit 36 ​​may delete the entire content of the second action from the display area for the incomplete action. In this way, when the instruction to perform the second operation is canceled by a cancel operation by the operator, the execution of the operation can be canceled before the operation at the work site begins. Therefore, it is possible to prevent the operation at the work site from being executed in cases where the situation in the facility changes after the execution of the first operation, making the operation at the work site unnecessary, or in cases where the first operation is executed by mistake.

[0082] Furthermore, although the execution instruction unit 34 has been described as selecting a terminal 2 that is not in operation as the destination terminal 2, it may also select a terminal 2 that is in operation as the destination terminal 2. As an example, the execution instruction unit 34 may output an execution instruction for one second operation to the same terminal 2, and then output an execution instruction for another second operation before the completion of the one second operation. In this case, the destination terminal 2 may execute each second operation in order from the execution instruction that was output first.

[0083] Furthermore, although the device 3 has been described as including the status data acquisition unit 32, the storage unit 33, the status detection unit 35, the display control unit 36, and the display unit 37, any of these may be omitted. If the device 3 does not include the status data acquisition unit 32, the execution instruction unit 34 may output an instruction to execute a second action regardless of the status of the facility in response to the detection of the first action by the action detection unit 31. If the device 3 does not include the storage unit 33, the correspondence table 330 may be stored in a storage device externally connected to the device 3. If the device 3 does not include the status detection unit 35, the display control unit 36 ​​may not display a message indicating that the destination terminal 2 has not yet arrived at the work site, or may not display information about a type of second action that has not yet been executed, among the second actions for which an execution instruction has been output.

[0084] Furthermore, although the terminal 2 has been described as being movable within the facility, it may be fixed within the facility. In this case, multiple terminals 2 may be provided at each work site, and the content of the second action may be displayed on the destination terminal 2 to which the execution instruction has been output, allowing the worker to execute the second action.

[0085] Various embodiments of the present invention may be described with reference to flowcharts and block diagrams, where the blocks may represent (1) stages of a process in which operations are performed or (2) sections of an apparatus responsible for performing the operations. Particular stages and sections may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable medium, and / or a processor provided with computer-readable instructions stored on a computer-readable medium. Dedicated circuitry may include digital and / or analog hardware circuitry, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuitry may include reconfigurable hardware circuitry, including logical AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, memory elements such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like.

[0086] A computer-readable medium may include any tangible device capable of storing instructions that are executed by an appropriate device, such that the computer-readable medium having instructions stored thereon comprises an article of manufacture containing instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable media may include electronic, magnetic, optical, electromagnetic, and semiconductor storage media. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick, integrated circuit card, and the like.

[0087] The computer readable instructions may include either assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0088] The computer-readable instructions may be provided to a processor or programmable circuit of a programmable data processing device, such as a computer, locally or over a wide area network (WAN) such as a local area network (LAN) or the Internet, and the computer-readable instructions may be executed to create means for performing the operations specified in the flowcharts or block diagrams. Here, the computer may be a personal computer (PC), a tablet computer, a smartphone, a workstation, a server computer, a general-purpose computer, a special-purpose computer, or the like, or may be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system, and is a broad definition of computer. In a distributed computing system, the multiple computers collectively execute a program by each executing a portion of the program and passing data between the computers as needed during program execution.

[0089] Examples of processors include a computer processor, a central processing unit (CPU), a processing unit, a microprocessor, a digital signal processor, a controller, a microcontroller, etc. A computer may have one or more processors. In a multiprocessor system with multiple processors, each processor executes a portion of a program and passes data between processors as needed during program execution, allowing the multiple processors to collectively execute a program. For example, in multitasking, each of the multiple processors may execute a portion of each task in small chunks by switching tasks at time slice intervals. In this case, which portion of a program each processor executes changes dynamically. Which portion of a program each of the multiple processors executes may also be statically determined by multiprocessor-aware programming.

[0090] 6 illustrates an example of a computer 1200 in which aspects of the present invention may be embodied, in whole or in part. Programs installed on the computer 1200 may cause the computer 1200 to function as or perform operations associated with an apparatus or one or more sections of the apparatus according to embodiments of the present invention, and / or to perform a process or steps of a process according to embodiments of the present invention. Such programs may be executed by the CPU 1212 to cause the computer 1200 to perform specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

[0091] A computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, a graphics controller 1216, and a display device 1218, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224 such as a hard disk drive, a DVD-ROM drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The computer also includes legacy input / output units such as a ROM 1230 and a keyboard 1242, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0092] The CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into the graphics controller 1216 itself, and causes the image data to be displayed on the display device 1218.

[0093] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD-ROM drive 1226 reads programs or data from a DVD-ROM 1227 and provides the programs or data to the storage device 1224 via the RAM 1214. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0094] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or programs that depend on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0095] The programs are provided by a computer-readable medium such as a DVD-ROM 1227 or an IC card. The programs are read from the computer-readable medium, installed in the storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and causes cooperation between the programs and the various types of hardware resources described above. An apparatus or a method may be configured by implementing information manipulation or processing in accordance with the use of the computer 1200.

[0096] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded into the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer processing area provided in the RAM 1214, the storage device 1224, the DVD-ROM 1227, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer processing area or the like provided on the recording medium.

[0097] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, the DVD-ROM drive 1226 (DVD-ROM 1227), an IC card, etc. to be read into the RAM 1214, and perform various types of processing on the data in the RAM 1214. The CPU 1212 then writes back the processed data to the external recording medium.

[0098] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. CPU 1212 may perform various types of processing on data read from RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to RAM 1214. CPU 1212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored on the recording medium, CPU 1212 may search for an entry that matches a condition specified by the attribute value of the first attribute from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0099] The above-described programs or software modules may be stored in a computer-readable medium on or near the computer 1200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable medium, thereby providing the programs to the computer 1200 via the network.

[0100] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.

[0101] It should be noted that the execution order of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order. [Explanation of symbols]

[0102] 1 System 2. Terminal 3 equipment 31 Motion detection unit 32 Status data acquisition unit 33 Storage section 34 Execution instruction section 35 Status detection unit 36 Display control unit 37 Display section 330 compatible table 1200 Computer 1210 host controller 1212 CPU 1214 RAM 1216 Graphics Controller 1218 Display Devices 1220 Input / Output Controller 1222 communication interface 1224 Storage device 1226 DVD-ROM drive 1227 DVD-ROM 1230 ROM 1240 Input / Output Chip 1242 keyboard

Claims

1. a motion detection unit that detects a first motion by an operator of the facility; an execution instruction unit that outputs, in response to the detection of the first action by the action detection unit, an execution instruction for a second action that is to be performed within the facility and that is associated with the first action in advance, to a terminal that is a destination of the execution instruction; An apparatus comprising:

2. the first operation includes work performed by the operator within the facility; The device according to claim 1 , wherein the execution instruction unit outputs the execution instruction for the second operation including work to be performed within the facility to the terminal used within the facility.

3. The device according to claim 1 , wherein the terminal is movably mounted within the facility.

4. the second operation includes traveling to a work site within the facility that is pre-associated with the first operation; The device comprises: an arrival detection unit that detects that the terminal has arrived at the work site; a display control unit that displays to the operator that the terminal has not yet arrived at the work site until the arrival detection unit detects that the terminal has arrived at the work site; The apparatus of claim 3 further comprising:

5. The device according to claim 4 , wherein the display control unit further displays to the operator that the terminal has arrived at the work site in response to the arrival detection unit detecting that the terminal has arrived at the work site.

6. the second operation includes working at the work site; the action detection unit further detects a third action by the operator; 5. The device according to claim 4, wherein the execution instruction unit cancels the instruction to execute the second operation in response to the third operation being detected by the operation detection unit before the arrival detection unit detects that the terminal has arrived at the work site.

7. The apparatus of claim 3 , wherein the second operation includes sequentially moving through a plurality of work sites within the facility that are pre-associated with the first operation.

8. the execution instruction unit outputs, to the plurality of terminals, execution instructions for a plurality of types of second actions that are associated in advance with a plurality of types of first actions; The apparatus of claim 3 , wherein the plurality of second actions each include traveling to a different work site within the facility.

9. the motion detection unit is capable of detecting a plurality of types of the first motion, the execution instruction unit outputs, for each type of the first action detected by the action detection unit, an execution instruction for a different type of the second action associated in advance with the type of first action to the terminal; The device comprises: a completion detection unit that detects that the second operation has been completed; The device according to claim 1 , further comprising a display control unit that displays to the operator information indicating a type of second operation that has not yet been performed, among the second operations for which an execution instruction has been output to the terminal.

10. a status data acquisition unit that acquires status data indicating a status of the facility; The device according to claim 1 , wherein the execution instruction unit outputs an instruction to execute the second action in response to the first action being detected by the action detection unit and the status data satisfying a reference condition.

11. A device according to any one of claims 1 to 10; a terminal that receives an instruction to execute the second operation output from the execution instruction unit in the device; and A system comprising:

12. The terminal The system according to claim 11 , wherein, in response to detecting an abnormality in the facility, execution of the second action is interrupted and another preset action is executed.

13. a motion detection step of detecting a first motion by an operator of the facility; an execution instruction step of outputting, in response to the first action being detected in the action detection step, an execution instruction for a second action to be performed within the facility, which is associated in advance with the first action, to a terminal that is a destination of the execution instruction; A method for providing the above.

14. When executed by a computer, the computer a motion detection unit that detects a first motion by an operator of the facility; an execution instruction unit that outputs, in response to the detection of the first action by the action detection unit, an execution instruction for a second action that is to be performed within the facility and that is associated in advance with the first action, to a terminal that is a destination of the execution instruction. A program that functions as a

Images