Apparatus, method, and program

Abstract

The present invention relates to an apparatus, a method, and a program.SOLUTION: There is provided an apparatus including an operation detection unit configured to detect a plurality of types of operations performed by an operator to operate a facility, a storage unit configured to store a plurality of first operation sequences including a plurality of operations detected by the operation detection unit, an extraction unit configured to extract two or more operations of which a probability of being consecutively executed is higher than a reference probability from the plurality of first operation sequences stored in the storage unit, and an output unit configured to output a second operation sequence including the two or more operations extracted by the extraction unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an apparatus, a method, and a program. [Background technology]

[0002] Patent Documents 1 to 6 state that "the operation contents of the operator are recorded, and the recorded contents are edited to display examples of appropriate operation procedures, etc." (Patent Document 1, paragraph 0001). [Prior art document] [Patent documents] [Patent Document 1] JP 2000-081908 A [Patent Document 2] JP 2000-270430 A [Patent Document 3] JP 2010-160818 A [Patent Document 4] JP 2019-023803 A [Patent Document 5] Special Publication No. 2022-528482 [Patent Document 6] JP ​​2019-003545 A Summary of the Invention

[0003] In a first aspect of the present invention, there is provided an apparatus comprising: an action detection unit that detects multiple types of actions performed by an operator to operate equipment; a memory unit that stores multiple first action sequences including the multiple actions detected by the action detection unit; an extraction unit that extracts two or more actions from the multiple first action sequences stored in the memory unit, the two or more actions having a probability of being executed consecutively that is higher than a reference probability; and an output unit that outputs a second action sequence including the two or more actions extracted by the extraction unit.

[0004] In the above device, the memory unit may store a plurality of the first operation sequences for each operation content for the equipment, and the extraction unit may extract the two or more operations from the plurality of first operation sequences corresponding to a common operation content.

[0005] In the above device, the extraction section may extract, for each operation content, the two or more actions from the plurality of first action sequences corresponding to the operation content.

[0006] Any of the above devices may further include an acquisition unit that acquires status data related to the equipment, wherein the memory unit stores status data associated with each first operation sequence when the operation of the first operation sequence is performed, and the extraction unit may select multiple status data from each status data stored in the memory unit based on similarity to status data at a certain point in time, and extract the two or more operations from multiple first operation sequences corresponding to the selected multiple status data.

[0007] In any of the above devices, the memory unit may further store, for each of at least one other piece of equipment that has a common operation with the equipment, a plurality of first operation sequences including a plurality of operations performed by other operators to operate the other piece of equipment, and the extraction unit may extract the two or more operations from the plurality of first operation sequences stored in the memory unit for each piece of equipment.

[0008] In any of the above devices, the extraction section may identify the two or more actions from the plurality of first action sequences by performing statistical processing on the plurality of first action sequences.

[0009] In any of the above devices, the memory unit may further store the second operation sequence, and the device may further include a first sequence selection unit that selects one of the second operation sequences stored in the memory unit in response to an operation by an operator, and the output unit may output the second operation sequence selected by the first sequence selection unit from the plurality of second operation sequences stored in the memory unit.

[0010] Any of the above devices may further include an action selection unit that selects two or more actions from any of the first action sequences stored in the memory unit in response to an operator's operation, and the output unit may further output a third action sequence that includes the two or more actions selected by the action selection unit.

[0011] In the above device, the memory unit may further store the third operation sequence, and the device may further include a second sequence selection unit that selects one of the third operation sequences stored in the memory unit in response to an operation by an operator, and the output unit may output the third operation sequence selected by the second sequence selection unit from the plurality of third operation sequences stored in the memory unit.

[0012] Any of the above devices may further include a display unit that displays a virtual space in which the equipment is three-dimensionally modeled to the operator, and the action detection unit may detect actions performed by the operator who is viewing the virtual space.

[0013] In the above device, the output unit may display the virtual space to another operator different from the operator via the display unit, and may also display an avatar performing each action of the second action sequence by superimposing it on the field of view within the virtual space.

[0014] In any of the above devices, the output section may display the second operation sequence to another operator different from the operator.

[0015] Any of the above devices may further include a transmitter that transmits an operation signal corresponding to the second operation sequence output from the output unit to the facility.

[0016] In the above device, the two or more actions may include an action of changing an operation amount of the equipment.

[0017] In any of the above devices, each of the two or more actions may be an action on the equipment.

[0018] In a second aspect of the present invention, there is provided a method comprising: an action detection step of detecting multiple types of actions performed by an operator to operate equipment; a storage step of storing a first action sequence including the multiple actions detected by the action detection step; an extraction step of extracting two or more actions from the multiple first action sequences stored by the storage step, the two or more actions having a probability of being executed consecutively that is higher than a reference probability; and an output step of outputting a second action sequence including the two or more actions extracted by the extraction step.

[0019] In a third aspect of the present invention, there is provided a program that, when executed by a computer, causes the computer to function as an action detection unit that detects multiple types of actions performed by an operator to operate equipment, a memory unit that stores a first action sequence including the multiple actions detected by the action detection unit, an extraction unit that extracts two or more actions that have a probability of being executed consecutively higher than a reference probability from the multiple first action sequences stored in the memory unit, and an output unit that outputs a second action sequence including the two or more actions extracted by the extraction unit.

[0020] The above summary of the invention does not list all of the necessary features of the present invention, and subcombinations of these features may also constitute inventions. [Brief explanation of the drawings]

[0021] [Figure 1] 1 shows a device 1 according to an embodiment. [Figure 2] 1 shows a storage manner of the detection operation sequence 1051 and the state data by the storage unit 105. [Figure 3] 10 shows how the standard operation sequence 1052 is stored in the storage unit 105. [Figure 4] The storage operation of the detection operation sequence 1051 is shown. [Figure 5] The storage operation of the standard operation sequence 1052 is shown. [Figure 6] The storage operation of the emergency operation sequence 1053 is shown. [Figure 7] The output operation of the sequence is shown. [Figure 8] 22 illustrates an example computer 2200 in which aspects of the present invention may be embodied, in whole or in part. DETAILED DESCRIPTION OF THE INVENTION

[0022] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0023] (device 1) 1 shows a device 1 according to this embodiment. The device 1 supports the operation of equipment and includes a display unit 101, an input unit 102, an action detection unit 103, an acquisition unit 104, a storage unit 105, an extraction unit 106, an action selection unit 107, a sequence selection unit 108, and an output unit 109.

[0024] Here, the facility may be equipped with a plurality of devices. For example, the facility may be a plant or a composite device that combines a plurality of devices. Examples of plants include industrial plants such as chemical and biotech plants, plants that manage and control wellheads and surrounding areas of gas and oil fields, plants that manage and control power generation such as hydroelectric, thermal, and nuclear power, plants that manage and control environmental power generation such as solar and wind power, and plants that manage and control water supply and sewage systems, dams, etc.

[0025] The equipment may be an instrument, a machine, or a device. For example, the equipment may be an actuator such as a valve, pump, heater, fan, motor, or switch that controls at least one physical quantity, such as pressure, temperature, pH, speed, or flow rate, in a process of the facility, or a controller that controls the actuator. The equipment may also be a sensor or instrument that measures the status of the facility. The status of the facility may be the status of the facility itself (e.g., pressure, flow rate, temperature, pH, speed, power consumption, concentration, etc.) or the status of the product of the facility (e.g., purity, concentration, composition, viscosity, color, etc.). The equipment may also be a structure such as a pipe, a tank, a heat exchanger, a furnace, or a distillation column. Each piece of equipment in the facility may be displayed as an object in the virtual space of the facility by the display unit 101, which will be described later.

[0026] ((Display section 101)) The display unit 101 displays various information to one or more operators. For example, the display unit 101 may display a virtual space in which the facility is a three-dimensional model. In this case, the display unit 101 may display an avatar of the operator in the virtual space. Here, the avatar refers to an image such as a character image that represents the user or their actions, which is mainly used in communication.

[0027] The display unit 101 may include one or more display devices of any type. As an example, the display unit 101 may be a head-mounted display that is worn on the operator's head and displays a virtual space of the facility.

[0028] ((Input unit 102)) The input unit 102 receives various inputs from an operator via an input device such as a keyboard or a mouse. For example, when the operator performs an action to operate equipment, the input unit 102 may acquire information indicating the operation content from the operator. In the present embodiment, the information indicating the operation content may be, as an example, identification information (also referred to as an operation ID) according to the operation content. The input unit 102 may acquire the operation ID before the operator performs an action, and may supply a trigger signal to the action detection unit 103 and the acquisition unit 104 in response to acquiring the operation ID. The input unit 102 may supply the acquired operation ID to the storage unit 105.

[0029] ((Motion detection unit 103)) The action detection unit 103 detects a plurality of types of actions performed by an operator to operate equipment. The action detection unit 103 may detect a plurality of types of actions performed by an operator to operate a predetermined piece of equipment. In this embodiment, as an example, the operator whose actions are detected may be a veteran operator who is more skilled at operations than other operators.

[0030] The operator's actions may be actions to operate equipment arranged in the facility, actions to check the status of the facility, etc. The action to operate the equipment may be, for example, an action to change the manipulated variable of the facility, and as an example, an action to increase or decrease the manipulated variable by a reference amount. The action to check the status of the facility may be, for example, an action to check a measurement value or a switch state, and as an example, an action to change the gaze position within the facility. Each detected action may be a predetermined action.

[0031] The motion detection unit 103 may detect input motions to an input device such as a keyboard or a mouse, may detect gesture motions via a conventionally known motion capture system, or may detect gaze change motions via a conventionally known eye tracking system.

[0032] The motion detection unit 103 according to this embodiment may detect a motion performed by an operator viewing a virtual space. As an example, the motion detection unit 103 may detect a motion performed by the operator in the real space with the intention of performing it on equipment in the virtual space. In this case, the motion detection unit 103 may supply the content of the detected motion to the display unit 101 and cause an avatar in the virtual space to operate. However, the motion detection unit 103 may also detect a motion on equipment in the real space.

[0033] The motion detection unit 103 may detect the motion of the operator in response to a trigger signal being supplied from the input unit 102. However, the motion detection unit 103 may constantly detect the motion of the operator.

[0034] The motion detection unit 103 may, in response to detecting any type of motion, supply identification information (also referred to as motion ID) corresponding to the type of motion to the storage unit 105. In response to detecting multiple motions, the motion detection unit 103 may sequentially supply the motion IDs of each motion to the storage unit 105. In response to the lapse of a reference time (for example, 5 seconds) since the last detection of a motion related to the operation of equipment, the motion detection unit 103 may supply a signal indicating the end of continuous motion detection (also referred to as motion sequence end signal) to the storage unit 105. Additionally or alternatively, the motion detection unit 103 may supply an motion sequence end signal to the storage unit 105 in response to detecting a predetermined motion unrelated to the operation of equipment.

[0035] ((Acquisition part 104)) The acquisition unit 104 acquires status data related to the equipment. In the present embodiment, as an example, the acquisition unit 104 acquires the status data in response to a trigger signal being supplied from the input unit 102. Therefore, when a trigger signal is supplied to the acquisition unit 104 and the motion detection unit 103, the acquired status data may be data obtained when motion detection is performed by the motion detection unit 103. However, instead of acquiring status data in response to a trigger signal, the acquisition unit 104 may acquire status data at each reference interval.

[0036] The status data may include at least one value indicating a status of the equipment. The status of the equipment may be the status of the equipment itself or the status of the product of the equipment. The status of the equipment itself may be, for example, the pressure, flow rate, temperature, pH, speed, power consumption, or concentration inside the equipment, or may be a status indicating a process variable, for example. The status of the equipment may be the temperature, humidity, sunlight, wind direction, wind volume, or precipitation of the equipment's external environment, the amount of energy or raw material consumed by the equipment, the amount of greenhouse gas emissions, the yield, or the production cost. The status of the product may be a predetermined quality (for example, purity, concentration, composition, viscosity, or color) or the production volume.

[0037] The acquisition unit 104 may acquire current status data. For example, the acquisition unit 104 may acquire the current status data from one or more sensors provided in the equipment. However, the acquisition unit 104 may also acquire the current status data from an operator. The acquisition unit 104 may supply the acquired status data to the storage unit 105 and the extraction unit 106.

[0038] In addition, the acquisition unit 104 may acquire state data at a past point in time, for example, state data at a point in time in the past specified by an operator. In this case, the acquisition unit 104 may acquire state data at the specified point in time from the state data that has been supplied to and stored in the storage unit 105 in advance, and may supply the acquired state data to the extraction unit 106.

[0039] ((Storage unit 105)) The storage unit 105 stores various information. The storage unit 105 may store a plurality of first operation sequences (also referred to as detection operation sequences) 1051, one or more second operation sequences (also referred to as standard operation sequences) 1052, and one or more third operation sequences (also referred to as emergency operation sequences) 1053.

[0040] (((Detection operation sequence 1051))) Each detected operation sequence 1051 includes a plurality of operations detected by the operation detection unit 103. Each detected operation sequence 1051 may include the operation ID of each operation detected by the operation detection unit 103 in the order of detection. Each detected operation sequence 1051 may include each operation ID received before the operation sequence end signal is output by the operation detection unit 103.

[0041] Here, each detection operation sequence 1051 according to the present embodiment may include a series of operations performed by an operator to operate a predetermined piece of equipment. Among the multiple detection operation sequences 1051 stored in the storage unit 105, some detection operation sequences 1051 may have different operation contents for the equipment from other detection operation sequences 1051. The storage unit 105 according to the present embodiment may store multiple detection operation sequences 1051 for each operation content for the equipment. For example, the storage unit 105 may store each detection operation sequence 1051 in association with an operation ID supplied from the input unit 102 before the operation ID is supplied by the operation detection unit 103.

[0042] Here, the storage unit 105 may store status data when the operation of the detection operation sequence 1051 is performed, in association with each detection operation sequence 1051. In the present embodiment, as an example, the storage unit 105 may add status data to each detection operation sequence 1051. The status data when the operation of the detection operation sequence 1051 is performed may indicate the status of the equipment when any of the operations included in the detection operation sequence 1051 is performed. As an example, the status data when the operation of the detection operation sequence 1051 is performed may be status data acquired by the acquisition unit 104 in response to a trigger signal output from the input unit 102.

[0043] (((Standard Operating Sequence 1052))) Each standard operation sequence 1052 includes two or more operations extracted by the extraction unit 106, which will be described later. The standard operation sequence 1052 may indicate a standard order of operations for operating equipment. The extraction of operations by the extraction unit 106 and the specific contents of the standard operation sequences 1052 will be described in detail later. When a plurality of standard operation sequences 1052 are stored in the storage unit 105, some standard operation sequences 1052 may differ from other standard operation sequences 1052 in terms of operation contents for equipment. The storage unit 105 may store an operation ID corresponding to the operation contents of the standard operation sequence 1052, in association with each standard operation sequence 1052.

[0044] Here, the storage unit 105 may store status data indicating a status (also referred to as a recommended execution status) in which the operation of the standard operation sequence 1052 should be performed, in association with each standard operation sequence 1052. In the present embodiment, as an example, the storage unit 105 may add status data to each standard operation sequence 1052. Details of the status data associated with the standard operation sequence 1052 will be described later.

[0045] (((Emergency Operation Sequence 1053))) The emergency operation sequence 1053 includes two or more operations selected by the operation selection unit 107 described below. The emergency operation sequence 1053 may indicate an order of operations for operating the equipment in an emergency, such as when an abnormality occurs in the equipment. The selection of operations by the operation selection unit 107 and the specific content of the emergency operation sequence 1053 will be described in detail later. When a plurality of emergency operation sequences 1053 are stored in the memory unit 105, some emergency operation sequences 1053 may have different operation contents for the equipment from other emergency operation sequences 1053. The memory unit 105 may store an operation ID corresponding to the operation content of the emergency operation sequence 1053, in association with each emergency operation sequence 1053.

[0046] Here, the storage unit 105 may store status data indicating a recommended execution status in which the operation of the emergency operation sequence 1053 should be performed, in association with each emergency operation sequence 1053. In the present embodiment, as an example, the storage unit 105 may add status data to each emergency operation sequence 1053. The status data associated with the emergency operation sequence 1053 will be described in detail later.

[0047] ((Extraction part 106)) The extraction unit 106 extracts two or more operations (also referred to as consecutive operations) whose successive execution probability is higher than a reference probability from a plurality of detection operation sequences 1051 stored in the storage unit 105. Each of the extracted consecutive operations may be included in a standard operation sequence 1052.

[0048] The extraction unit 106 may identify consecutive actions from the multiple detection operation sequences 1051 by statistical processing of the multiple detection operation sequences 1051. For example, the extraction unit 106 may detect each action sequence consisting of at least two consecutive actions from the multiple detection operation sequences 1051 and calculate the number of occurrences of each action sequence. The number of occurrences of each action sequence that does not appear more than once in a single detection operation sequence 1051 may be the number of detection operation sequences 1051 that include the action sequence. The extraction unit 106 may calculate the accuracy of each action sequence using the formula: accuracy = (number of occurrences of target action sequence) / (number of occurrences of all action sequences). Note that in this formula, the target action sequence may be the action sequence whose accuracy is to be calculated. The extraction unit 106 may identify, among the multiple action sequences detected from the multiple detection operation sequences 1051, an action sequence whose accuracy is higher than a reference accuracy as a consecutive action (i.e., two or more actions that are executed consecutively with a probability higher than a reference accuracy). The reference accuracy may be any value.

[0049] The extraction unit 106 may extract consecutive actions from a plurality of detected action sequences 1051 corresponding to a common operation content (a common operation ID is used as an example in this embodiment). Each consecutive action may be an action on a piece of equipment. The consecutive actions may include, for example, an action that changes the amount of operation of the equipment.

[0050] The extraction unit 106 may extract, for each operation content, consecutive actions from a plurality of detection operation sequences 1051 corresponding to the operation content. That is, the extraction unit 106 may extract consecutive actions for each of a plurality of operation contents. In the present embodiment, as an example, the extraction unit 106 may select, for each operation ID stored in the storage unit 105, a plurality of detection operation sequences 1051 associated with the ID, and extract consecutive actions from the selected plurality of detection operation sequences 1051.

[0051] The extraction unit 106 may extract consecutive actions from a plurality of detection operation sequences 1051 that have been narrowed down using the state data. For example, the extraction unit 106 may select a plurality of state data from each of the state data stored in the storage unit 105 in association with each detection operation sequence 1051, based on the similarity to the state data at a certain time point. The extraction unit 106 may use the distance between the state data (for example, Euclidean distance) as the similarity, and may select a plurality of state data from each of the state data stored in the storage unit 105, whose similarity to the state data at a certain time point is equal to or greater than a reference similarity. The certain time point may be the current time point or an arbitrary past time point designated by the operator. The reference similarity may be set to an arbitrary value in advance. The extraction unit 106 may extract consecutive actions from a plurality of detection operation sequences 1051 corresponding to the selected plurality of state data. As a result, consecutive actions are extracted from the detection operation sequences 1051 detected in a state close to the current time point or an arbitrary past time point.

[0052] Here, when the extraction unit 106 extracts consecutive actions from a plurality of detection operation sequences 1051 narrowed down using status data, the extraction unit 106 may further determine a recommended state for execution of a standard operation sequence 1052 including the consecutive actions. For example, when the extraction unit 106 selects a plurality of status data from a plurality of status data stored in the storage unit 105 in association with each detection operation sequence 1051 based on similarity to status data at a certain point in time, the extraction unit 106 may determine a state indicated by the status data at the certain point in time as a recommended state for execution. Alternatively, the extraction unit 106 may determine a state indicated by status data within a range of a reference similarity from the status data at the certain point in time as a recommended state for execution.

[0053] The extraction unit 106 may include the extracted consecutive actions in a standard action sequence 1052 and store the same in the storage unit 105. In the present embodiment, as an example, the extraction unit 106 may arrange the action IDs of the actions in the consecutive actions in order to create the standard action sequence 1052. When the extraction unit 106 determines the recommended execution state of the standard action sequence 1052, it may add state data indicating the recommended execution state to the standard action sequence 1052 and store the state data.

[0054] ((Operation selection unit 107)) The action selection unit 107 selects two or more actions from any of the detection action sequences 1051 stored in the memory unit 105 in response to an operation by an operator (for example, an experienced operator). The action selection unit 107 may select any action in response to an operation by the operator. For example, the action selection unit 107 may cause the display unit 101 to display at least one detection action sequence 1051 stored in the memory unit 105 (for example, the most recently stored detection action sequence 1051) in response to an operation by the operator, and may select any two or more actions included in the detection action sequence 1051. The action selection unit 107 may select all of the actions included in the detection action sequence 1051. Each of the selected actions may be included in the emergency action sequence 1053.

[0055] The action selection unit 107 may further determine a recommended state for execution of the emergency action sequence 1053. For example, the action selection unit 107 may determine, as the recommended state for execution, a state indicated by state data stored in the storage unit 105 in association with the detection action sequence 1051 from which the actions to be included in the emergency action sequence 1053 were selected. Alternatively, the extraction unit 106 may determine, as the recommended state for execution, a state indicated by state data within a range of a reference similarity from the state data.

[0056] The action selection unit 107 may include the two or more selected actions in an emergency action sequence 1053 and store the same in the storage unit 105. In the present embodiment, as an example, the action selection unit 107 may arrange the action IDs of the selected actions in order to create the emergency action sequence 1053. When the action selection unit 107 determines a recommended execution state for the emergency action sequence 1053, it may add state data indicating the recommended execution state to the emergency action sequence 1053 and store the state data.

[0057] ((Sequence selection unit 108)) The sequence selection unit 108 is an example of a first sequence selection unit and a second sequence selection unit, and selects any one of the standard operation sequences 1052 or emergency operation sequences 1053 stored in the storage unit 105 in response to an operation by an operator (for example, an experienced operator). For example, the sequence selection unit 108 may list the standard operation sequences 1052 or emergency operation sequences 1053 stored in the storage unit 105 and display them on the display unit 101 in response to an operation by the operator, and may select any one of the displayed sequences. The sequence selection unit 108 may supply the selected standard operation sequence 1052 or emergency operation sequence 1053 to the output unit 109.

[0058] ((output unit 109)) The output unit 109 outputs the standard operation sequence 1052 generated by the extraction unit 106. The output unit 109 according to this embodiment may output the standard operation sequence 1052 selected by the sequence selection unit 108 from the multiple standard operation sequences 1052 stored in the storage unit 105.

[0059] The output unit 109 may further output the emergency operation sequence 1053 generated by the operation selection unit 107. The output unit 109 may output the emergency operation sequence 1053 selected by the sequence selection unit 108 from the plurality of emergency operation sequences 1053 stored in the memory unit 105.

[0060] The output unit 109 may display at least one of the standard action sequence 1052 and the emergency action sequence 1053 via the display unit 101. The output unit 109 may display the sequences to one or more operators via the display unit 101, and may display at least one of the standard action sequence 1052 and the emergency action sequence 1053 to other operators (also referred to as rookie operators) who are different from veteran operators. As an example, the output unit 109 may display a virtual space to the rookie operator via the display unit 101, and may display an avatar performing each action in the standard action sequence 1052 or the emergency action sequence 1053 superimposed on the field of view within the virtual space. In this case, the avatar may be displayed semi-transparently as a so-called ghost. The output unit 109 may pre-store avatar actions associated with each action ID, and may cause the avatar to sequentially perform actions corresponding to the action IDs included in the standard action sequence 1052 or the emergency action sequence 1053.

[0061] The output unit 109 may store in advance explanatory text or diagrams that explain the operation contents in association with each operation ID. In this case, the output unit 109 may cause the display unit 101 to display explanatory text or the like of the operation contents that correspond to the operation IDs included in the standard operation sequence 1052 or the emergency operation sequence 1053.

[0062] According to the above-described device 1, consecutive actions whose successive execution accuracy is higher than a reference accuracy are extracted from a plurality of detected action sequences 1051 including a plurality of actions performed and detected to operate equipment, and a standard action sequence 1052 including the consecutive actions is output. Therefore, consecutive actions that do not include actions that are unnecessary for operating equipment or erroneous actions can be preferentially extracted, and therefore a standard action sequence 1052 including appropriate actions without waste can be generated and output.

[0063] Furthermore, multiple detection operation sequences 1051 are stored for each operation content for the equipment, and consecutive operations are extracted from the multiple detection operation sequences 1051 corresponding to a common operation content. Therefore, it is possible to generate and output a standard operation sequence 1052 including efficient and appropriate operations for performing an operation of one operation content.

[0064] Furthermore, for each operation content, consecutive operations are extracted from a plurality of detection operation sequences 1051 corresponding to the operation content. Therefore, it is possible to generate and output a standard operation sequence 1052 including efficient and appropriate operations for performing each of the plurality of operation contents.

[0065] Furthermore, from each stored state data, a plurality of state data are selected based on the similarity to the state data at a certain point in time, and consecutive operations are extracted from a plurality of detection operation sequences 1051 corresponding to the selected plurality of state data. Therefore, it is possible to generate and output a standard operation sequence 1052 including efficient and appropriate operations for performing operations according to the state of the equipment.

[0066] Furthermore, by performing statistical processing on the plurality of detection operation sequences 1051, consecutive operations are identified from the plurality of detection operation sequences 1051. Therefore, it is possible to generate and output with high accuracy a standard operation sequence 1052 that includes appropriate operations without waste.

[0067] Furthermore, a plurality of standard operation sequences 1052 are stored, and a standard operation sequence 1052 selected in response to an operation by an operator is output. Therefore, any one of the plurality of stored standard operation sequences 1052 can be output.

[0068] Furthermore, in response to an operation by the operator, an emergency operation sequence 1053 including two or more operations selected from any of the detection operation sequences 1051 is further output. Therefore, it is possible to arbitrarily generate and output an emergency operation sequence 1053 including operations with a low probability of being executed consecutively.

[0069] Furthermore, a plurality of emergency operation sequences 1053 are stored, and an emergency operation sequence 1053 selected in response to an operation by an operator is output. Therefore, any emergency operation sequence 1053 can be output from among the plurality of emergency operation sequences 1053 stored.

[0070] Furthermore, since the actions performed by the operator viewing the virtual space are detected, the standard action sequence 1052 can be generated from the actions performed on the equipment in the virtual space instead of the actions performed on the actual equipment.

[0071] Furthermore, since the standard operation sequence 1052 is displayed to the new operator, the standard operation sequence 1052 can be shown to the new operator.

[0072] Furthermore, a virtual space is displayed to the new operator, and each action in the standard action sequence 1052 is performed by an avatar, superimposed on the field of view within the virtual space. Therefore, the standard action sequence 1052 can be shown to the new operator by the movements of the avatar.

[0073] Furthermore, since each of the two or more operations included in the standard operation sequence 1052 is an operation for the equipment, it is possible to prevent an operation unrelated to the equipment from being included in the standard operation sequence 1052.

[0074] (Storage state of storage unit 105) FIG. 2 shows how the storage unit 105 stores detection operation sequences 1051. The storage unit 105 may store, in association with each detection operation sequence 1051, an operation ID corresponding to the operation content and status data at the time the operation was performed. In this figure, as an example, detection operation sequences 1051 and status data for operation IDs "D0001," "D0003," "D0004," ... are stored in association with operation ID "S001," and detection operation sequences 1051 and status data for operation IDs "D0001," "D0011," "D0003," "D0004," ... are stored in association with operation ID "S002." Among these, the operation with operation ID "D0011" is an operation for viewing equipment unrelated to the operation and may be an operation unnecessary for operating the equipment.

[0075] 3 shows how the storage unit 105 stores standard operation sequences 1052. The storage unit 105 may store, in association with each standard operation sequence 1052, an operation ID corresponding to the operation content and status data indicating a recommended execution status. In this figure, as an example, standard operation sequences 1052 with operation IDs "D0001," "D0003," "D0004," ... are stored in association with operation ID "S001." As shown in this figure, the standard operation sequence 1052 corresponding to the operation content of operation ID "S001" does not include the operation with operation ID "D0011," which is unrelated to the operation.

[0076] (operation) ((Storage of detection operation sequence 1051)) 4 shows the storage operation of the detection operation sequence 1051. The device 1 may store the detection operation sequence 1051 in the storage unit 105 by performing the processes of steps S11 to S17. The operation in this figure may be started in response to the operator inputting an operation ID.

[0077] In step S11, the input unit 102 acquires an operation ID in response to an operation by the operator. The operation ID acquired in step S11 may indicate the operation content by the action detected in step S13, which will be described later.

[0078] In step S13, the action detection unit 103 detects a plurality of types of actions performed by the operator to operate the equipment. The action detection unit 103 may end the processing of step S13 when a reference time has elapsed since the last action was detected.

[0079] In step S15, the acquisition unit 104 acquires status data relating to the equipment. The acquired status data may be data when the operation of the detection operation sequence 1051 was performed, and may be data at the current time, for example.

[0080] In step S17, the storage unit 105 stores the detected action sequence 1051 including the plurality of actions detected in step S13 in association with the state data acquired in step S15.

[0081] ((Storage of standard operating sequence 1052)) 5 shows the operation of storing the standard operation sequence 1052. The device 1 may generate the standard operation sequence 1052 and store it in the storage unit 105 by performing the processes of steps S21 to S29. The operation in this figure may be started in response to an operation to generate the standard operation sequence 1052 being performed by an operator.

[0082] In step S21, the input unit 102 acquires an operation ID in response to an operation by the operator. The operation ID acquired in step S21 may indicate the operation content of the standard operation sequence 1052 that the operator wishes to generate, and may be an operation ID associated with any of the detection operation sequences 1051 in the storage unit 105. In this operation, the input unit 102 may supply a trigger signal to the acquisition unit 104 without supplying it to the operation detection unit 103.

[0083] In step S23, the acquisition unit 104 acquires status data related to the equipment. The acquired status data may be data at the current time point or data at a past time point designated by the operator. The acquisition unit 104 may acquire past status data from the storage unit 105.

[0084] In step S25, the extraction unit 106 selects, from the plurality of detection operation sequences 1051 stored in the storage unit 105, a plurality of detection operation sequences 1051 that correspond to the operation ID acquired in step S21 and have a similarity to the state data acquired in step S23 that is equal to or greater than a reference similarity. Note that this diagram illustrates, as an example, a case in which the number of selected detection operation sequences 1051 exceeds a reference number. The reference number may be the number of detection operation sequences 1051 necessary for performing statistical processing in step S27, which will be described later. If the number of selected detection operation sequences 1051 is less than the reference number, a message to that effect may be displayed on the display unit 101, and the operation in this diagram may end.

[0085] In step S27, the extraction unit 106 extracts consecutive actions whose probability of being executed consecutively is higher than a reference probability from the selected plurality of detection operation sequences 1051. The extraction unit 106 may identify the consecutive actions to be extracted by performing statistical processing on the selected plurality of detection operation sequences 1051.

[0086] In step S29, the extraction unit 106 stores the standard action sequence 1052 including the consecutive actions extracted in step S27 in the storage unit 105. The extraction unit 106 may store the operation ID acquired in step S21 in the storage unit 105 in association with the standard action sequence 1052. The extraction unit 106 may store the state data acquired in step S23 in association with the standard action sequence 1052 as data indicating the recommended execution state of the standard action sequence 1052 in the storage unit 105. The extraction unit 106 may store the probability calculated for the consecutive actions in step S27 in association with the standard action sequence 1052.

[0087] ((Memory of Emergency Sequence 1053)) 6 shows the operation of storing the emergency operation sequence 1053. The device 1 may generate the emergency operation sequence 1053 and store it in the storage unit 105 by performing the processes of steps S31 to S37. The operation of this figure may be started in response to an operation to generate the emergency operation sequence 1053 being performed by an operator.

[0088] In step S31, the operation selection unit 107 causes the display unit 101 to display at least one detection operation sequence 1051 stored in the storage unit 105 (for example, the most recently stored detection operation sequence 1051) in response to an operation by the operator.

[0089] In step S33, the acquisition unit 104 acquires status data relating to the equipment. The acquired status data may be data at the current time, for example.

[0090] In step S35, the operation selection unit 107 selects two or more operations included in the detection operation sequence 1051 displayed in step S31 in response to an operation by the operator.

[0091] In step S37, the action selection unit 107 stores the two or more selected actions as an emergency action sequence 1053 in the storage unit 105. The extraction unit 106 may store the operation ID associated with the detection action sequence 1051 displayed in step S31 in the storage unit 105 in association with the emergency action sequence 1053. The action selection unit 107 may store the state data acquired in step S33 in the storage unit 105 in association with the emergency action sequence 1053 as data indicating a recommended state for execution of the emergency action sequence 1053.

[0092] ((Output of sequence)) 7 shows the sequence output operation. The device 1 may output a standard operation sequence 1052 or an emergency operation sequence 1053 by performing the processing of steps S41 to S53. The operation in this figure may be started in response to an operation to output a sequence by an operator. Note that while this figure shows an example in which the standard operation sequence 1052 is output, the emergency operation sequence 1053 may be output in addition to or instead of the standard operation sequence 1052 by similar processing.

[0093] In step S41, the sequence selection unit 108 determines whether or not an operation to narrow down the sequences to be output has been performed by the operator. If it is determined that an operation to narrow down the sequences has not been performed (step S41; No), the process may proceed to step S43. If it is determined that an operation to narrow down the sequences has been performed (step S41; Yes), the process may proceed to step S45.

[0094] In step S43, the sequence selection unit 108 lists the multiple standard operation sequences 1052 stored in the storage unit 105 and displays the list on the display unit 101. The sequence selection unit 108 may display the multiple standard operation sequences 1052 according to the number of operations included, that is, according to the length of the sequence. As an example, the sequence selection unit 108 may display the multiple standard operation sequences 1052 in ascending or descending order of the accuracy. If the accuracy calculated by the extraction unit 106 when generating each standard operation sequence 1052 is stored in the storage unit 105, the sequence selection unit 108 may display the multiple standard operation sequences 1052 in descending or descending order of accuracy. As an example, the sequence selection unit 108 may display the multiple standard operation sequences 1052 in descending or descending order of accuracy.

[0095] In step S43, a deletion instruction may be input from the input unit 102 for any of the standard operation sequences 1052 displayed in the list, and the target standard operation sequence 1052 may be deleted from the storage unit 105. After the processing of step S43 is completed, the processing may proceed to step S51, which will be described later.

[0096] In step S45, the input unit 102 acquires an operation ID in response to an operation by the operator. The operation ID acquired in step S45 may indicate the operation content of the sequence that the operator wishes to output. In this operation, the input unit 102 may supply a trigger signal to the acquisition unit 104 without supplying it to the operation detection unit 103.

[0097] In step S47, the acquisition unit 104 acquires status data related to the equipment. The acquired status data may be data at the current time point or data at a past time point designated by the operator. The acquisition unit 104 may acquire past status data from the storage unit 105.

[0098] In step S49, the sequence selection unit 108 selects, from the plurality of standard operation sequences 1052 stored in the storage unit 105, a sequence that corresponds to the operation ID acquired in step S45 and has a similarity to the state data acquired in step S47 that is equal to or greater than a reference similarity. The sequence selection unit 108 may list the selected standard operation sequences 1052 and display the list on the display unit 101. As in step S43 described above, the sequence selection unit 108 may display the plurality of standard operation sequences 1052 according to the length of the sequence or according to the accuracy. Note that in step S29, any of the standard operation sequences 1052 may be deleted from the storage unit 105, as in step S43 described above.

[0099] In step S51, the sequence selection unit 108 selects one of the displayed standard operation sequences 1052 in response to an operation by the operator.

[0100] In step S53, the output unit 109 outputs the selected standard action sequence 1052. As an example, the output unit 109 may display a virtual space to the new operator via the display unit 101, and may also display the standard action sequence 1052 as an action performed by an avatar, superimposed on the field of view in the virtual space. Alternatively, the output unit 109 may display, on the display unit 101, an explanation of each action included in the selected standard action sequence 1052. In this case, the input unit 102 may receive an operation to edit an action included in the standard action sequence 1052 (for example, an operation to delete any action), and may change the content of the standard action sequence 1052 in the storage unit 105 in accordance with the operation.

[0101] According to the above operation, a plurality of standard operation sequences 1052 are displayed in a list according to the number of operations, and the selected standard operation sequence 1052 is output, so that the standard operation sequence 1052 with the appropriate content can be easily selected and output.

[0102] Furthermore, a plurality of standard operation sequences 1052 are displayed in a list according to the accuracy, and a selected standard operation sequence 1052 is output, so that a standard operation sequence 1052 with appropriate content can be easily selected and output.

[0103] (Variation) In the above embodiment, the output unit 109 is described as displaying the standard operation sequence 1052 and the emergency operation sequence 1053 via the display unit 101. However, the standard operation sequence 1052 and the emergency operation sequence 1053 may be output in other modes. For example, the device 1 may include a transmission unit that transmits an operation signal to the equipment in response to an operation by an operator, and the output unit 109 may output the standard operation sequence 1052 and the emergency operation sequence 1053 to the transmission unit. The transmission unit may transmit an operation signal in response to the standard operation sequence 1052 or the emergency operation sequence 1053 output from the output unit 109 to the equipment. This makes it possible to operate the equipment with operation content in response to the standard operation sequence 1052 or the emergency operation sequence 1053. Furthermore, by including an operation that changes the operation amount of the equipment in the standard operation sequence 1052 or the emergency operation sequence 1053, it is possible to change the operation amount of the equipment.

[0104] Furthermore, although the description has been given assuming that the storage unit 105 stores the detection operation sequence 1051 including multiple operations performed by an operator to operate one piece of equipment, the type of detection operation sequence 1051 is not limited to this. For example, the storage unit 105 may further store, for each of at least one other piece of equipment, multiple detection operation sequences 1051 including multiple operations performed by another operator to operate the other piece of equipment. Each of the other pieces of equipment may share operations with the above-mentioned one piece of equipment. In this case, the extraction unit 106 may extract consecutive operations from the multiple detection operation sequences 1051 stored in the storage unit 105 for each piece of equipment. In this way, consecutive operations with a high probability of being executed consecutively are extracted by further using the detection operation sequences 1051 performed in the other pieces of equipment, and therefore, a standard operation sequence 1052 common to the pieces of equipment can be generated and output.

[0105] Furthermore, although it has been explained that status data indicating recommended execution states are added to the standard operation sequence 1052 and emergency operation sequence 1053 stored in the memory unit 105, if the sequences are not narrowed down based on the recommended execution states in the sequence output operation (see Figure 7), the status data does not need to be added.

[0106] Furthermore, although the input unit 102 has been described as acquiring an operation ID before the operator performs an operation to operate the equipment, the operation ID may be acquired after the operation is performed. In this case, the operation detection unit 103 may start detecting the operation in response to the operator's operation, and may end detecting the operation in response to the input unit 102 acquiring the operation ID. The acquisition unit 104 may acquire status data in response to the operation detection unit 103 detecting the operation.

[0107] Furthermore, although the device 1 has been described as including the display unit 101, the input unit 102, the acquisition unit 104, the operation selection unit 107, and the sequence selection unit 108, any of these may be omitted. If the device 1 does not include the display unit 101, the device 1 may perform display via an externally connected display device. If the device 1 does not include the input unit 102, the device 1 may acquire the operation ID via an externally connected input device. If the device 1 does not include the acquisition unit 104, the extraction unit 106 may extract consecutive operations from the detection operation sequence 1051 regardless of the state of the equipment. If the device 1 does not include the operation selection unit 107, the emergency operation sequence 1053 may not be stored in the memory unit 105. If the device 1 does not include the sequence selection unit 108, the output unit 109 may output a standard action sequence 1052 including a consecutive action in response to the consecutive action being extracted by the extraction unit 106, and may output an emergency action sequence 1053 including the two or more actions in response to two or more actions being selected by the action selection unit 107. In this case, the standard action sequence 1052 and the emergency action sequence 1053 do not need to be stored in the memory unit 105.

[0108] Various embodiments of the present invention may be described with reference to flowcharts and block diagrams, where the blocks may represent (1) stages of a process in which operations are performed or (2) sections of an apparatus responsible for performing the operations. Particular stages and sections may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable medium, and / or a processor provided with computer-readable instructions stored on a computer-readable medium. Dedicated circuitry may include digital and / or analog hardware circuitry, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuitry may include reconfigurable hardware circuitry, including logical AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, memory elements such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like.

[0109] A computer-readable medium may include any tangible device capable of storing instructions that are executed by an appropriate device, such that the computer-readable medium having instructions stored thereon comprises an article of manufacture containing instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable media may include electronic, magnetic, optical, electromagnetic, and semiconductor storage media. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick, integrated circuit card, and the like.

[0110] The computer readable instructions may include either assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0111] The computer-readable instructions may be provided to a processor or programmable circuit of a programmable data processing device, such as a computer, locally or over a wide area network (WAN) such as a local area network (LAN) or the Internet, and the computer-readable instructions may be executed to create means for performing the operations specified in the flowcharts or block diagrams. Here, the computer may be a personal computer (PC), a tablet computer, a smartphone, a workstation, a server computer, a general-purpose computer, a special-purpose computer, or the like, or may be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system, and is a broad definition of computer. In a distributed computing system, the multiple computers collectively execute a program by each executing a portion of the program and passing data between the computers as needed during program execution.

[0112] Examples of processors include a computer processor, a central processing unit (CPU), a processing unit, a microprocessor, a digital signal processor, a controller, a microcontroller, etc. A computer may have one or more processors. In a multiprocessor system with multiple processors, each processor executes a portion of a program and passes data between processors as needed during program execution, allowing the multiple processors to collectively execute a program. For example, in multitasking, each of the multiple processors may execute a portion of each task in small chunks by switching tasks at time slice intervals. In this case, which portion of a program each processor executes changes dynamically. Which portion of a program each of the multiple processors executes may also be statically determined by multiprocessor-aware programming.

[0113] 8 illustrates an example of a computer 1200 in which aspects of the present invention may be embodied, in whole or in part. Programs installed on the computer 1200 may cause the computer 1200 to function as or perform operations associated with an apparatus or one or more sections of the apparatus according to embodiments of the present invention, and / or to perform a process or steps of a process according to embodiments of the present invention. Such programs may be executed by the CPU 1212 to cause the computer 1200 to perform specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0114] A computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, a graphics controller 1216, and a display device 1218, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224 such as a hard disk drive, a DVD-ROM drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The computer also includes legacy input / output units such as a ROM 1230 and a keyboard 1242, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0115] The CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into the graphics controller 1216 itself, and causes the image data to be displayed on the display device 1218.

[0116] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD-ROM drive 1226 reads programs or data from a DVD-ROM 1227 and provides the programs or data to the storage device 1224 via the RAM 1214. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0117] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or programs that depend on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0118] The programs are provided by a computer-readable medium such as a DVD-ROM 1227 or an IC card. The programs are read from the computer-readable medium, installed in the storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and causes cooperation between the programs and the various types of hardware resources described above. An apparatus or a method may be configured by implementing information manipulation or processing in accordance with the use of the computer 1200.

[0119] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded into the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer processing area provided in the RAM 1214, the storage device 1224, the DVD-ROM 1227, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer processing area or the like provided on the recording medium.

[0120] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, the DVD-ROM drive 1226 (DVD-ROM 1227), an IC card, etc. to be read into the RAM 1214, and perform various types of processing on the data in the RAM 1214. The CPU 1212 then writes back the processed data to the external recording medium.

[0121] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. CPU 1212 may perform various types of processing on data read from RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to RAM 1214. CPU 1212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored on the recording medium, CPU 1212 may search for an entry that matches a condition specified by the attribute value of the first attribute from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0122] The above-described programs or software modules may be stored in a computer-readable medium on or near the computer 1200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable medium, thereby providing the programs to the computer 1200 via the network.

[0123] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.

[0124] It should be noted that the execution order of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order. [Explanation of symbols]

[0125] 1 device 101 Display section 102 Input section 103 Motion detection unit 104 Acquisition Department 105 Storage section 106 Extraction part 107 Operation selection section 108 Sequence selection section 109 Output section 1051 Detection operation sequence 1052 Standard Operation Sequence 1053 Emergency Operation Sequence 1200 Computer 1210 host controller 1212 CPU 1214 RAM 1216 Graphics Controller 1218 Display Devices 1220 Input / Output Controller 1222 communication interface 1224 Storage device 1226 DVD-ROM drive 1227 DVD-ROM 1230 ROM 1240 Input / Output Chip 1242 keyboard

Claims

1. an action detection unit that detects a plurality of types of actions performed by an operator to operate the equipment; a storage unit configured to store a plurality of first movement sequences including a plurality of movements detected by the movement detection unit; an extracting unit that extracts, from the plurality of first operation sequences stored in the storage unit, two or more operations whose probability of being executed consecutively is higher than a reference probability; an output unit that outputs a second action sequence including the two or more actions extracted by the extraction unit; An apparatus comprising:

2. the storage unit stores a plurality of the first operation sequences for each operation content for the equipment, The device according to claim 1 , wherein the extracting unit extracts the two or more actions from the plurality of first action sequences corresponding to a common operation content.

3. The device according to claim 2 , wherein the extracting unit extracts, for each operation content, the two or more actions from the plurality of first action sequences corresponding to the operation content.

4. An acquisition unit that acquires status data related to the equipment, the storage unit stores, in association with each first operation sequence, state data when an operation of the first operation sequence is performed; The extraction unit The device according to claim 1, further comprising: selecting a plurality of status data from each status data stored in the memory unit based on a similarity to the status data at a certain point in time; and extracting the two or more actions from a plurality of the first action sequences corresponding to the selected plurality of status data.

5. the storage unit further stores, for each of at least one other piece of equipment having a common operation with the piece of equipment, a plurality of first operation sequences including a plurality of operations performed by another operator to operate the other piece of equipment; The extraction unit The apparatus according to claim 1 , wherein the two or more operations are extracted from a plurality of the first operation sequences stored in the memory unit for each piece of equipment.

6. The device according to claim 1 , wherein the extraction unit identifies the two or more actions from the plurality of first action sequences by performing statistical processing on the plurality of first action sequences.

7. the storage unit further stores the second operation sequence; the device further includes a first sequence selection unit that selects one of the second operation sequences stored in the storage unit in response to an operation by an operator; The device according to claim 1 , wherein the output unit outputs the second operation sequence selected by the first sequence selection unit from the plurality of second operation sequences stored in the storage unit.

8. further comprising an operation selection unit that selects two or more operations from any of the first operation sequences stored in the storage unit in response to an operation by an operator; The apparatus according to claim 1 , wherein the output unit further outputs a third action sequence including the two or more actions selected by the action selection unit.

9. the storage unit further stores the third operation sequence; the device further includes a second sequence selection unit that selects one of the third operation sequences stored in the storage unit in response to an operation by an operator; The device according to claim 8 , wherein the output unit outputs the third operation sequence selected by the second sequence selection unit from the plurality of third operation sequences stored in the storage unit.

10. a display unit that displays a virtual space in which the facility is three-dimensionally modeled to the operator; The device according to claim 1 , wherein the action detection unit detects an action performed by the operator viewing the virtual space.

11. The device according to claim 10, wherein the output unit displays the virtual space to another operator different from the operator via the display unit, and displays avatars performing each action of the second action sequence superimposed on the field of view within the virtual space.

12. The apparatus according to claim 1 , wherein the output unit displays the second operation sequence to another operator different from the operator.

13. The device according to claim 1 , further comprising a transmitter that transmits an operation signal corresponding to the second operation sequence output from the output unit to the facility.

14. The apparatus of claim 13 , wherein the two or more actions include an action that changes an operating amount of the equipment.

15. The apparatus of claim 1 , wherein each of the two or more actions is an action on the facility.

16. an action detection step of detecting a plurality of types of actions performed by an operator to operate the equipment; a storing step of storing a first action sequence including a plurality of actions detected by the action detecting step; an extraction step of extracting, from the plurality of first action sequences stored by the storage step, two or more actions whose probability of being executed consecutively is higher than a reference probability; an output step of outputting a second action sequence including the two or more actions extracted by the extraction step; A method for providing the above.

17. When executed by a computer, the computer an action detection unit that detects a plurality of types of actions performed by an operator to operate the equipment; a storage unit configured to store a first movement sequence including a plurality of movements detected by the movement detection unit; an extracting unit that extracts, from the plurality of first operation sequences stored in the storage unit, two or more operations whose probability of being executed consecutively is higher than a reference probability; an output unit that outputs a second action sequence including the two or more actions extracted by the extraction unit; A program that functions as a

Images