Information processing device, analysis system, analysis method, and program

Abstract

The information processing device (30) includes a log acquisition unit (31) that acquires an operation log (21) including records of a plurality of operations by an operator on a target facility (10) and an operation log (11) including records of errors of the target facility, and an operation sequence creation unit (32) that creates an operation sequence by extracting, when a time interval between operations is equal to or longer than a predetermined first time, a series of operations up to an operation just before the time interval from the operation log (21).The information processing device (30) further includes a relevance calculation unit (33) that calculates a relevance between an error included in the operation log (11) that occurs after the end of the last operation of the operation sequence and the operation sequence, and an analysis unit (35) that outputs an analysis result based on the relevance.

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an analysis system, an analysis method, and a program. [Background technology]

[0002] In industrial facilities where various equipment is in operation, there is a technology that monitors events, including equipment operation or alarm occurrence, and analyzes the causal relationships between events in order to improve operational safety or operating conditions (for example, Patent Document 1). Systems that issue warnings based on the results of such analyses are also in use.

[0003] The event analysis device described in Patent Document 1 analyzes causal relationships by combining events, including alarms generated by multiple devices in a plant and operations on the devices, with process data from multiple devices. It is explained that this makes it possible to perform analysis that also includes fluctuations in process data that appear due to operations that are not causally related to alarms. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-128855 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the event analysis device described in Patent Document 1, when the same type of operation event is repeatedly generated within a short period of time, the same type of events are aggregated into one operation event data. In addition, when detecting a change in the trend of process data, the data is aggregated by classifying the fluctuation interval. Such classification of the same type of operation event or fluctuation interval needs to be defined in advance, which poses a problem that the event analysis device needs to be customized according to the plant or line.

[0006] The present disclosure has been made in consideration of the above circumstances, and aims to provide an information processing device, an analysis system, an analysis method, and a program capable of analyzing a variety of equipment or operations. [Means for solving the problem]

[0007] In order to achieve the above object, the information processing device of the present disclosure is Contains records of multiple operations From the operation log: The time interval between operations is At least the first predetermined time When I was A series of operations up to the operation before the time interval is extracted to generate an operation sequence. Furthermore, after the end of the last operation in the operation sequence, the information processing device In the target facility A degree of association between the error and the operation sequence is calculated. is equal to or greater than a predetermined threshold, the operation sequence related to the relevance is an erroneous operation. Output the analysis results. The relevance is calculated using an index value that decreases with increasing time from the end of the last operation in the operation sequence to the occurrence of the error. Effect of the Invention

[0008] According to the present disclosure, an operation sequence indicating a series of operations up to a certain time interval is created, and the degree of association with an error that occurred after the operation sequence is calculated, thereby making it possible to analyze a variety of equipment or operations. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the overall configuration of an analysis system according to a first embodiment. [Diagram 2] FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing device. [Diagram 3] Flowchart showing analysis process [Figure 4] Flowchart showing operation sequence creation processing [Diagram 5] An example of an operation log [Figure 6] An example of creating an operation sequence [Figure 7] Flowchart showing relevance calculation processing [Figure 8] An example of an operation log [Figure 9] An example of relevance [Figure 10] An example of a relevance table [Figure 11] Flowchart showing independence determination processing [Figure 12A] A diagram showing an example of actual measured values ​​used in determining independence [Figure 12B] A diagram showing an example of theoretical values ​​used in determining independence [Figure 12C] An example of a relevance table [Figure 13] A diagram showing an example of an operation sequence list. [Figure 14] Flowchart showing operation error determination processing [Figure 15] An example of an alarm output [Figure 16] FIG. 13 is a block diagram showing an example of the overall configuration of an analysis system according to a second embodiment. [Figure 17] A diagram showing an example of correct labels for training data [Figure 18] Flowchart showing learning process DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] (Embodiment 1) Hereinafter, a first embodiment for carrying out the present disclosure will be described in detail with reference to the drawings, in which the same or corresponding parts are denoted by the same reference numerals.

[0011] Fig. 1 is a block diagram showing an example of the overall configuration of an analysis system 100 according to the first embodiment. The analysis system 100 is a system that analyzes the relationship between operations and errors in order to prevent erroneous operations on a target facility 10 and improve the operating state of the target facility 10. As shown in Fig. 1, the analysis system 100 includes a target facility 10 that is communicably connected to each other, an input display device 20 that receives an operation input on the target facility 10 and displays information related to the target facility 10, and an information processing device 30 that analyzes operations on the target facility 10 and errors that occur in the target facility 10.

[0012] 1, the analysis system 100 includes one each of the target equipment 10 and the input display device 20, but the number of the target equipment 10 and the input display device 20 is arbitrary. The analysis system 100 may include two or more each of the target equipment 10 and the input display device 20.

[0013] The target equipment 10 is any equipment operating in an industrial facility, such as a robot cell. The target equipment 10 is operated based on an operation signal from an input display device 20, and accumulates an operation log 11 in a storage unit, which includes a record of errors that occur as a result of the operation.

[0014] The input display device 20 has a function of receiving operation input from an operator, outputting an operation signal to the target equipment 10, and displaying the operating status, errors, alarms, etc. of the target equipment 10 received from the target equipment 10 and the information processing device 30. The input display device 20 is, for example, a programmable display device in which a control program for the target equipment 10 is installed. The input unit of the input display device 20 may include physical buttons or may be a touch panel. The input display device 20 accumulates a record of operations performed on the input unit by the operator in a storage unit as an operation log 21.

[0015] Furthermore, the input display device 20 has a function of determining whether or not an input operation is likely to be an erroneous operation, and outputting an alarm when it is determined that there is a high possibility of an erroneous operation.

[0016] The information processing device 30 is any computer having a function of analyzing operations on the target equipment 10 and errors occurring in the target equipment 10, based on the operation log 11 acquired from the target equipment 10 and the operation log 21 acquired from the input display device 20. The information processing device 30 is a general-purpose computer, a tablet terminal, a smartphone, or the like, on which an analysis program is installed.

[0017] Fig. 2 is a block diagram showing an example of a hardware configuration of the information processing device 30. In the example of Fig. 2, the information processing device 30 includes a processor 301, a primary storage device 302, a secondary storage device 303, an input unit 304, a display 305, and a communication interface 306, which are connected to each other via a bus 310.

[0018] The processor 301 includes, for example, a CPU (Central Processing Unit). The processor 301 loads a control program stored in the secondary storage device 303 into the primary storage device 302 and executes the program.

[0019] The primary storage device 302 includes, for example, a RAM (Random Access Memory), functions as a work memory for the processor 301, and temporarily stores the control program that the processor 301 reads from the secondary storage device 303.

[0020] The secondary storage device 303 includes, for example, an EEPROM (Electrically Erasable and Programmable Read Only Memory), a flash memory, etc. The secondary storage device 303 stores the program executed by the processor 301, or data and parameters used in analysis.

[0021] The input unit 304 includes, for example, a keyboard or a pointing device, accepts input from the administrator, and passes the input signal to the processor 301. The display 305 is any display device, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. The input unit 304 and the display 305 may be an integrated touch panel.

[0022] The communication interface 306 is an interface of any communication method for transmitting and receiving data to and from the target equipment 10 and the input display device 20, and includes a communication device such as Ethernet (registered trademark) or wireless LAN.

[0023] For example, the processor 301 and the primary storage device 302 of the information processing device 30 cooperate to realize each function shown in FIG. 1. That is, the information processing device 30 functions as a log acquisition unit 31 that acquires the operation log 11 and the operation log 21 from the target equipment 10 and the input display device 20, respectively, an operation sequence creation unit 32 that extracts a series of operations from the operation log 21 to create an operation sequence, and an association calculation unit 33 that calculates the association between the operation sequence and an error included in the operation log 11. Furthermore, the information processing device 30 functions as an independence determination unit 34 that determines the independence between the operation sequence and the error, and an analysis unit 35 that analyzes the operation and the error based on the association or independence. In addition, either one or both of the primary storage device 302 and the secondary storage device 303 function as the storage unit 40 of the information processing device 30.

[0024] The log acquisition unit 31 acquires the operation log 11 including records of errors from the target equipment 10, and also acquires the operation log 21 including records of operations on the target equipment 10 from the input display device 20, and stores them in the storage unit 40. The operation sequence creation unit 32 extracts from the operation log 21 a series of operations up to the operation just before the time interval between one operation and the next operation when the time interval between the two operations is equal to or longer than a certain interval, and creates an operation sequence.

[0025] The relevance calculation unit 33 calculates the relevance between the operation sequence created by the operation sequence creation unit 32 and an error included in the operation log 11, which occurred within a certain time period after the end of the last operation of the operation sequence. The calculated relevance is associated with the operation sequence and stored in the relevance table 41 in the storage unit 40.

[0026] The independence determination unit 34 determines the independence between the operation sequence created by the operation sequence creation unit 32 and an error that has occurred in the target equipment 10 and is included in the operation log 11, and updates the degree of association calculated by the degree of association calculation unit 33 according to the determined independence. The analysis unit 35 analyzes the operations and errors based on the degree of association calculated by the degree of association calculation unit 33 or updated by the independence determination unit 34. Specifically, the analysis unit 35 determines whether a series of operations indicated in the operation sequence are erroneous operations based on the degree of association, and outputs a list of operation sequences including the determination result (operation sequence list 42) to the input display device 20.

[0027] The input display device 20 also has a hardware configuration including a processor and a primary storage device similar to those of the information processing device 30. The processor and the primary storage device of the input display device 20 work together to function as an operation error determination unit 22. The operation error determination unit 22 checks a newly detected operation sequence against an operation sequence list 42 acquired from the information processing device 30, and determines that there is a high possibility of an operation error if the operation sequence is the same as an operation sequence determined to be an operation error or if the operation sequence has not been detected before.

[0028] The operation of the analysis system 100 having the above-described configuration will be described with reference to the flowchart in Fig. 3. Fig. 3 is a flowchart of the analysis process executed by the information processing device 30. The analysis process may be executed at any timing, for example, when an execution instruction is given by an administrator of the information processing device 30, when the operation log 11 or the operation log 21 is received, or at a predetermined execution date and time.

[0029] First, the log acquisition unit 31 acquires the operation log 11 from the target equipment 10, acquires the operation log 21 from the input display device 20 (step S1), and stores them in the storage unit 40. Next, the operation sequence creation unit 32 extracts a set of operations that are estimated to have meaning as a series of operations from the operation log 21 acquired in step S1, and creates an operation sequence (step S2; operation sequence creation step). The operation sequence creation process will be described in detail with reference to Figs. 4 to 6. Fig. 4 is a flowchart of the operation sequence process, Fig. 5 is an example of the operation log 21, and Fig. 6 is an example of the creation of an operation sequence.

[0030] In the flowchart of FIG. 4, first, the operation sequence creation unit 32 acquires the operation log 21 stored in the storage unit 40 (step S101). As illustrated in FIG. 5, the operation log 21 includes date, time, identification information of the input display device 20, identification information of a screen, and identification information of an operation. Here, the identification information of the input display device 20, identification information of a screen, and identification information of an operation are represented by a mere string of characters or symbols, and the identification information does not have a meaning such as a use or function. For example, the identification information of a screen does not include the meaning that "screen 1 is the initial screen." By not assigning a meaning to each piece of identification information, it becomes possible to apply it to any equipment or operation.

[0031] The operation sequence creation unit 32 judges the time interval between operations from the earliest operation in the chronological order based on the dates and times of the operation log 21 acquired in step S101 (step S102). If the time interval between operations is less than a predetermined first time t1 (step S102; No), it is presumed that the operation is in the middle of the operation, and the operation sequence is not extracted and the process proceeds to step S107. If the time interval between operations is equal to or greater than the first time t1 (step S102; Yes), it is presumed that the series of operations up to the operation preceding the time interval is a meaningful set of operations and is extracted as an operation sequence (step S103). The first operation in this series of operations is the operation following the operation sequence extracted in the previous step S103.

[0032] For the operation sequence extracted in step S103, the operation sequence creation unit 32 judges whether or not there is an identical operation sequence in the operation sequence list 42 of the storage unit 40 (step S104). If there is no identical operation sequence (step S104; No), the operation sequence creation unit 32 assigns a new index to the operation sequence extracted in step S103 and adds it to the operation sequence list 42 of the storage unit 40 (step S105). If there is an identical operation sequence (step S104; Yes), the number of indexes for that operation sequence is incremented by 1 (step S106).

[0033] In the example of Fig. 5, when the first time t1 is 20 seconds, the time interval between the second operation and the third operation is 20 seconds or more, so the operation sequence creation unit 32 extracts the first and second operations as a first operation sequence. Also, the time interval between the fifth operation and the sixth operation is 20 seconds or more, so the operation sequence creation unit 32 extracts the third to fifth operations as a second operation sequence. Note that in this embodiment, the time interval between operations within an operation sequence is not taken into consideration.

[0034] FIG. 6 shows an operation sequence extracted from the operation log 21 of FIG. 5. As shown in FIG. 6, an operation sequence in which the first operation "display 1 + screen 1 + button 1" and the second operation "display 1 + screen 2 + button 1" in FIG. 5 are performed in order is added to the operation sequence list 42 of the storage unit 40 with a new index "1". Also, an operation sequence in which the third operation "display 1 + screen 1 + button 1", the fourth operation "display 1 + screen 2 + button 3", and the fifth operation "display 1 + screen 3 + button 2" in FIG. 5 are performed in order is added to the operation sequence list 42 of the storage unit 40 with a new index "2". Here, when an operation sequence is generated that has the same operation content and procedure as a previously saved operation sequence, a new index is not added, and 1 is added to the number of times of the operation sequence. Hereinafter, an operation sequence with index x is called operation sequence x.

[0035] Thereafter, if there is no unprocessed operation in the operation log 21 acquired in step S101 (step S107; No), the process ends. If there is an unprocessed operation (step S107; Yes), the process returns to step S102 and continues.

[0036] After the operation sequence creation process in Fig. 4 is completed, the process returns to the flowchart in Fig. 3 and executes the relevance calculation process (step S3; relevance calculation step). The relevance calculation process will be described in detail with reference to Figs. 7 to 9. Fig. 7 is a flowchart of the relevance calculation process, Fig. 8 is an example of an operation log 11 including an error for which the relevance is to be calculated, and Fig. 9 is an example of the calculation of the relevance.

[0037] In the flowchart of Fig. 7, the relevance calculation unit 33 first acquires one operation sequence created in the operation sequence creation process (step S2 in Fig. 3) shown in Fig. 4 (step S201). Next, from the operation logs 11 acquired from the target equipment 10 in step S1 in Fig. 3 and stored in the storage unit 40 of the information processing device 30, logs within a predetermined second time t2 from the end of the last operation of the operation sequence are acquired (step S202).

[0038] Next, the relevance calculation unit 33 calculates the relevance between the errors included in the operation log 11 within the second time t2 acquired in step S202 and the operation sequence. Specifically, the relevance is calculated for each error that occurred within the second time t2 from the end of the last operation of the operation sequence, and if the relevance for the same operation sequence index and the same error code has already been calculated, the relevance calculated this time is added to the relevance value stored at that time (step S203). The relevance calculation will be described with a specific example.

[0039] The operation log 11 illustrated in Fig. 8 records errors that occurred in the target equipment 10 when the operations shown in the operation log 21 in Fig. 5 were performed. As illustrated in Fig. 8, the operation log 11 includes a date, a time, and an error code. Here, the error code is represented by a simple list of characters or symbols, and does not have any meaning such as the type of target equipment or the content of the error.

[0040] When the second time t2 is 1 minute, errors with error codes 1 to 3 (hereinafter referred to as errors 1 to 3, and so on below) occur within 1 minute from 8:00:02, the end time of the last operation in operation sequence 1 shown in Fig. 5. Also, errors 1 and 4 occur within 1 minute from 8:01:20, the end time of the last operation in operation sequence 2 shown in Fig. 5.

[0041] A calculation example of the relevance between each error and each operation sequence will be described below. For example, when the time difference between the end time of operation sequence x and the occurrence time of error (y, i) is expressed as t(x, y, i), the relevance Assoc(x, y) may be defined by the following formula (1). Here, since the same error y may occur multiple times, error (y, i) indicates that the error y occurs the i-th time.

[0042]

number

[0043] FIG. 9 is a graph showing an example of the relevance between operation sequence x and error (y, i), which is the i-th component below Σ in formula (1). The horizontal axis of the graph in FIG. 9 is the time difference t(x, y, i) between the end time of operation sequence x and the occurrence time of error (y, i), and the vertical axis is the relevance of error (y, i). As shown in FIG. 9, it can be said that the relevance calculated by formula (1) is the sum of index values ​​that decrease with an increase in the time t(x, y, i) from the end of the last operation of operation sequence x to the occurrence of error (y, i). Note that the relevance may be defined by other indexes.

[0044] In the example shown in FIGS. 5 and 8, when the second time t2 is set to 1 minute, errors 1 to 3 within 1 minute from the end of operation sequence 1 and errors 1 and 4 within 1 minute from the end of operation sequence 2 are subject to correlation calculation.

[0045] Fig. 10 shows an association degree table 41 including the result of calculating the association degree expressed by formula (1) for the operation log 21 and the operation log 11 shown in Figs. 5 and 8. In detail, as shown in Fig. 10, the association degree is calculated for each of error 1 that occurred at 8:00:04, error 2 that occurred at 8:00:05, and error 3 that occurred at 8:00:06, which are within one minute after operation sequence 1 ended at 8:00:02. In addition, the association degree is calculated for each of error 1 that occurred at 8:01:30 and error 4 that occurred at 8:01:31, which are within one minute after operation sequence 2 ended at 8:01:20.

[0046] Here, we show an example where each error occurs only once, but the relevance increases each time the same error occurs for the same operation sequence, that is, each time i increases. In other words, the higher the frequency of error occurrence, the higher the relevance, which can indicate the strength of the causal relationship between the operation sequence and the error.

[0047] 7, the relevance calculation unit 33 calculates the relevance for each error for the operation sequence acquired in step S201 in step S203, calculates the relevance for each index of the operation sequence and for each error code by adding them, and then stores the calculated relevance in the relevance table 41 in the storage unit 40 (step S204). After that, the relevance calculation unit 33 determines whether there is an unprocessed operation sequence (step S205), and ends the process if there is no unprocessed operation sequence. If there is an unprocessed operation sequence, the process returns to step S201 and continues the process of calculating the relevance for the next operation sequence.

[0048] After the relevance calculation process in Fig. 7 is completed, the flow returns to the flowchart in Fig. 3, and the independence determination unit 34 executes the independence determination process (step S4; independence determination step). The independence determination process will be described in detail with reference to Figs. 11 and 12A to C. Fig. 11 is a flowchart of the independence determination process, and Figs. 12A to C are specific examples for explaining the independence determination process.

[0049] In the flowchart of Fig. 11, first, the independence determination unit 34 acquires one operation sequence created in the operation sequence creation process (step S2 in Fig. 3) shown in Fig. 4 (step S301). Next, from among the operation logs 11 acquired from the target equipment 10 in step S1 of Fig. 3 and stored in the storage unit 40 of the information processing device 30, a log within a predetermined second time t2 from the end of the operation sequence is acquired (step S302).

[0050] Next, the independence determination unit 34 determines the independence between an error of one error code selected from the errors included in the operation log 11 and the operation sequence. Any method may be used to determine the independence, but in this embodiment, a case where the independence determination is performed by a chi-square test will be described. In steps S303 to 305, the independence determination between the operation sequence x and the error y will be described.

[0051] First, the independence determination unit 34 calculates the test statistic of the chi-square test for the operation sequence x and the error y (step S303), and when the test statistic is equal to or less than the corresponding value of the significance level (step S304; Yes), it determines that there is independence, and updates the relevance stored in the relevance table 41 in the storage unit 40 to 0 (step S305). On the other hand, when the test statistic exceeds the corresponding value of the significance level (step S304; No), it determines that there is no independence and that there is a causal relationship, and proceeds to step S306 without updating the relevance. A specific example of the chi-square test will be described.

[0052] The chi-square test determines the independence of operation sequence x and error y based on the frequency of their occurrence. Here, "independence" refers to a state in which the frequency of overlapping occurrence of operation sequence x and error y is necessarily due to the frequency of occurrence of each. In the chi-square test, the significance level set in advance is, for example, 1% or 5%.

[0053] Using the specific example shown in Figures 12A to 12C, the determination of the independence of the combination of index 1 of an operation sequence and error code 2 will be described. Figure 12A shows the actual measurement value of the number of times that any error code appeared within one minute from the end of any operation sequence in a target period, when the total number of times that any error code appeared was 1001. When an error appeared within one minute from the end of an operation sequence, the index of the operation sequence and the error code of the error are said to be related, and when an error code of an error that did not appear within one minute from the end of the operation sequence is said to be unrelated to the index of the operation sequence.

[0054] As shown in Fig. 12A, out of a total of 1001 detections, the number of times that index 1 of the operation sequence was associated with error code 2 was 3, the number of times that index 1 of the operation sequence was associated with an error code other than error code 2 was 48, and the number of times that error code 2 was associated with an index other than index 1 of the operation sequence was 25.

[0055] The theoretical values ​​calculated based on the table of actual measurements shown in Figure 12A are shown in Figure 12B. For example, the total number of times that an index of an arbitrary operation sequence and an arbitrary error code are related is 1001, of which the error code was 2 28 times and the operation sequence index was 1 51 times. From this, the probability calculation is performed and the theoretical value of the number of times that index 1 of the operation sequence and error code 2 are related is 28 x 51 ÷ 1001 = 1.42657. The other combinations are calculated in the same way, and the theoretical value shown in Figure 12B is obtained.

[0056] Next, the independence determining unit 34 calculates the test statistic of the chi-square test using the following formula (2).

[0057]

number

[0058] The test statistic calculated by applying formula (2) to the theoretical values ​​shown in Figure 12B and the corresponding measured values ​​in Figure 12A is 1.88118. The chi-square test in a 2 x 2 distribution table follows a chi-square distribution with one degree of freedom, and the chi-square value corresponding to a significance level of 5% for the chi-square distribution with one degree of freedom is 3.87. Since the test statistic calculated using formula (2) is 1.88118, which is less than 3.87, it is determined that index 1 in the operation sequence and error code 2 are independent.

[0059] 11, as explained in the above example, the independence judgment unit 34 calculates the test statistic of the chi-square test for the error of error code 1 (step S303), and since the test statistic is equal to or less than the chi-square value corresponding to the significance level (step S304; Yes), it is judged that index 1 of the operation sequence and error code 2 are independent, and the relevance is updated to 0, which is lower than the value 0.95 calculated by the relevance calculation unit 33 (step S305). Fig. 12C is a diagram showing the relevance table 41 including the relevance after updating from Fig. 10.

[0060] After the processes of steps S304 and S305, if there are unprocessed error codes (step S306; Yes), the process returns to step S303, and the independence determination unit 34 executes the chi-square test process of steps S303 to S305 for the errors in the unprocessed error codes.

[0061] If there is no unprocessed error code (step S306; No), it is determined whether there is an unprocessed operation sequence (step S307). If there is an unprocessed operation sequence (step S307; Yes), the process returns to step S301 and executes the processes of steps S301 to S305 for the unprocessed operation sequence. If there is no unprocessed operation sequence (step S307; No), the process ends.

[0062] In this manner, in the flowchart of FIG. 3, the relevance calculation unit 33 calculates the relevance (step S3), the independence determination unit 34 determines the independence and updates the relevance (step S4), and then the analysis unit 35 analyzes the operation and error based on the relevance and outputs the analysis result to the input display device 20 (step S5; analysis step).

[0063] Specifically, when the relevance is equal to or greater than a predetermined threshold, the analysis unit 35 determines that the operation sequence related to the error code is an erroneous operation. On the other hand, when the relevance is less than the predetermined threshold, the analysis unit 35 determines that the operation sequence related to the error code is a normal operation and not an erroneous operation. The threshold may be any value, and for example, when the relevance takes a value between 0 and 1, the threshold may be 0.5. When the relevance shown in FIG. 12C is used, when the threshold is 0.5, the relevance between index 1 of the operation sequence and error code 1 is 0.97, which is greater than 0.5, and therefore the analysis unit 35 determines that operation sequence 1 is an erroneous operation. The analysis unit 35 outputs an operation sequence list 42 including the determination result to the input display device 20.

[0064] 13 shows an example of the operation sequence list 42 including the judgment result. The operation sequence list 42 includes an index of the operation sequence and a judgment result of whether the operation is an erroneous operation or normal operation. Furthermore, the operation sequence list 42 may include the operation content of the operation sequence and an error code.

[0065] The operation error determination section 22 of the input display device 20, which has acquired the operation sequence list 42 including the determination result, executes an operation error determination process. FIG. 14 is a flowchart of the operation error determination process. First, it is determined whether or not an operation sequence has been detected (step S501). The operation sequence detection procedure is similar to steps S101 to S103 of the operation sequence creation process shown in FIG. 4. That is, when the time interval between operations becomes equal to or longer than the first time t1, the operation error determination section 22 detects a series of operations up to that time interval as an operation sequence.

[0066] The operation error determination unit 22 waits while it does not detect an operation sequence (step S501; No). When it detects an operation sequence (step S501; Yes), the operation error determination unit 22 refers to the operation sequence list 42 acquired from the information processing device 30, and when it determines that the detected operation sequence is not included in the operation sequence list 42 and is an operation sequence that has not been detected before (step S502; Yes), it outputs an alarm indicating that there is a possibility of an operation error (step S504).

[0067] On the other hand, if the operation sequence detected in step S501 is included in the operation sequence list 42 and the same operation sequence has occurred in the past (step S502; No), it is determined whether or not the operation sequence has been determined to be an operation error (step S503). If the operation sequence is determined to be an operation error (step S503; Yes), an alarm is output (step S504). For example, if an operation sequence identical to the operation sequence of index 1 is detected in step S501, the operation error determination unit 22 refers to the operation sequence list 42 in FIG. 13, determines that it is an operation error, and outputs an alarm (step S504).

[0068] The method of displaying the alarm is arbitrary, but for example, as shown in Figure 15, after the first operation (display 1 + screen 1 + button 1) and the second operation (display 1 + screen 2 + button 1) are performed as in operation sequence 1, a message saying "An operation that may be an erroneous operation has been observed" may be displayed.

[0069] If the operation sequence detected in step S501 is the same as the operation sequence that has not been determined to be an erroneous operation (step S503; No), and if there is no end command from the operator of the input display device 20 (step S505; No), the process returns to step S501 and continues. If there is an end command from the operator (step S505; Yes), the process ends.

[0070] As described above, in the analysis system 100 according to the present embodiment, the log acquisition unit 31 of the information processing device 30 acquires the operation log 21 and the operation log 11 related to the target equipment 10, and the operation sequence creation unit 32 creates an operation sequence indicating a series of operations up to the operation before the time interval t1 when the time interval between operations is t1 or more. The relevance calculation unit 33 calculates the relevance between the operation sequence and an error that occurs after the end of the last operation of the operation sequence, and the independence determination unit 34 determines the independence between the operation sequence and the error, and updates the relevance according to the independence. When the relevance is higher than a threshold value, the analysis unit 35 determines that the operation related to the operation sequence is an erroneous operation. This makes it possible to analyze operations and errors for various equipment or operations and determine erroneous operations, regardless of the type of equipment or operation.

[0071] (Embodiment 2) A second embodiment of the present disclosure will be described in detail with reference to Figs. 16 to 18. In addition, the same or corresponding parts in the drawings are given the same reference numerals. Fig. 16 is a block diagram showing an example of the overall configuration of an analysis system 200 according to the second embodiment. Similar to the first embodiment, the analysis system 200 is a system for preventing erroneous operation of the target equipment 10 and improving the operating state.

[0072] The analysis system 200 includes a target facility 10, an input display device 20, and an information processing device 50, similar to the first embodiment. The configurations of the target facility 10 and the input display device 20 are similar to those of the first embodiment. The information processing device 50 includes a learning unit 36 ​​in addition to the configuration of the information processing device 30 according to the first embodiment, and further includes a storage unit inside or outside the information processing device 50 that stores learning data 51.

[0073] The learning unit 36 ​​learns using the learning data 51 in order to optimize at least one of parameters 43 used in the operation sequence creation unit 32, the relevance calculation unit 33, the independence determination unit 34, and the analysis unit 35 of the information processing device 50. The parameters 43 specifically include a first time t1 which is a time interval for extracting an operation sequence, a second time t2 after the end of the operation sequence for acquiring an error to be calculated, a significance level for determining whether or not there is independence in the chi-square test for determining independence, and a threshold value of the relevance for determining whether or not there is an operation error in the operation error determination.

[0074] For at least one of these parameters 43, a value that allows more accurate manipulation error determination is found through machine learning by the learning unit 36. The machine learning method may be any conventional method.

[0075] The learning data 51 includes the operation log 21, the operation log 11, and a correct answer label for the operation error judgment. The correct answer label of the learning data 51 indicates whether or not there is a relationship between an arbitrary operation sequence and an arbitrary error, and has a value of "1" if there is a relationship, and has a value of "0" if there is no relationship. FIG. 17 is a diagram showing an example of the correct answer label of the learning data 51. The example of FIG. 17 shows that the operation sequence 1 and the error 1, and the operation sequence 2 and the error 2 are related, and the operation sequence 1 and the error 2, and the operation sequence 2 and the error 1 are not related. The learning unit 36 ​​obtains the values ​​of various parameters 43 by machine learning such that the difference between the value of the correct answer label, 0 or 1, and the operation error judgment result obtained from the operation log 21 and the operation log 11 is equal to or less than a certain value, and updates the parameters 43 to the obtained values.

[0076] 18 is a flowchart of the learning process executed by the learning unit 36. The following will be described with reference to the flowchart in FIG.

[0077] First, the learning unit 36 ​​acquires initial values ​​of various parameters 43 from the storage unit 40 (step S601). Next, using the parameters 43 acquired in step S601, the degree of association is calculated from the operation log 21 and the operation log 11 to determine whether an operation error has occurred, and the error between the result and the correct label is calculated (step S602).

[0078] The error calculation in step S602 is performed, for example, using the following formula (3): In formula (3), Value is the error between the operation error judgment result and the correct label, and when the index of the operation sequence is i and the error code is j, the operation error judgment result for each combination is Result(i,j), and the correct label is Correct(i,j).

[0079]

number

[0080] If the error value Value calculated by equation (3) is equal to or less than the threshold value (step S603; Yes), the parameter 43 is not updated and the process proceeds to step S605. If the error value Value exceeds the threshold value (step S603; No), the parameter 43 is updated based on the error value Value (step S604). The threshold value is a predetermined value, for example, 0.01.

[0081] Thereafter, if the error calculation has been performed a certain number of times or more (step S605; Yes), the process ends. If the number of error calculations is less than a certain number (step S605; No), the process returns to step S602 and continues. In the next step S602, an error determination is performed using the updated parameters 43, and an error calculation with respect to the correct label is performed.

[0082] The parameter 43 can be updated in step S604 by any conventional method, such as the steepest descent method, back propagation, or other methods used in the context of neural networks.

[0083] Various parameters 43 obtained as a result of the machine learning by the learning unit 36 ​​are output to the operation sequence creation unit 32, the relevance calculation unit 33, the independence determination unit 34, and the analysis unit 35, and are used in each process. Specifically, the operation sequence creation unit 32 creates an operation sequence using the first time t1 obtained by learning, and the relevance calculation unit 33 calculates the relevance between the operation sequence and the error using the second time t2 obtained by learning. The independence determination unit 34 determines the independence using the significance level obtained by learning and updates the relevance. The analysis unit 35 determines whether the operation sequence is an error using the threshold value of the relevance obtained by learning, and outputs an operation sequence list 42 including the error determination result to the input display device 20.

[0084] As described above, in the analysis system 200 according to this embodiment, the information processing device 50 further includes the learning unit 36, which performs machine learning using the learning data 51 including the correct answer label for the operation error judgment, and obtains the parameters 43 used in the creation of the operation sequence, the calculation of the relevance, the independence judgment, and the operation error judgment, which can output the correct answer for the operation error judgment with a higher probability. The information processing device 50 uses the parameters 43 obtained by learning to execute the creation of the operation sequence, the calculation of the relevance, the independence judgment, and the operation error judgment. This eliminates the need to input parameters required for the analysis process in advance, and enables accurate operation error judgment regardless of the configuration or specifications of the equipment.

[0085] The hardware configuration and the flow chart shown in the above-mentioned first and second embodiments are merely examples, and can be arbitrarily modified and applied. For example, in the above-mentioned first embodiment, the target equipment 10 accumulates the operation log 11, the input display device 20 accumulates the operation log 21, and the information processing device 30 acquires each of the accumulated logs, but the method of acquiring each log is not limited to this. For example, each time an error occurs in the target equipment 10, the target equipment 10 may transmit error information to the information processing device 30, and the information processing device 30 may accumulate the operation log 11 in the storage unit 40. Also, each time the input display device 20 detects an operation, the input display device 20 may transmit operation information to the information processing device 30, and the information processing device 30 may accumulate the operation log 21 in the storage unit 40.

[0086] In the above-mentioned first embodiment, the information processing device 30 transmits the operation sequence list 42 determined to be an operation error to the input display device 20, and the input display device 20 refers to the list and outputs an alarm when there is a possibility of an operation error, but the method of outputting the alarm is not limited to this. For example, the input display device 20 may transmit operation information to the information processing device 30 every time it detects an operation, and the information processing device 30 may determine the possibility of an operation error and send alarm information to the input display device 20. In this case, the input display device 20 outputs the received alarm information.

[0087] In addition, in the calculation of the relevance in the above embodiment 1, the i component of the relevance between the same operation sequence x and the same error (y, i) is added up by the number of occurrences, but other statistical values ​​such as the average or maximum number of occurrences may be used as the relevance between the operation sequence x and the error y.

[0088] In the above-mentioned first embodiment, the information processing device 30 directly connected to the target facility 10 and the input display device 20 performs the analysis process, but the configuration of the analysis system is not limited to this. For example, the target facility 10 or the input display device 20 may have the function of the information processing device 30.

[0089] Alternatively, a server connected to a plurality of sets of target facilities 10 and input display devices 20 via a network may accumulate the operation logs 11 and the operation logs 21 and perform an analysis process thereon. In this case, the input display device 20 can determine an operation error by transmitting an operation sequence list 42 including an operation error determination result obtained as a result of the analysis process performed by the server to the input display device 20. Furthermore, the learning process in the above-mentioned second embodiment may be performed by the server.

[0090] In the above embodiment 1, the relevance is updated based on the determination result by the independence determination unit 34 for the result of the relevance calculated by the relevance calculation unit 33. However, either one of the relevance calculation unit 33 and the independence determination unit 34 may be omitted. In other words, the analysis unit 35 may determine an operation error in the operation sequence based on either the result calculated by the relevance calculation unit 33 or the result determined by the independence determination unit 34.

[0091] The allocation of the functions realized by the processor 301 in the information processing devices 30 and 40 in the first and second embodiments is merely an example, and the allocation may be changed as desired. The functions realized by the processor 301 can be realized by using a computer system having a normal communication function, not by a dedicated system.

[0092] Furthermore, a computer capable of implementing each function may be configured by distributing a program for executing the operations of the above-mentioned first and second embodiments stored in a computer-readable recording medium such as a CD-ROM (Compact Disc Read-Only Memory), a DVD (Digital Versatile Disc), an MO (Magneto Optical Disc), or a memory card, and installing the program in the computer. In addition, when each function is implemented by sharing the work between an OS (Operating System) and an application, or by cooperation between the OS and an application, only the parts other than the OS may be stored in the recording medium.

[0093] Various embodiments and modifications of the present disclosure are possible without departing from the broad spirit and scope of the present disclosure. The above-described embodiments are for explaining the present disclosure and do not limit the scope of the present disclosure. That is, the scope of the present disclosure is indicated by the claims, not the embodiments. Various modifications made within the scope of the claims and the scope of the disclosure equivalent thereto are considered to be within the scope of the present disclosure. [Explanation of symbols]

[0094] 100,200 analysis system, 10 target equipment, 11 operation log, 20 input display device, 21 operation log, 22 error operation determination unit, 30,50 information processing device, 31 log acquisition unit, 32 operation sequence creation unit, 33 relevance calculation unit, 34 independence determination unit, 35 analysis unit, 36 learning unit, 40 memory unit, 41 relevance table, 42 operation sequence list, 43 parameters, 51 learning data, 301 processor, 302 primary memory device, 303 secondary memory device, 304 input unit, 305 display, 306 communication interface, 310 bus.

Claims

1. an operation sequence creation unit that extracts, from an operation log of the target equipment, a series of operations up to an operation that occurred a time interval equal to or greater than a predetermined first time, and creates an operation sequence; a correlation calculation unit that calculates a correlation between an error that occurs after the completion of the last operation of the operation sequence and the operation sequence; and an analysis unit that outputs an analysis result based on the relevance. Information processing device.

2. Further comprising a log acquisition unit that acquires the operation log including a record of a plurality of operations of the target equipment and an operation log including a record of an error of the target equipment, the operation sequence creation unit, when a time interval between operations is equal to or longer than the first time, extracts from the operation log a series of operations up to an operation immediately before the time interval, and creates the operation sequence; the relevance calculation unit calculates the relevance between the error included in the operation log, which occurs after completion of the last operation in the operation sequence, and the operation sequence; The information processing device according to claim 1 .

3. the relevance calculation unit calculates the relevance using an index value that decreases with an increase in time from the end of the last operation in the operation sequence to the occurrence of the error; The information processing device according to claim 1 .

4. When there are multiple records in which an error having the same error code occurred within a predetermined second hour from the end of the last operation of the same operation sequence, the relevance calculation unit calculates the sum of the index values ​​calculated for the errors in each record as the relevance. The information processing device according to claim 3 .

5. When there are multiple records in which an error having the same error code occurred within a predetermined second hour from the end of the last operation of the same operation sequence, the relevance calculation unit calculates the average of the index values ​​calculated for the errors in each record as the relevance. The information processing device according to claim 3 .

6. an independence determination unit that determines independence between the operation sequence created by the operation sequence creation unit and the error, and changes the degree of association between the operation sequence determined to be independent and the error to a value lower than the value calculated by the degree of association calculation unit; The analysis unit outputs the analysis result based on the degree of association calculated by the degree of association calculation unit or the degree of association changed by the independence determination unit. The information processing device according to claim 1 .

7. The independence determination unit performs the determination by a chi-square test at a predetermined significance level. The information processing device according to claim 6.

8. The analysis unit determines that the operation sequence related to the relevance is an operation error when the relevance is equal to or greater than a predetermined threshold, and outputs a list of the operation sequences including a result of the operation error determination as the analysis result. The information processing device according to claim 1 .

9. a learning unit that obtains, by machine learning, at least one of parameters used in the processing of the operation sequence creation unit, the relevance calculation unit, and the analysis unit, The information processing device according to claim 1 .

10. An information processing device according to any one of claims 1 to 9; The target equipment is communicatively connected to the information processing device and outputs an operation log including a record of the error to the information processing device; and an input display device that is communicatively connected to the information processing device and the target equipment, receives operation input to the target equipment, outputs the operation log including a record of a plurality of operations of the target equipment to the information processing device, and displays information based on the analysis result output by the analysis unit of the information processing device. Analysis system.

11. When the input display device detects the series of operations that are the same as the operation sequence in which the relevance calculated by the relevance calculation unit is equal to or greater than a predetermined value, the input display device determines that the series of operations are erroneous operations and outputs an alarm. The analysis system according to claim 10.

12. the input display device outputs an alarm when detecting a series of operations different from the operation sequence previously created by the operation sequence creation unit. The analysis system according to claim 10.

13. an operation sequence creating step of extracting a series of operations up to an operation that occurred a time interval equal to or greater than a predetermined first time from the operation log of the target equipment, and creating an operation sequence; a correlation calculation step of calculating a correlation between an error occurring after the completion of the last operation of the operation sequence and the operation sequence; An analysis step of performing an analysis based on the relevance. Analysis method.

14. Computer, an operation sequence creation unit that extracts, from the operation log of the target equipment, a series of operations up to an operation that occurred a time interval equal to or greater than a predetermined first time, and creates an operation sequence; a correlation degree calculation unit that calculates a correlation degree between an error that occurs after completion of a final operation in the operation sequence and the operation sequence; an analysis unit that performs an analysis based on the relevance; A program to function as a

Images