Information processing method, information processing device, system, article manufacturing method, program, and recording medium

Abstract

To provide a method for properly extracting learning data for machine learning of features during operation in a normal state with respect to machine facilities changing in way of operation according to states of succeeding processes although repeatedly performing the same operation like a robot arranged in a production line.SOLUTION: An information processing method comprises: acquiring measured values related to machine facilities in a normal state in a first period; using the measured values and profile information on measured value when the machine facilities are in an operation state to specify a period in the machine facilities are in the operation state in the first period; extracting, as machine learning data, feature values based upon the measured values in the period in which the machine facilities are in the operation state in the first period; generating a learning-completed model through machine learning using the machine learning data; and using the learning-completed model to determine a state of the machine facilities at the time of evaluation.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing method, an information processing device, a machine equipped with an information processing device, a control program, and a computer-readable recording medium used to detect signs of failure in mechanical equipment based on data from sensors, etc. In particular, the present invention relates to the creation of learning data used to generate a failure prediction model for mechanical equipment by machine learning. [Background technology]

[0002] The operating state of machinery and equipment can change from moment to moment due to changes in the condition of its components, etc. When the operating state is within the allowable range in light of the intended use of the machinery and equipment, it is called a normal state, and when it is outside the allowable range, it is called a faulty state (abnormal state). For example, if a production machine goes into a faulty state (abnormal state), it will produce defective products or cause the production line to stop, resulting in malfunctions.

[0003] In production machinery, etc., it is common to perform maintenance work on a regular or irregular basis, even when the same work is performed repeatedly and continuously, in order to minimize the occurrence of breakdowns. Shortening the intervals between maintenance work is effective in increasing preventive safety, but because production machinery is stopped during maintenance work, excessively frequent maintenance work reduces the availability of production machinery. Therefore, it is desirable to be able to detect when a breakdown is imminent, even if the machinery is still operating normally. If it is possible to detect an imminent breakdown (predict a breakdown), maintenance work can be carried out at that point, preventing an unnecessary drop in availability.

[0004] A known method for predicting the occurrence of failure involves creating a trained model based on machine learning of the state of mechanical equipment in advance, and then using the trained model to evaluate the state of the mechanical equipment at the time of evaluation. For example, a known method involves generating a trained model based on machine learning of the characteristics of the normal state of the mechanical equipment, calculating the degree of deviation between the state at the time of evaluation and the machine-learned normal state using the trained model, and predicting the occurrence of failure based on the calculated degree of deviation. To improve prediction accuracy, it is important to build a trained model that is suitable for predicting failures, but to do so, the suitability of the training data used in machine learning becomes an issue.

[0005] For example, Patent Document 1 describes extracting vectors based on sensor signals indicating the state of machinery and equipment, and selecting features to be used based on data checks of the feature vectors. It also describes creating a normal model of machinery and equipment based on the selected training data.

[0006] Furthermore, Patent Document 2 describes that, with regard to the selection of multiple learning data prepared for each season according to seasonal fluctuations, etc., the sensor signal to be focused on and selected according to the anomaly is selected from the anomaly measure, which is the result of multivariate analysis, and the evaluation result of the influence of each sensor signal. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-70635 [Patent Document 2] Japanese Patent Application Laid-Open No. 2011-59790 Summary of the Invention [Problem to be solved by the invention]

[0008] In machinery, measurement data is acquired for various parameters to manage its operating state. When creating machine learning data to model the normal state of machinery, it is important to appropriately extract measurement data during operation when the machinery is in a normal state. However, in the case of machinery such as industrial robots installed on production lines, it has been difficult to properly extract data during normal operation.

[0009] Robots deployed on production lines typically perform the same operations repeatedly to repeatedly produce the same product. However, even if the robot itself is operating normally, its operation may be affected by the status of the machines responsible for the processes before and after it. For example, consider a case in which a robot receives a workpiece from a machine responsible for the preceding process, performs the work of that process (e.g., assembling parts), and then passes the workpiece to a machine responsible for the following process. Even if the robot is operating normally, if the cycle time of the robot is shorter than the cycle time of the machine responsible for the preceding process, the robot will experience waiting times and will not be constantly operating. Similarly, if the cycle time of the robot is shorter than the cycle time of the machine responsible for the following process, the robot will experience waiting times and will not be constantly operating.

[0010] Furthermore, even if the cycle time of the preceding and following processes and the cycle time of the robot in question are set to be equal, if an abnormality occurs in the preceding or following process, it may cause problems in the transfer of workpieces, and the robot may be forced to stop even if it is in a normal state. For example, it may wait until a workpiece is sent from a machine in charge of the preceding process, or it may stop operating until a machine in charge of the following process is ready to receive it.

[0011] In this way, even if the robot is in a normal state, the continuous measurement data includes data measured while the robot is on standby or stopped, and the learning data used to machine-learn the characteristics of normal operation will contain noise.

[0012] Furthermore, apart from noise during standby or stoppage, the various measurement data obtained when a robot repeatedly performs work operations also includes measurement data that does not represent the characteristics of normal operation. For example, when a robot operates using six-axis control, depending on the programmed work operations, some axes operate frequently, while others operate infrequently or do not operate at all. As a result, the data measuring the drive status of each axis includes measurement data that does not reflect the characteristics of normal operation. Therefore, if all of the measurement data were to be used, the training data for machine learning of the characteristics of normal operation would be redundant and contain noise.

[0013] Although Patent Documents 1 and 2 recognize the need to select training data, they do not fully consider specific methods for selecting and acquiring training data for machinery that performs repetitive operations, such as production machinery. For this reason, it has been difficult to create a trained model with high prediction accuracy using conventional methods.

[0014] Therefore, there was a need for a method to appropriately extract learning data for machine learning of the characteristics of normal operation of machinery and equipment, such as robots placed on a production line, which perform the same operations repeatedly but whose behavior changes depending on the situation in the preceding and following processes. [Means for solving the problem]

[0015] The present invention One aspect of teeth, Multiple joints of a robot Obtain the measured values ​​per unit time, Among the plurality of joints The number of times the measurement value reaches the specified value For most joints, the above measurements By detecting that the predetermined number of times has passed, robot The period during which the and the period of non-operation during which the robot was in an inoperative state. and acquiring feature values ​​from the measurement values ​​corresponding to the operating period as machine learning data; excluding the measurement values ​​corresponding to the non-operating period from the machine learning data; By machine learning using the machine learning data, robotand acquiring a trained model for acquiring the state of the information processing method.

[0016] Furthermore, the present invention Another aspect of teeth, Multiple joints of a robot and obtain the measured values ​​per unit time. Among multiple joints The number of times the measurement value reaches the specified value For most joints, the above measurements By detecting that the predetermined number of times has passed, robot The period during which the and the period of non-operation during which the robot was in an inoperative state. and acquiring feature values ​​from the measurement values ​​corresponding to the operating period as machine learning data; excluding the measurement values ​​corresponding to the non-operating period from the machine learning data; By machine learning using the machine learning data, robot The information processing device is characterized by comprising a control unit that acquires a trained model for acquiring the state of the information processing device. [Effects of the Invention]

[0017] According to the present invention, for example, for machinery that repeatedly performs the same operation but whose behavior changes depending on the status of the preceding and following processes, it is possible to appropriately extract learning data for machine learning of the characteristics of normal operation, thereby enabling the creation of a failure prediction model with high prediction accuracy. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a schematic functional block diagram for explaining functional blocks included in a failure prediction system according to an embodiment; [Figure 2] FIG. 2 is a schematic diagram illustrating a hardware configuration of the embodiment. [Figure 3] 5A and 5B are schematic diagrams for explaining a feature extraction method according to the embodiment. [Figure 4] (a) Example of measurement data for one cycle of operation. (b) Example of unit record data (unit record) when the device is operating continuously. (c) Example of unit record data (unit record) when it includes a period of non-operation. [Figure 5](a) A diagram for explaining an operation profile, (b) A diagram showing a case where it is determined that the device is in operation, and (c) An example showing a case where it is determined that the device is not in operation. [Figure 6] 1 is a schematic diagram illustrating a machine learning method according to an embodiment. [Figure 7] 5A and 5B are schematic diagrams for explaining a method for determining a determination threshold value in the embodiment. [Figure 8] 1 is a schematic diagram for explaining a failure prediction method according to an embodiment; [Figure 9] 4 is a flowchart showing a processing procedure for generating a failure prediction model according to an embodiment. [Figure 10] 4 is a flowchart showing a procedure for failure prediction according to an embodiment. [Figure 11] FIG. 1 is a perspective view showing a six-axis robot as an example of mechanical equipment. [Figure 12] A diagram showing the movement of each rotary joint of a six-axis robot. [Figure 13] FIG. 4 is a schematic diagram illustrating a method for determining an operation profile according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0019] With reference to the drawings, embodiments of the present invention will be described, including a failure prediction system, a control method, a control device, a mechanical equipment equipped with a control device, a control program, a computer-readable recording medium, and the like, used to predict failures in mechanical equipment.

[0020] [Function block configuration] FIG. 1 is a schematic functional block diagram for explaining the configuration of functional blocks included in a failure prediction system according to an embodiment. While FIG. 1 uses functional blocks to represent functional elements necessary for explaining the features of this embodiment, general functional elements that are not directly related to the problem-solving principles of the present invention are omitted. Furthermore, the functional elements shown in FIG. 1 are conceptual functional elements and do not necessarily have to be physically configured as shown. For example, the specific form of distribution and integration of the functional blocks is not limited to the illustrated example, and all or part of them can be functionally or physically distributed and integrated in any unit depending on the usage situation, etc. As shown in FIG. 1, the failure prediction system of the embodiment includes a mechanical equipment 10 to be diagnosed and a failure prediction device 100.

[0021] The machinery 10 is various types of industrial equipment, such as an articulated robot or production equipment installed on a production line. The machinery 10 is equipped with various sensors 11 for measuring the state of the machinery. For example, if the machinery 10 is an articulated robot, sensors for measuring the current value of the motors that drive the joints, joint angle sensors, and sensors for measuring speed, vibration, and sound may be installed. However, this is merely an example, and an appropriate type and number of sensors may be installed as the sensors 11 in appropriate positions depending on the type of machinery 10 and the purpose of the work. The sensors 11 may include various types of sensors, such as force sensors, torque sensors, vibration sensors, sound sensors, imaging sensors, distance sensors, temperature sensors, humidity sensors, flow sensors, pH sensors, pressure sensors, viscosity sensors, and gas sensors. Although FIG. 1 shows the sensor 11 in singular for ease of illustration, multiple sensors are typically installed. The mechanical equipment 10 is connected to the failure prediction device 100 via wire or wirelessly so as to be able to communicate with the failure prediction device 100, and the failure prediction device 100 can acquire data measured by the sensor 11 via communication.

[0022] In the failure prediction model creation stage, the failure prediction device 100 uses data collected from the sensor 11 to select feature quantities highly correlated with the occurrence of a failure in mechanical equipment, and performs machine learning using the selected feature quantities to generate and store a trained model (failure prediction model). In addition, in the evaluation stage (failure prediction stage), the data collected from the sensor 11 at the time of evaluation is input into the trained model, and the degree of deviation is calculated using the input and output of the trained model to determine whether a failure is approaching. Below, the functional blocks of the failure prediction device 100 will be explained in order. The failure prediction device 100 includes a control unit 110, a storage unit 120, a display unit 130, and an input unit 140.

[0023] The control unit 110 includes multiple functional blocks, which are configured, for example, by a control program stored in a storage device, read and executed by the CPU of the failure prediction device 100. Alternatively, some or all of the functional blocks may be configured by hardware such as an ASIC provided in the failure prediction device 100.

[0024] The storage unit 120 includes a sensor data storage means 121, a feature amount storage means 122, an operation profile storage means 123, an operating state determination storage means 124, a failure prediction model condition storage means 125, and a failure prediction model storage means 126. These means included in the storage unit 120 are configured by being appropriately allocated to storage areas of a storage device such as a hard disk drive, RAM, or ROM. The storage unit 120 is a data acquisition unit that acquires and stores various data necessary for processing to perform failure prediction.

[0025] The display unit 130 and the input unit 140 are user interfaces provided in the failure prediction device 100. The display unit 130 uses a display device such as a liquid crystal display or an organic EL display, and the input unit 140 uses an input device such as a keyboard, a jog dial, a mouse, a pointing device, or a voice input device.

[0026] The sensor data collection means 111 of the control unit 110 acquires measurement data from the sensors 11 of the mechanical equipment 10 and stores it in the sensor data storage means 121. That is, measurement data relating to the state of the mechanical equipment, such as current, speed, pressure, vibration, sound, temperature of each part, etc. measured in the mechanical equipment 10, is collected and stored in the sensor data storage means 121.

[0027] The feature extraction means 112 extracts feature values ​​that indicate characteristics of the state of the mechanical equipment 10 based on the measurement data stored in the sensor data storage means 121 and stores the feature values ​​in the feature storage means 122. For example, the feature data may be the maximum and / or minimum values ​​of sensor measurement values ​​collected during one operating cycle of the mechanical equipment, or the average value. Alternatively, the feature data may be, for example, a time-series frequency domain integral transformation of the sensor measurement values ​​over a predetermined period of time. The feature data may also be a differential value or a second-order differential value with respect to time of the measurement values ​​arranged in a time series. Furthermore, if the sensor measurement values ​​(raw data) themselves are useful as information for determining whether a failure is approaching, the measurement values ​​themselves may be treated as feature data. In this embodiment, the feature extraction means 112 extracts or calculates feature values ​​based on the sensor measurement data, creates time-series feature data, and stores the feature data in the feature storage means 122. Feature extraction will be described in detail later with reference to FIG. 3.

[0028] The state determination means 113 acquires sensor data from the sensor data storage means 121, feature amounts from the feature amount storage means 122, and an operation profile definition for determining the operating state from the operation profile storage means 123. The operation profile definition is information related to criteria for determining whether the mechanical equipment 10 is operating (in operation) or stopped (not operating). The state determination means 113 identifies the period during which the mechanical equipment 10 was operating (in operation) based on the acquired information. Then, it stores information related to the period during which the mechanical equipment 10 was determined to be operating (in operation) in the operating state determination storage means 124. Note that the state determination means 113 does not necessarily have to acquire both the sensor data and the feature amounts; for example, if the operating state of the mechanical equipment 10 can be determined based on the sensor data alone, it may acquire only the sensor data.

[0029] When generating a trained model, the data extraction means 114 extracts features from the feature storage means 122 based on information about the operating period of the mechanical equipment stored in the operating state determination storage means 124 and information stored in the failure prediction model condition storage means 125. The extracted features are output to the failure prediction model generation means 115 as data for machine learning. The failure prediction model condition storage means 125 stores in advance information that identifies, from among various features, features that represent characteristics of the mechanical equipment in a normal state. For this reason, features that represent characteristics of the mechanical equipment in a normal state are selected as data for machine learning, and only the portion corresponding to the period when the mechanical equipment is in operation is extracted.

[0030] Furthermore, at the time of evaluation, the data extraction means 114 extracts features from the feature storage means 122 based on information relating to the operating period of the mechanical equipment 10 stored in the operating state determination storage means 124 and information stored in the failure prediction model condition storage means 125. The extracted features are output as evaluation feature data to the failure determination means 116. For this reason, the same types of features as those used during machine learning are selected as the evaluation feature data, and only the portion corresponding to the period during which the mechanical equipment is in operation is extracted.

[0031] The failure prediction model generation means 115 generates a trained model (failure prediction model) using the machine learning data input from the data extraction means 114 when generating the trained model, and stores the trained model in the failure prediction model storage means 126.

[0032] The failure determination means 116 inputs the feature data for evaluation input from the data extraction means 114 at the time of evaluation into a trained model (failure prediction model) stored in the failure prediction model storage means 126, calculates the degree of deviation between the input and the output, and then compares the degree of deviation with a determination threshold to determine whether or not there is a sign of failure. The fault notification means 117 notifies an external device of the determination result of the fault determination means 116 and displays it on the display unit 130 .

[0033] [Hardware configuration] FIG. 2 shows a schematic diagram of an example of the hardware configuration of a failure prediction system according to an embodiment. As shown in FIG. 2, the failure prediction system may include PC hardware equipped with a CPU 1601 as a main control unit, a ROM 1602 as a storage device, and a RAM 1603. The ROM 1602 can store information such as processing programs and inference algorithms for implementing the failure prediction method described below. The RAM 1603 is used as a work area for the CPU 1601 when executing the control procedure. An external storage device 1606 is also connected to the control system. The external storage device 1606 may be an HDD, an SSD, or an external storage device of another system mounted via a network.

[0034] The processing program of the CPU 1601 for implementing the failure prediction method of this embodiment, which will be described later, can be stored in a storage unit such as an external storage device 1606, such as an HDD or SSD, or a ROM 1602 (e.g., an EEPROM area). In this case, the processing program of the CPU 1601 for implementing the failure prediction method can be supplied to each of the above storage units via a network interface (NIF) 1607 and updated with a new (different) program. Alternatively, the processing program of the CPU 1601 for implementing the failure prediction method can be supplied to each of the above storage units via various storage means, such as magnetic disks, optical disks, and flash memories, and their associated drives, and updated. Various storage means, storage units, or storage devices storing a program capable of executing the processing of the CPU 1601 for implementing the failure prediction method constitute a computer-readable recording medium storing the failure prediction procedure of the present invention.

[0035] The sensor 11 shown in Fig. 1 is connected to the CPU 1601. In Fig. 2, for the sake of simplicity, the sensor 11 is shown as being directly connected to the CPU 1601, but it may be connected via, for example, IEEE488 (so-called GPIB) or the like. The sensor 11 may also be configured to be connected to the CPU 1601 via a network interface 1607 and a network 1608.

[0036] The network interface 1607 can be configured using a communication standard for wired communication such as IEEE 802.3 or wireless communication such as IEEE 802.11 or 802.15. The CPU 1601 can communicate with other devices 1104 and 1121 via the network interface 1607. For example, if the mechanical equipment to be subjected to failure prediction is a robot, the devices 1104 and 1121 may be a central control device such as a PLC or sequencer arranged to control and manage the robot, or a management server.

[0037] In the example shown in Fig. 2, an operation unit 1604 and a display device 1605 related to the input unit 140 and display unit 130 shown in Fig. 1 are connected as a UI device (user interface device). The operation unit 1604 can be configured by a terminal such as a handy terminal, or devices such as a keyboard, a jog dial, a mouse, a pointing device, a voice input device, etc. (or a control terminal equipped with these). The display device 1605 may be any device that can display information related to the processing executed by the state determination means 113, the failure prediction model generation means 115, the failure determination means 116, etc. on a display screen, and for example, a liquid crystal display device can be used.

[0038] [About failure prediction methods] In this embodiment, the failure prediction model generation means 115 of the failure prediction device 100 constructs a trained model (failure prediction model) by so-called unsupervised learning. To learn the characteristics of mechanical equipment failures by so-called unsupervised learning, machine learning is performed using only operational data from a fault-free state, i.e., when the mechanical equipment is operating normally. Unsupervised learning is a method in which a learning device is provided with a large amount of input data alone, and the device learns the distribution of the input data. In other words, this is a method in which a device that performs processes such as compression, classification, and shaping on input data learns the process without providing it with training output data corresponding to the input data.

[0039] A failure prediction method using unsupervised learning techniques will now be described in detail. Machine learning is performed using only operational data of the machinery in its normal state, with the normal state being defined as a state in which the machinery is operating within an acceptable range in light of its intended use. In this embodiment, an autoencoder is used as the unsupervised learning model.

[0040] This embodiment is characterized by the method of extracting data used for machine learning. Specifically, feature quantities that represent the behavior of machinery when it is in a normal state are selected, and only data during the period when the machinery is in operation is extracted from the continuous data of the selected feature quantities and used as learning data.

[0041] First, the extraction of feature quantities will be described with reference to FIG. 3 . The sensors 11 included in the mechanical equipment 10 to be subjected to failure prediction include, as illustrated in FIG. 3 , sensor 1, which is a current sensor, sensor 2, which is a speed sensor, and sensor 3, which is a pressure sensor. In the failure prediction method according to this embodiment, feature quantities indicating the operating state of the mechanical equipment 10 are first extracted based on the measurement data of each sensor included in sensor 11. The feature quantities are extracted by performing processes on the time-series measurement data of the sensors, such as integral transformation into the frequency domain, calculating first and second derivatives with respect to time, filtering, and extracting maximum and minimum values ​​of periodic behavior. Note that the sensors and measurement data processing described above are merely examples, and any sensor or measurement data processing may be used as long as it can acquire data suitable for understanding the state of the mechanical equipment. Furthermore, if the state of the mechanical equipment can be easily analyzed using the sensor measurement data itself, the measurement data itself may be used as the feature quantities without any special processing. Figure 3 shows a schematic diagram of the state in which time-series data for a total of nine types of features shown on the right side are extracted by performing three types of processing on the measurement data from sensors 1, 2, and 3.

[0042] Next, a method for determining whether mechanical equipment 10 is operating (in operation) or stopped (not operating) and for identifying the operating (in operation) period will be described. Here, an articulated robot that is installed in a production line and is responsible for one process in the manufacturing process is taken as an example of the mechanical equipment 10. The articulated robot receives a workpiece from a machine responsible for the preceding process, performs the task of that process (for example, assembling parts), and passes the workpiece to a machine responsible for the following process, but it repeatedly performs the same operation to repeatedly produce the same product.

[0043] FIG. 11 shows an external view of a six-axis articulated robot, which is an example of the mechanical equipment 10. Links 200 to 206 are connected in series by six rotary joints J1 to J6. Each rotary joint is equipped with a sensor that measures the rotation speed of the motor, a sensor that measures the rotation angle of the joint, a torque sensor, and the like. A robot hand 210 can be attached to the link at the tip. A teaching pendant 102 is connected to a control device 101 that controls the robot's movements, allowing an operator to teach the robot movements.

[0044] Robots installed on production lines perform cycles, i.e., repeating set operations. In the case of six-axis articulated robots, depending on the nature of the cycle, some axes may operate frequently, while others may not operate at all. For example, in a process that rotates a workpiece at a fixed position, only the rotary joint J6 at the tip needs to operate, and the other rotary joints J1 to J5 do not operate. On the other hand, in a process that moves a workpiece horizontally, the rotary joint J1 is mainly in operation, and J5 and J6, which are closer to the tip, may not operate.

[0045] 12 shows the direction of movement of each rotary joint of a six-axis articulated robot, and whether or not each rotary joint is being driven can be determined, for example, by measuring the rotational speed of the motor that drives the rotary joint with a sensor. However, as mentioned above, the movement of each rotary axis differs depending on the content of the cyclic operation, so in order to determine whether or not the robot is in operation, it is best to measure the rotational speed of the rotary joint that is driven most frequently in the cyclic operation performed by the robot.

[0046] Here, we will explain a method for selecting the rotary joint that is driven most frequently while the robot is performing a cyclic operation. Figure 13 shows the measurement results of the rotational speed sensors of the rotary joints J1 to J6 when the robot is stably continuing a certain cyclic operation (e.g., assembly work). One cycle of the cyclic operation is 10 seconds, and the sensor output waveforms for six cycles are shown. As shown, in this cyclic operation (e.g., assembly work), it is clear that the rotary joint J5 is driven most frequently throughout the entire period, while the rotary joints J1 and J6 are not driven. Therefore, monitoring the rotational speed of the rotary joint J5 is said to be the most suitable way to determine whether the robot performing this cyclic operation is in operation.

[0047] To automatically select the rotary joint that is operating most frequently, the failure prediction device 100 acquires rotational speed data from the sensor 11 for each rotary joint that is operating stably and measures the number of times the rotational speed reaches zero (the number of times the graph crosses zero). The control unit 110 compares the number of times the rotational speed reaches zero for each rotary joint and determines the rotary joint with the highest number of times (J5 in the example of Figure 13) as the rotary joint to be used in the operation profile. This is because the rotary joint with the highest number of times switches speed the most and is therefore the most suitable for determining operation. In other words, the profile information described below is set based on the measurement values ​​measured by multiple sensors that change most when the mechanical equipment performs a predetermined repetitive operation.

[0048] Figure 4(a) shows an example of measurement data of the rotational speed of the motor that drives the rotary joint J5 determined in this way, and shows the waveform for the period during which one process is performed (one cycle of operation). Here, one cycle of operation is performed in 10 seconds as an example.

[0049] The sensor data collection means 111 collects measurement data outputted from the sensor 11 in time series and stores it in the sensor data storage means 121. At that time, for convenience of handling, the measurement data that is continuous in time is divided into predetermined time intervals (for example, 60 seconds), and the measurement data for the predetermined time is treated as one unit of recorded data (unit record). The period corresponding to each unit of recorded data (unit record) is called a unit recording period.

[0050] Figure 4(b) is a graph showing an example of unit record data (unit record) when a robot in a normal state is continuously operating (working). On the other hand, as already explained, a robot installed in a production line may temporarily stop operating (become in a non-operating state) due to the status of the machines in charge of the preceding and following processes. In such a case, the unit record data (unit record) will include measurement data from the non-operating state, as shown in Figure 4(c).

[0051] The robot is continuously operating during the unit recording period shown in Fig. 4(b), so there is no problem in using the feature values ​​corresponding to this unit recording period as learning data. However, the unit recording period shown in Fig. 4(c) includes a period when the robot was not operating, even if it was in a normal state, so the feature values ​​corresponding to this unit recording period contain noise when used as learning data.

[0052] Therefore, in this embodiment, the state determination means 113 checks whether the mechanical equipment (robot) has entered a non-operating state for the unit recording period corresponding to each unit recording data (unit record) stored in the sensor data storage means 121.

[0053] Specifically, profile information relating to the characteristics of one cycle of repeated operation is stored in advance in the operation profile storage means 123. In this example, as shown in Figure 5(a), the speed of the motor, which repeatedly accelerates and decelerates, has the characteristic of reaching zero eight times within one cycle (10 seconds), so the number of zero crossings of the speed is 0.8 times per second, which is stored in advance as profile information indicating the operating state. In other words, the profile information is set based on the number of times the measurement value of the speed sensor reaches zero within a unit time.

[0054] The state determination means 113 acquires profile information indicating the operating state (number of zero crossings of the speed is 0.8 times / second) from the operating profile storage means 123. Then, for each unit record data (unit record) of the motor speed stored in the sensor data storage means 121, it determines whether it is in the operating state (whether it includes a non-operating state).

[0055] For example, as shown in Figure 5(b), if the robot is operating continuously without stopping, 48 zero crossings are counted in a 60-second unit record, which is calculated as 0.8 times per second, and since this matches the profile, it is determined that the robot is operating.

[0056] On the other hand, if the unit record data (unit record) includes a period in which the robot was stopped, as shown in Figure 5(c), the number of zero crossings will be counted only 24 times, calculated as 0.4 times / second, which does not match the profile, and it is determined that the period includes non-operation.

[0057] The profile information for determining "operating" does not necessarily have to be set to a fixed value (0.8 times / second). Taking into account fluctuations in the robot's operating speed on the production line (fluctuations in takt time), the profile information may be set with a predetermined width, such as a range of ±20% centered around 0.8 times / second. Alternatively, a threshold value may be set, for example, at 0.7 times / second, and any value above that may be determined to be "operating," while any value below that may be determined to be "not operating."

[0058] In this way, it is determined whether the robot was "in operation" or "including non-operation" in the unit recording period corresponding to each unit recording data (unit record). In this way, the state determination means 113 identifies the unit recording period in which the robot was in operation, and stores the information in the operation state determination storage means 124. For example, among the information on the time axis (calendar information), a label of "in operation" is assigned to a unit recording period that is determined to be in operation, and a label of "noise" is assigned to a unit recording period that included non-operation, and these are stored in the operation state determination storage means 124.

[0059] When performing machine learning, the data extraction means reads information on a unit recording period labeled "operating" from the operation state determination storage means 124, and extracts features corresponding to the unit recording period from the feature storage means 122. The data extraction means outputs the extracted features to the failure prediction model generation means 115 as learning data.

[0060] In this way, according to this embodiment, by selectively extracting only the feature data corresponding to the unit recording period during which the robot was in operation (in motion) from the time-series feature data, it is possible to create data for machine learning with less noise.

[0061] Next, with reference to the schematic diagram in Figure 6, we will explain a method for having an autoencoder perform machine learning using the training data extracted as described above. An autoencoder is a type of neural network that compresses (encodes) input training data into a small amount of information and then restores (decodes) it. Through machine learning, it learns "parameters for effectively compressing and restoring input data," i.e., the characteristics of the input data.

[0062] An autoencoder encodes the input value x and compresses it in the intermediate layer z. It then decodes the intermediate layer z and restores it as the output value y. In this process, it uses machine learning to minimize the restoration error J between the input and output values.

[0063] That is, the autoencoder determines W and b in Equation 1 and W′ and b′ in Equation 2 so as to reduce the recovery error J in Equation 3 shown below, where s is an activation function.

[0064]

number

[0065]

number

[0066]

number

[0067] If data with similar features to the training data is input into a trained autoencoder (sometimes referred to as a trained model or failure prediction model), it will output an output value with a small restoration error through encoding and decoding using the parameters acquired during training.On the other hand, if data with different features from the training data is input into a trained model, the parameters acquired during training cannot compress and decode it properly, resulting in a large restoration error.

[0068] To utilize this characteristic for predicting a fault state (abnormal state), in this embodiment, a feature value corresponding to the period during which the robot was in a normal state and in operation (in motion) is given as an input value x to an autoencoder for machine learning.

[0069] Furthermore, when performing failure prediction, from the feature quantities extracted during evaluation, feature quantities that are the same type as those selected during learning and that correspond to the period when the machine was in operation (in operation) are extracted, and input into the trained model as input value x, which is then output as output value y. Then, the reconstruction error of output value y relative to input value x is calculated, and the reconstruction error, i.e., the degree of deviation between input and output, is treated as an index showing the degree to which the machine equipment deviates from its normal state.

[0070] In this embodiment, a determination threshold is set in advance to be used when determining whether a mechanical equipment failure is imminent using the deviation. To set the determination threshold, first, feature amounts based on actual sensor data of the mechanical equipment from a normal state until a failure occurs are extracted and input into the trained model, and the change in deviation over time until the failure occurs is examined.

[0071] In this embodiment, the feature data used in this case is the same type of feature as that selected during learning (feature obtained by performing the same processing on measurement data from the same sensor) and is extracted as feature corresponding to the period when the machine was in operation (in operation). The period when the machine was in operation (in operation) is identified by determination using the operation profile, as described in the creation of learning data. A determination threshold is set based on the change in the deviation over time to determine whether a failure is imminent. If the deviation is equal to or greater than the determination threshold, it is determined that a failure of the mechanical equipment is imminent, i.e., there is a sign of a failure.

[0072] Fig. 7 is a diagram specifically illustrating a method for determining a judgment threshold. The horizontal axis of the graph in Fig. 7 is time (hour), and the vertical axis is an index value (deviation between input and output of the trained model) indicating the degree of approach to the occurrence of a fault, and shows the change in the index value over time from the initial normal state until the occurrence of a fault. For convenience of illustration, the deviation calculated based on feature amounts corresponding to the period when the system was in operation (in operation) is shown as a continuous graph over time.

[0073] Let us assume that we want to ensure a predetermined period t of operating time from when the failure prediction device predicts and notifies us of an impending failure until the failure actually occurs, i.e., when we want the failure prediction device to predict a predetermined period t before the failure occurs. In this case, as shown in the figure, the numerical value of the index value (the degree of deviation between the input and output of the trained model) at a point in time predating the occurrence of the failure by the predetermined period t is set as the judgment threshold T for failure prediction (judgment threshold setting process).

[0074] Next, we will explain a failure prediction method using the above-mentioned trained model and judgment threshold. Figure 8 is a schematic diagram for explaining a failure prediction method using an autoencoder.

[0075] Evaluation data showing the operating state of the machinery at the time of evaluation is input into the trained model, and the input and output values ​​are used to calculate the degree of deviation that indicates how far the machinery deviates from the trained normal state. The evaluation data used is data from the time of evaluation for the same type of features selected during training (features obtained by performing the same processing on measurement data from the same sensor), and is extracted from features corresponding to the period when the machinery was in operation (in operation). The period when the machinery was in operation (in operation) is identified by judgment using the operation profile, as described in creating the training data.

[0076] Specifically, as shown in Fig. 8, evaluation data is input into the failure prediction model, and the recovery error J between the resulting output value y and input value x of the failure prediction model is calculated and treated as the deviation from the normal state. In this embodiment, this deviation is treated as an index value indicating the degree of approach to the occurrence of a failure. If the deviation (recovery error J) is equal to or greater than the judgment threshold T, it is determined that the period until the occurrence of a failure is equal to or less than the predetermined period t, i.e., there is a sign of a failure. Conversely, if the deviation (recovery error J) is less than the judgment threshold T, it is determined that the period until the occurrence of a failure is longer than the predetermined period t, i.e., there is no sign of a failure.

[0077] [Processing Procedure] Next, the procedure of the process executed by the failure prediction device 100 will be described with reference to the flowcharts of FIGS. [Generate Model] FIG. 9 is a flowchart showing a processing procedure for generating a failure prediction model.

[0078] First, in step S101, the sensor data collection means 111 of the failure prediction device 100 acquires measurement data from the sensors 11 for measuring the state of the mechanical equipment 10, and stores the data in the sensor data storage means 121. That is, measurement values ​​related to the mechanical equipment in a normal state are acquired during a first period (measurement data acquisition process).

[0079] Next, in step S102, the feature extraction means 112 extracts features indicating the characteristics of the operating state of the mechanical equipment 10 based on the sensor data stored in the sensor data storage means 121, and stores them in the feature storage means 122 (feature extraction process). Next, in step S103, the state determination means 113 reads out unit record data (unit record) from the sensor data storage means 121.

[0080] Next, in step S104, the state determination means 113 compares the read unit record data (unit record) with the profile stored in the operation profile storage means 123, and determines whether the robot was operating during that unit recording period. If it is determined that the robot was operating (step S104: yes), the process proceeds to step S105, where the state determination means 113 labels that unit recording period of the calendar information as "operating" and stores it in the operation state determination storage means 124. If it is determined that the unit recording period includes non-operating periods (step S104: no), the process proceeds to step S106, where the state determination means 113 labels that unit recording period of the calendar information as "noise" and stores it in the operation state determination storage means 124.

[0081] Next, in step S107, it is determined whether the number of unit recording periods labeled "in operation" has reached a predetermined number. Here, the predetermined number is a number that is set in advance to ensure a sufficient amount of machine learning data to generate a highly accurate failure prediction model. If the number of unit recording periods labeled "in operation" has not reached the predetermined number (step S107: no), steps S103 and subsequent steps are repeated until the number reaches the predetermined number. If the number of unit recording periods labeled "in operation" has reached the predetermined number (step S107: yes), proceed to step S108.

[0082] In step S108, the data extraction means 114 extracts features from the feature storage means 122 based on information related to the period during which the mechanical equipment is in operation stored in the operating state determination storage means 124 and information stored in the failure prediction model condition storage means 125. The failure prediction model condition storage means 125 pre-stores information specifying which of various feature values ​​represents the characteristics of the mechanical equipment in a normal state (for example, a feature selected from the nine feature values ​​shown on the right side of Figure 3). The operating state determination storage means 124 also stores information specifying the period during which the mechanical equipment is in operation. Therefore, feature values ​​representing the characteristics of the mechanical equipment in a normal state are selected as data for machine learning, and only the portion corresponding to the period during which the mechanical equipment is in operation is extracted (learning data extraction process). The extracted feature values ​​are output to the failure prediction model generation means 115 as data for machine learning.

[0083] Next, in step S109, the failure prediction model generation means 115 generates a trained model (failure prediction model) using the machine learning data input from the data extraction means 114 and stores it in the failure prediction model storage means 126 (trained model generation process). By performing the above series of processes, a trained model (fault prediction model) can be generated.

[0084] [Failure prediction] Next, the procedure of the process executed by the failure prediction device 100 using the generated trained model (failure prediction model) when determining whether the mechanical equipment 10 is approaching the occurrence of a failure will be described.

[0085] 10 is a flowchart showing the processing procedure. The process of determining whether the mechanical equipment 10 is approaching a failure is started, for example, by a user using the input unit 140 of the failure prediction device 100 to instruct the start of the process. Alternatively, the control program of the failure prediction device 100 may be configured to automatically start the process according to the operating time of the mechanical equipment 10.

[0086] When the process starts, in step S201, the sensor data collection means 111 of the failure prediction device 100 acquires measurement data from the sensors 11 for measuring the state of the mechanical equipment 10 and stores the data in the sensor data storage means 121. In other words, the measurement values ​​related to the mechanical equipment during the evaluation period are acquired. Next, in step S202, the feature extraction means 112 extracts features that indicate the characteristics of the operating state of the mechanical equipment 10 based on the sensor data stored in the sensor data storage means 121, and stores them in the feature storage means 122.

[0087] Next, in step S203, the state determination means 113 reads unit record data (unit record) from the sensor data storage means 121 and compares it with the profile stored in the operation profile storage means 123. Then, it is determined whether the robot was operating during that unit recording period. If it is determined that the robot was operating, the state determination means 113 labels that unit recording period of the calendar information as "operating" and stores it in the operation state determination storage means 124. If it is determined that the unit recording period includes non-operating periods, the state determination means 113 labels that unit recording period of the calendar information as "noise" and stores it in the operation state determination storage means 124. It is desirable to repeat steps S201 to S203 until a sufficient number of samples of "operating" labels are secured to perform highly accurate failure prediction. Once a sufficient number of "operating" labels have been assigned to the calendar information to perform highly accurate evaluation, the process proceeds to step S204.

[0088] In step S204, the data extraction means 114 extracts features from the feature storage means 122 based on information about the period during which the mechanical equipment is in operation stored in the operating state determination storage means 124 and information stored in the failure prediction model condition storage means 125. The failure prediction model condition storage means 125 pre-stores information that identifies, among various features, features that represent characteristics of the mechanical equipment in a normal state (for example, features selected from the nine types of features shown on the right side of Figure 3). The operating state determination storage means 124 also stores information that identifies the period during which the mechanical equipment is in operation. Therefore, the same types of features used when creating the learning data are selected as evaluation data, and only the portions corresponding to the period during which the mechanical equipment is in operation are extracted (evaluation data extraction process). The extracted features are output as evaluation data to the failure determination means 116.

[0089] Next, in step S205, the fault judgment means 116 inputs the evaluation feature data input from the data extraction means 114 into the trained model (fault prediction model) stored in the fault prediction model storage means 126, and calculates the degree of deviation between the input and the output.

[0090] Next, in step S206, the failure determination means 116 compares the calculated deviation with a determination threshold value to determine whether or not the mechanical equipment 10 is approaching the occurrence of a failure, that is, whether or not there is a sign of a failure. If the deviation is equal to or greater than the determination threshold (step S206: yes), it is determined that a failure of the mechanical equipment 10 is imminent, and the process proceeds to step S207.

[0091] In step S207, the fault determination means 116 issues a notification command to the fault notification means 117. Upon receiving the notification command, the fault notification means 117 notifies the user of the determination result of the fault determination means 116. When making the notification, the user is notified via a user interface, and information related to the determination may be stored in the memory unit 120 or provided to an external device via an external interface. To notify the user, processing such as displaying on the display unit 130 of the fault prediction device 100, issuing a voice message, or printing and outputting on a medium such as paper may be performed. When notification to the user is complete, the processing ends (END).

[0092] If the deviation is less than the judgment threshold (step S206: no), it is judged that the occurrence of a failure in the mechanical equipment 10 is far away, i.e., there are no signs of a failure, and the process ends (END). Note that even if it is judged that there are no signs of a failure, the result may be notified to the user, information related to the judgment may be stored in a storage device, or provided to an external device via an external interface.

[0093] As described above, in this embodiment, various feature amounts are extracted based on sensor measurement data for machinery and equipment, such as robots installed on a production line, which repeatedly perform the same operation but whose behavior changes depending on the status of the preceding and following processes.From these feature amounts, feature amounts suitable for machine learning of the robot's normal behavior are selected.

[0094] In addition, from the sensor measurement data, measurement data that changes significantly when the robot performs its operation is selected, and profile information is set to identify the operating state (operation). Then, by comparing the measurement data for a given period with the profile information, it is determined whether the robot was operating during that period. This makes it possible to extract only the feature values ​​from the time-series feature data that represent the operating period and create data for machine learning. By creating machine learning data with less noise, it is possible to create a trained model (failure prediction model) with higher prediction accuracy than conventional models. Furthermore, when setting the judgment threshold and creating evaluation data, it is possible to extract only the feature values ​​from the operating period, thereby improving the accuracy of failure prediction using the trained model (failure prediction model).

[0095] [Other embodiments] The present invention is not limited to the above-described embodiment, and many modifications are possible within the scope of the technical concept of the present invention. For example, in the above-described embodiment, a failure prediction model was created using an autoencoder by a so-called unsupervised learning method, but the present invention can also be implemented by creating a failure prediction model using a so-called supervised learning method. Supervised learning is a method of providing a large amount of data sets of certain inputs and results (labels) to a learning device, causing it to learn the features of those data sets, and constructing a model that estimates results from inputs, i.e., a trained model that inductively acquires the relationship between inputs and outputs.

[0096] Furthermore, in the above-described embodiment, a method using a neural network has been described as an example of machine learning, but the machine learning method is not limited to this, and other methods may be used, such as genetic programming, functional logic programming, support vector machines, etc. Although a general-purpose computer or processor may be used as a device for performing machine learning, high-speed processing is possible when a graphics processing unit with a GPGPU function or a large-scale PC cluster is used.

[0097] Furthermore, machine learning is not limited to one time, and additional learning may be performed. In this case, additional learning is performed by extracting only the feature amounts from the period when the machinery equipment was in operation.

[0098] Furthermore, for the operating profile, it is advisable to select the parameters that change most frequently when the machinery or equipment performs its operation, but the rotational speed of a rotary joint is just one example, and parameters for determining the operating state can be selected appropriately depending on the type of machinery or equipment and its operation.

[0099] In addition, in the embodiment, the number of zero crossings per unit time is used as an index to determine whether a period is in operation or not, but the present invention is not limited to this. For example, the number of inflection points or the number of extreme values ​​per unit time may be used as an index.

[0100] In the above-described embodiment, the failure prediction device extracts feature amounts from the acquired sensor data, identifies the period in which the device is in operation, and extracts feature amounts for that period from all feature amounts, but the processing method is not limited to this example. For example, the device may first identify the period in which the device is in operation based on the sensor data, and then extract feature amounts from only the sensor data corresponding to that period.

[0101] The failure prediction device of the present invention can be applied to failure prediction of various machines and equipment, such as industrial robots, service robots, processing machines operated by computer numerical control, etc. The failure prediction device may be integrated with the machine equipment to form a failure prediction system, or the failure prediction device may be provided as part of the machine equipment.

[0102] The present invention can also be realized by supplying a program that realizes one or more functions of the embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0103] 10. Mechanical equipment / 11. Sensor / 100. Failure prediction device / 110. Control unit / 111. Sensor data collection means / 112. Feature extraction means / 113. State determination means / 114. Data extraction means / 115. Failure prediction model generation means / 116. Failure determination means / 117. Failure notification means / 120. Storage unit / 121. Sensor data storage means / 122. Feature storage means / 123. Operation profile storage means / 124. Operation state determination storage means / 125. Failure prediction model condition storage means / 126. Failure prediction model storage means / 130. Display unit / 140. Input unit

Claims

1. Acquire measurements related to multiple joints of a robot, identifying an operating period in which the robot was in an operating state and an inactive period in which the robot was in an inactive state by detecting that the measurement value of a joint among the plurality of joints has reached a predetermined value the most times per unit time; acquiring feature values ​​from the measurement values ​​corresponding to the operating period as machine learning data, and excluding the measurement values ​​corresponding to the non-operating period from the machine learning data; obtaining a trained model for acquiring the state of the robot by machine learning using the machine learning data; An information processing method comprising:

2. The predetermined number of times has a predetermined upper limit value and a predetermined lower limit value.

2. The information processing method according to claim 1,

3. The unit time is a time having a predetermined length of time.

2. The information processing method according to claim 1,

4. acquiring a state of the robot using the trained model; 4. The information processing method according to claim 1, wherein:

5. In determining the state of the robot, Identifying the operating period within the evaluation period for which the determination is made; acquiring, as evaluation features, features based on measurement values ​​corresponding to the operation period in the evaluation period; acquiring an index value indicating the degree to which the robot has deviated from a normal state based on the evaluation feature amount and the trained model, and determining the state of the robot during the evaluation period; 5. The information processing method according to claim 4.

6. inputting data on feature quantities of the same type as the feature quantities acquired as the machine learning data, from the time when the robot changes from the normal state to the abnormal state, into the trained model, determining a degree of deviation between the input data input into the trained model and output data output from the trained model, and acquiring a judgment threshold value based on a change in the degree of deviation over time during the period when the robot changes from the normal state to the abnormal state; determining the state of the robot during the evaluation period using the index value and the determination threshold value; 6. The information processing method according to claim 5,

7. In acquiring the judgment threshold, data for the operating period from data of the robot when the robot changes from the normal state to the abnormal state is acquired and input into the trained model.

7. The information processing method according to claim 6,

8. In acquiring the trained model, the trained model is acquired by machine learning using an autoencoder.

8. The information processing method according to claim 1, wherein:

9. The control unit notifies the result of the determination of the state of the robot.

9. The information processing method according to claim 1, wherein:

10. The operating state is a state in which the robot repeatedly executes a predetermined operation.

10. The information processing method according to claim 1, wherein:

11. the measurement values ​​include a plurality of measurement values ​​measured by a plurality of sensors, identifying the operating period based on a measurement value that exhibits a large degree of change while the robot repeatedly executes the predetermined operation, among the plurality of measurement values; 11. The information processing method according to claim 10.

12. the predetermined value is zero; 12. The information processing method according to claim 1, wherein:

13. The unit time is 10 seconds, and a period in which the number of occurrences is 8 is specified as the operation period.

13. The information processing method according to claim 12.

14. The predetermined value includes at least one of an inflection point of the measurement value and an extreme value of the measurement value.

14. The information processing method according to claim 1,

15. Labeling the active period as active; 15. The information processing method according to claim 1,

16. labeling at least a portion of the non-operating period as noise based on the number of times the measurement value reaches the predetermined value per unit time; 16. The information processing method according to claim 1,

17. The predetermined value or the number of times can be set by the user.

17. The information processing method according to claim 1.

18. A reference value of the number of times is set.

18. The information processing method according to claim 1,

19. A range is set for the reference value.

20. The information processing method according to claim 18,

20. The range is a range of ±20% centered on the reference value.

20. The information processing method according to claim 19.

21. The measured value is information about the speed, 14. The information processing method according to claim 1,

22. The robot repeats the actions of receiving a workpiece, assembling the workpiece, and handing over the workpiece.

22. The information processing method according to claim 1,

23. The machine learning is unsupervised learning or supervised learning.

23. The information processing method according to claim 1,

24. Acquiring measurements related to multiple joints of a robot, identifying an operating period in which the robot was in an operating state and an inactive period in which the robot was in an inactive state by detecting that the measurement value of a joint among the plurality of joints has reached a predetermined value the most times per unit time; acquiring feature values ​​from the measurement values ​​corresponding to the operating period as machine learning data, and excluding the measurement values ​​corresponding to the non-operating period from the machine learning data; obtaining a trained model for acquiring the state of the robot by machine learning using the machine learning data; A control unit is provided.

1. An information processing device comprising:

25. A system comprising: the information processing device according to claim 24; and the robot.

26. A method for manufacturing an article, comprising manufacturing the article using the system according to claim 25.

27. A program that enables a computer to execute the information processing method according to any one of claims 1 to 23.

28. A computer-readable recording medium storing the program according to claim 27.

Images