Information processing device, information processing method, and information processing program

By calculating and comparing the rate of change in time series data with a probability distribution, the device effectively identifies and removes outliers, enhancing prediction accuracy in time series data analysis.

JP7628926B2Active Publication Date: 2025-02-12HITACHI LTD
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2021162675
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-10-01
Publication Date
2025-02-12
Estimated Expiration
2041-10-01

AI Technical Summary

Technical Problem

Existing methods for outlier removal in time series data are inadequate, as they fail to evaluate changes along the time axis relative to other samples and struggle with small numbers of observation points, making it difficult to apply statistical models effectively.

Method used

An information processing device that calculates the rate of change over time for time series data, compares this rate with a given probability distribution, and excludes data points that deviate significantly from this distribution, using methods like the Quantile-Quantile plot to identify and remove outliers.

Benefits of technology

This approach allows for the relative evaluation of time series data samples based on their time-based changes, improving the accuracy of subsequent predictions by effectively identifying and removing unique samples.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007628926000001
    Figure 0007628926000001
  • Figure 0007628926000002
    Figure 0007628926000002
  • Figure 0007628926000003
    Figure 0007628926000003
Patent Text Reader

Abstract

To enable extraction of unique time-lapse data samples from many sets of time-lapse data.SOLUTION: An information processing device is provided, comprising a processor for running a program and a storage device for storing the program. The storage device retains multiple sets of time-series data, each including data at two or more pints in time. The processor computes a rate of change over time for each of the multiple sets of time-series data and relatively evaluates the rates of change of the multiple sets of time-series data.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program for processing time-dependent data. [Background technology]

[0002] In information processing using machine learning etc., preprocessing to remove outliers from the large amount of training data used for learning is considered important. This is because if the training data contains outliers, the learning results may be unintended or the learning efficiency may decrease.

[0003] Methods for removing outliers differ depending on whether the training data is cross-sectional data that represents information at a certain point in time or time series data along a time axis. For cross-sectional data, the Smirnoff-Grubbs test and Hotelling's theory are well known. These methods use the mean and variance of the data as parameters, and it is difficult to apply them to time series data where the parameters of the data change dynamically from time to time.

[0004] An outlier in time series data can be (1) a time within a single time series sample that exhibits an abnormal value, or (2) an unusual sample within multiple time series samples at a single time.

[0005] Regarding the outliers in (1) above, Japanese Patent Laid-Open Publication No. 2008-117381 (Patent Document 1) discloses a time-series data analysis device that aims to realize a time-series data analysis device capable of optimal modeling. This device detects abnormal values ​​in a sample by taking the difference between the original value in the sample and the value smoothed in the time series.

[0006] Regarding the outliers in (2) above, WO 2016 / 116961 (Patent Document 2) discloses an information processing device for more accurately determining the time when a time-series signal begins to show an abnormality. This device detects an abnormality based on upper and lower limits of normal data that are set in advance. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2008-117381 A [Patent Document 2] International Publication No. 2016 / 116961 Summary of the Invention [Problem to be solved by the invention]

[0008] However, no matter which outlier removal method is used, it is not possible to evaluate the change in a certain time series data along the time axis relatively by comparing it with other samples included in the training data. In addition, when the number of observation points of the time series data is small, it is difficult to smooth the time series data or express it using a statistical model such as an autoregressive model.

[0009] In this specification, time-series data with a small number of observation time points is referred to as time-series data. The present invention aims to realize information processing characterized by outlier removal that confirms both the uniqueness of each time point compared to other samples and the uniqueness of intra-sample variation from a large amount of time-series learning data used for learning such as machine learning. [Means for solving the problem]

[0010] An information processing device according to one aspect of the invention disclosed in the present application includes a processor that executes a program and a storage device that stores the program, the storage device stores a plurality of time series data each including data at two or more points in time, the processor calculates a rate of change over time for each of the plurality of time series data, The distribution of the change rate is compared with a predetermined probability distribution, and the time series data in which the degree of deviation of the change rate from the predetermined probability distribution satisfies a condition for peculiar data determination is determined to be peculiar data. Relatively evaluating the change rates of the plurality of time series data and repeatedly executing a process of comparing the distribution of the change rates of the plurality of time series data excluding the time series data determined to be peculiar data with the predetermined probability distribution while changing the condition for the peculiar data determination so that the number or ratio of the time series data determined to be peculiar data satisfies a predetermined condition, and determining, as peculiar data, the time series data whose degree of deviation of the change rate from the predetermined probability distribution satisfies the condition for the peculiar data determination. The present invention is characterized by the above. Effect of the Invention

[0011] According to a representative embodiment of the present invention, it is possible to extract peculiar samples by relatively evaluating samples based on the rate of change of each sample along the time axis from time-course learning data used for machine learning, etc. Problems, configurations, and effects other than those described above will become clear from the following description of the embodiments. [Brief description of the drawings]

[0012] [Figure 1] 1 is a block diagram showing an example of a hardware configuration of an information processing device according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing an example of a functional configuration of an information processing device according to an embodiment of the present invention. [Diagram 3] FIG. 4 is an explanatory diagram showing an example of the stored contents of notification information according to an embodiment of the present invention. [Figure 4] FIG. 11 is an explanatory diagram showing an example of non-continuous value data according to an embodiment of the present invention. [Diagram 5] FIG. 1 is an explanatory diagram illustrating an example of continuous value data according to an embodiment of the present invention. [Figure 6] FIG. 11 is an explanatory diagram illustrating an example of change rate data according to an embodiment of the present invention. [Figure 7] FIG. 4 is an explanatory diagram illustrating an example of an input / output screen according to an embodiment of the present invention. [Figure 8] FIG. 13 is an explanatory diagram illustrating an example of an execution result screen according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] The information processing device according to the present invention will be described below with reference to the attached drawings. In this specification, an example of information processing aimed at removing anomalous data for predicting insurance payment risk in underwriting assessment of life insurance is shown. In underwriting assessment, future insurance payment risk is assessed based on information notified by the insurance applicant (hereinafter, notified information), and approval or rejection of insurance application is decided. The notified information includes the results of medical examinations, medical interviews, medical history, etc.

[0014] <Example of hardware configuration of information processing device> FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing device according to an embodiment of the present invention.

[0015] The information processing device 100 includes a processor 101, a storage device 102, an input device 103, an output device 104, and a communication interface (communication IF) 105. The processor 101, the storage device 102, the input device 103, the output device 104, and the communication IF 105 are connected by a bus 106. The processor 101 controls the information processing device 100. The storage device 102 serves as a working area for the processor 101. The storage device 102 is a non-transient or temporary recording medium that stores various programs and data. Examples of the storage device 102 include a ROM (Read Only Memory), a RAM (Random Access Memory), a HDD (Hard Disk Drive), and a flash memory. The input device 103 inputs data. Examples of the input device 103 include a keyboard, a mouse, a touch panel, a numeric keypad, and a scanner. The output device 104 outputs data. Examples of the output device 104 include a display and a printer. The communication IF 105 is connected to a network (not shown) and transmits and receives data.

[0016] <Example of functional configuration of information processing device 100> FIG. 2 is a block diagram showing an example of a functional configuration of the information processing device 100 according to the embodiment of the present invention.

[0017] The information processing device 100 includes an input unit 201, a data cleansing unit 202, a data classification unit 203, a time-dependent change rate calculation unit 204, an unusual sample removal unit 205, and an output unit 206. Specifically, the data cleansing unit 202, the data classification unit 203, the time-dependent change rate calculation unit 204, and the unusual sample removal unit 205 are realized by, for example, causing the processor 101 to execute a program stored in the storage device 102 shown in FIG.

[0018] Furthermore, the information processing device 100 stores the notification information 300, the non-continuous value data 400, the continuous value data 500, and the change rate data 600 in the storage device 102. The notification information 300 may be stored in advance in the information processing device 100, or may be acquired from another computer capable of communicating with the information processing device 100. First, the notification information 300 input to the input unit 201 will be described in detail.

[0019] FIG. 3 is an explanatory diagram showing an example of the contents of the notification information 300 according to an embodiment of the present invention.

[0020] The notification information 300 is information required for the insurance contract notified by the policy applicant, and is the data to be analyzed. The notification information 300 has basic notification information 310, medical examination results 320, interview results 330, and medical history 340. The basic notification information 310 is basic information related to the notification of the policy applicant. The basic notification information 310 includes a name ID 311, a date of birth 312, and an age 313.

[0021] Name ID 311 is identification information that uniquely identifies a contract applicant. Date of birth 312 is the date on which the contract applicant was born. The three entries of the contract applicant with name ID 311 "0001" in FIG. 3 show the analysis target data for the past three years for that contract applicant. Age 313 is the number of years that have passed since the contract applicant's date of birth 312. In the example described below, for the three entries of the contract applicant with name ID 311 "0001", age 313 is "47" which represents the first year in the chronological order, "48" which represents the second year in the chronological order, and "49" which represents the third year in the chronological order.

[0022] The medical checkup result 320 is the result of a medical checkup that the contract applicant underwent. The medical checkup result 320 includes weight 321, BMI (Body Mass Index) 322, systolic blood pressure 323, diastolic blood pressure 324, and fasting blood glucose 325. Weight 321 is the body weight of the contract applicant. BMI 322 is a body mass index that indicates the degree of obesity in humans, and is calculated by weight / (height 2 The lower the BMI322 value, the thinner the person, and the higher the value, the fatter the person.

[0023] Systolic blood pressure 323 is the pressure exerted on the aortic vascular wall by the blood pushed out by the contraction of the heart when blood is being pumped from the heart to the aorta. Diastolic blood pressure 324 is the pressure exerted on the aortic vascular wall when blood is returning to the heart, the pressure being reduced by the blood flowing from the aorta to the heart due to the expansion of the heart, reducing the amount of blood in the aorta. Fasting blood glucose 325 is the blood glucose level measured in a fasting state.

[0024] The medical interview result 330 is the result of the medical interview taken by the contract applicant. The medical interview result 330 includes smoking habits 331, drinking habits 332, and exercise habits 333. The smoking habits 331 indicate whether the contract applicant smokes, how often, and how much. The drinking habits 332 indicate whether the contract applicant drinks alcohol, how often, and how much. The exercise habits 333 indicate whether the contract applicant exercises, how often, and how much.

[0025] The medical history 340 is a history of medical treatments the contract applicant has already received or been hospitalized. The medical history 340 includes a hypertension medical examination history 341, a hypertension hospitalization history 342, and a diabetes medical examination history 343. The hypertension medical examination history 341 is a history of medical treatments the contract applicant has received for hypertension. The hypertension hospitalization history 342 is a history of medical treatments the contract applicant has received for hypertension. The diabetes medical examination history 343 is a history of medical treatments the contract applicant has received for diabetes.

[0026] Referring again to Fig. 2, the data cleansing unit 202 extracts noise samples from the notification information 300 output from the input unit 201 and removes the noise. This makes it possible to improve the accuracy of removing anomalous data and the prediction accuracy of the subsequent insurance payment risk prediction. Types of noise samples include missing data and erroneous data input, and cleansing is achieved by deleting and correcting the respective samples.

[0027] The data classification unit 203 divides the cleansed notification information 300 output from the data cleansing unit 202 into continuous value data 500 and non-continuous value data 400 based on the data type. The continuous value data 500 is classified into weight 321, BMI 322, and the like. The non-continuous value data 400 is classified into binary data such as smoking habit 331 and categorical data such as drinking habit 332. This enables processing based on the data type, and achieves high accuracy in removing anomalous data.

[0028] 4 and 5 are explanatory diagrams showing an example of non-continuous value data 400 and continuous value data 500 according to an embodiment of the present invention, respectively.

[0029] The non-continuous value data 400 is a subset of the notification information 300, and includes data other than the continuous value type data. For example, from the notification information 300 shown in Fig. 3, the non-continuous value data 400 including smoking habit 331, drinking habit 332, and exercise habit, which are categorical data indicating whether the habit corresponds to "none," "once a week," or "twice a week," and the like, and hypertension consultation history 341, hypertension hospitalization history, and diabetes consultation history 343, which are binary data of "yes" or "no," are associated with the name ID 311 to generate the non-continuous value data 400.

[0030] The continuous value data 500 is a subset of the notification information 300 and includes continuous value type data such as weight 321 , BMI 322 , systolic blood pressure 323 , diastolic blood pressure 324 and fasting blood glucose 325 associated with the name ID 311 .

[0031] The continuous value data 500 is a set of time-series data to be evaluated by the information processing device 100 of this embodiment. For example, data of each item (e.g., weight, BMI, etc.) observed at multiple time points for each person constitutes one piece of time-series data. However, although the number of observation time points of the time-series data in this embodiment is not limited, it is assumed to be smaller than that assumed for general time-series data, for example, 2 or more, at most about 10. Such time-series data may be described as longitudinal data.

[0032] Referring again to FIG. 2, the time-course change rate calculation unit 204 calculates the change rate over time for each item of the continuous value data 500. Here, the number of time points included in the continuous value data 500 is n, and each time is t (1, 2, . . . , T). If the continuous value data 500 includes M types of continuous value data, for example, an arbitrary continuous value variable at time t for a sample with a name ID 311 of 0001 can be expressed as V(0001, t, m). Here, m is any value from 1 to M, and identifies an item of continuous value data such as weight or BMI.

[0033] The time-dependent change rate calculation unit 204 calculates the change rate U from the previous time from time t=2 onwards, from V(0001,2,m) to V(0001,T,m). The change rate U at time t can be expressed by the following formula.

[0034] U(0001,t,m)=100×(V(0001,t,m) - V(0001,t-1,m)) / V(0001,t-1,m)

[0035] The calculated rate of change is stored in the rate of change data 600. In this embodiment, the change over time of the continuous value data 500 is expressed as a rate of change, but the change over time can be quantified by expressing the change over time in any manner, such as the amount of change from the previous time point or the rate of change from two time points before.

[0036] FIG. 6 is an explanatory diagram showing an example of change rate data 600 according to an embodiment of the present invention.

[0037] The change rate data 600 includes a name ID 601 for identifying each contract applicant, and a change rate of the continuous value data of each contract applicant at each time. As an example, Fig. 6 shows a change rate 602 at time 2, a change rate 603 at time T-1, and a change rate 604 at time T for the samples of continuous value data of item m with name IDs 601 of 0001 and 0002.

[0038] The peculiar sample exclusion unit 205 retrieves the change rate U calculated by the time-dependent change rate calculation unit 204 from the change rate data 600, and determines whether each sample is a sample that exhibits a peculiar change compared to other samples. If the change over time of a sample is peculiar, the sample is excluded from the notification information 300.

[0039] Assuming that the change rates U of all samples follow a normal distribution, the peculiar sample elimination unit 205 compares the distribution of the change rates U with the normal distribution, extracts samples that deviate from the normal distribution, and displays them through the output unit 206. For example, a QQ (Quantile-Quantile) plot is used to compare the distribution of the change rate U with the normal distribution. A QQ plot is known as a method for visually checking whether the change rate U follows a normal distribution by plotting theoretical quantiles of the normal distribution corresponding to the quantiles of the change rate U.

[0040] In the QQ plot, if the line smoothly connecting the plotted quantiles is a straight line, it can be determined that the rate of change U follows a perfect normal distribution. Conversely, when the plotted quantiles are approximated by a straight line, points that deviate from the straight line can be determined to be outliers from the normal distribution. The peculiar sample exclusion unit 205 calculates the confidence interval of the QQ plot based on multiple confidence coefficients, and excludes samples that deviate from any confidence interval as peculiar samples. This can improve the prediction accuracy of future insurance payment risk predictions.

[0041] One example of an automatic peculiar sample extraction method in the peculiar sample exclusion unit 205 is to repeat the process until the extraction rate or number of samples to be excluded reaches a pre-specified value. Specifically, the peculiar sample exclusion unit 205 calculates a confidence interval with a sufficiently large confidence coefficient, such as 0.999, and extracts samples that deviate from the confidence interval. If the extraction rate or number of samples extracted in this way reaches a pre-specified value, the process ends, and if not, the confidence coefficient is reduced and samples that deviate from the confidence interval are extracted again. This process is repeated, and the process ends when the extraction rate or number of samples to be extracted reaches a pre-specified value.

[0042] Alternatively, the peculiar sample exclusion unit 205 may repeat the process of excluding the sample with the maximum deviation from the normal distribution, comparing the distribution of the rate of change U of the remaining samples with the normal distribution to which it conforms, and eliminating the sample with the maximum deviation from the normal distribution. This repetition may be performed until the extraction rate or number of samples to be excluded reaches a pre-specified value, or until the deviation from the normal distribution falls within a predetermined range (for example, until there are no samples deviating from the confidence interval of a predetermined confidence coefficient).

[0043] The peculiar sample exclusion unit 205 can display the QQ plot on the output unit 206, and the user of the information processing device 100 can visually extract and exclude peculiar samples. In this embodiment, it is assumed that the rate of change U follows a normal distribution, but this is just one example, and a method of drawing a QQ plot by assuming any probability distribution other than the normal distribution may be adopted. If it is difficult to specify an arbitrary probability distribution in advance, a method of preparing a large number of probability distribution candidates and searching for a probability distribution that has the smallest removal sample extraction rate or number of samples extracted by repeated processing (i.e., the smallest degree of deviation of the rate of change U) may be adopted.

[0044] Furthermore, instead of a QQ plot, a method of extracting and excluding peculiar samples by visually checking the histogram may also be considered. The set of change rates U processed by the peculiar sample exclusion unit 205 can be divided and processed by time changes at the same time for M types of items, or can be processed collectively by time changes of the same time width, ignoring the time.

[0045] <Screen example> FIG. 7 is an explanatory diagram showing an example of an input / output screen according to an embodiment of the present invention.

[0046] The input / output screen 700 is displayed on a display, which is an example of the output device 104 of the information processing device 100, or on a display of another computer (not shown) that can communicate with the information processing device 100.

[0047] The input / output screen 700 includes a notification information read button 701, a process item selection pull-down 705, a reliability coefficient selection bar 708, a process execution button 710, and an execution result display area 800. The notification information 300 may be read when the user operates the notification information read button 701. Alternatively, when the user operates the notification information input button 702, the information processing device 100 may display a notification information input screen (not shown), and the user may input the notification information using the input device 103.

[0048] FIG. 8 is an explanatory diagram showing an example of an execution result screen according to an embodiment of the present invention.

[0049] The execution result display area 800 includes a plot screen 801 that displays the QQ plot drawn by the unusual sample excluding unit 205, and an unusual sample ID screen 802 that displays the name IDs of the extracted unusual samples.

[0050] The plot screen 801 shows the quantiles of the rate of change U on the vertical axis and the theoretical quantiles of normal distribution on the horizontal axis, with the points where the rate of change U is plotted as black circles. If the rate of change U exactly follows the normal distribution, all the black circles are plotted on the thick solid line. The thin solid lines represent the confidence intervals calculated based on multiple confidence coefficients. The peculiar sample ID screen 802 is a screen that lists samples that deviate from the confidence intervals calculated based on the confidence coefficient specified by the confidence coefficient selection bar 708.

[0051] In the above embodiment, the insurance payment risk prediction in the underwriting assessment of life insurance has been described as an example, but the present invention can also be applied to, for example, corporate financial analysis. In this case, the data described in the securities report or index data calculated from the data is used as the evaluation target instead of the notification information 300. In general, the present invention can be applied to extract peculiar samples (outliers) from a collection of multiple time series data when the number of observation points for each time series data is small.

[0052] Furthermore, the functions of the information processing device 100 in the above-described embodiment may be provided via an API (Application Programming Interface). For example, when the information processing device 100 receives notification information 300 via a network connected to the communication IF 105, the information processing device 100 may store the notification information 300 in the storage device 102, execute the process shown in Fig. 2, and output the notification information from which the peculiar sample has been removed and data required to display the information shown in Fig. 7 and Fig. 8 via the network.

[0053] Furthermore, the system according to the embodiment of the present invention may be configured as follows.

[0054] (1) An information processing device (e.g., information processing device 100) having a processor (e.g., processor 101) that executes a program and a storage device (e.g., storage device 102) that holds the program, wherein the storage device holds a plurality of time series data (e.g., continuous value data 500), each of which includes data from two or more points in time, and the processor calculates a rate of change with respect to time for each of the plurality of time series data (e.g., processing by the time-series change rate calculation unit 204) and relatively evaluates the rates of change of the plurality of time series data (e.g., processing by the peculiar sample exclusion unit 205).

[0055] This makes it possible to evaluate samples relative to one another based on the rate of change of each sample over time, using longitudinal learning data used in machine learning and other applications.

[0056] (2) In the above (1), the processor compares the distribution of the change rates with a predetermined probability distribution and determines that time series data whose degree of deviation of the change rate from the predetermined probability distribution satisfies the condition for determining peculiar data is peculiar data, thereby relatively evaluating the change rates of multiple time series data (for example, processing by the peculiar sample exclusion unit 205).

[0057] This makes it possible to extract peculiar samples from longitudinal learning data used in machine learning and other applications by evaluating samples relative to each other based on the rate of change of each sample over time.

[0058] (3) In the above (2), the processor determines that the time series data having the largest deviation in rate of change from a predetermined probability distribution is anomalous data.

[0059] This makes it possible to appropriately exclude anomalous samples from longitudinal learning data used in machine learning and other applications.

[0060] (4) In the above (3), the processor compares the distribution of the change rates of the multiple time series data excluding the time series data determined to be peculiar data with a predetermined probability distribution, and determines the time series data having the largest deviation of its change rate from the predetermined probability distribution as peculiar data. This process is repeatedly executed until the number or proportion of the time series data determined to be peculiar data satisfies a predetermined condition or the degree of deviation of the change rate from the predetermined probability distribution falls within a predetermined range.

[0061] This makes it possible to appropriately exclude anomalous samples from longitudinal learning data used in machine learning and other applications.

[0062] (5) In the above (2), the processor repeatedly executes a process of comparing the distribution of change rates of the multiple time series data excluding the time series data determined to be peculiar data with a predetermined probability distribution while changing the condition for peculiar data determination so that the number or proportion of time series data determined to be peculiar data satisfies the predetermined condition, and determining as peculiar data the time series data whose degree of deviation of the change rate from the predetermined probability distribution satisfies the condition for peculiar data determination.

[0063] This makes it possible to appropriately exclude anomalous samples from longitudinal learning data used in machine learning and other applications.

[0064] (6) In (2) above, the processor generates a plurality of probability distributions by assuming that the distributions of the change rates are based on different probability distribution models, compares the distribution of the change rates with the plurality of probability distributions, and determines the probability distribution with the smallest degree of deviation of the change rates as the predetermined probability distribution to be compared for determining peculiar data.

[0065] This makes it possible to appropriately exclude anomalous samples from longitudinal learning data used in machine learning and other applications.

[0066] (7) In the above (2), the predetermined probability distribution is a distribution based on a predetermined probability distribution model that the distribution of the change rate is assumed to follow (e.g., a normal distribution and other distributions),

[0067] The processor determines that time series data whose rate of change falls outside a confidence interval corresponding to a predetermined confidence coefficient of a predetermined probability distribution is anomalous data.

[0068] This makes it possible to appropriately exclude anomalous samples from longitudinal learning data used in machine learning and other applications.

[0069] (8) In the above (7), the processor repeatedly executes a process of comparing the distribution of change rates of the multiple time series data excluding the time series data determined to be peculiar data with a predetermined probability distribution while changing the reliability coefficient so that the number or proportion of the time series data determined to be peculiar data satisfies a predetermined condition, and determining that the time series data whose change rate falls outside the reliability interval is peculiar data.

[0070] This makes it possible to appropriately exclude anomalous samples from longitudinal learning data used in machine learning and other applications.

[0071] (9) In the above (2), the information processing device further has an output device, and the output device displays a Quantile-Quantile plot based on the distribution of the change rate and a predetermined probability distribution.

[0072] This makes it easier to visually check the presence of anomalous data.

[0073] The present invention is not limited to the above-described embodiments, and includes various modified examples and equivalent configurations within the spirit of the appended claims. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those having all of the configurations described. In addition, a part of the configuration of one embodiment may be replaced with a configuration of another embodiment. In addition, a configuration of another embodiment may be added to a configuration of one embodiment. In addition, a part of the configuration of each embodiment may be added, deleted, or replaced with another configuration.

[0074] In addition, each of the configurations, functions, processing units, processing means, etc. described above may be realized in part or in whole in hardware, for example by designing them as integrated circuits, or may be realized in software by processor 101 interpreting and executing a program that realizes each function.

[0075] Information such as programs, tables, files, etc. that realize each function can be stored in a storage device such as a memory, a hard disk, or an SSD (Solid State Drive), or in a computer-readable non-transitory data recording medium such as an IC (Integrated Circuit) card, an SD card, or a DVD (Digital Versatile Disc).

[0076] In addition, the control lines and information lines shown are those considered necessary for the explanation, and do not necessarily show all the control lines and information lines necessary for implementation. In reality, it can be considered that almost all components are connected to each other. [Explanation of symbols]

[0077] 100 Information processing device 101 Processor 102 Storage Devices 202 Data Cleansing Department 203 Data Classification Department 204 Time-dependent change rate calculation section 205 Unique Sample Exclusion Department 300 Announcement Information 400 Non-continuous data 500 Continuous Value Data 600 Rate of change data

Claims

1. An information processing device, A processor for executing a program and a storage device for storing the program, the storage device holds a plurality of time series data each including data at two or more points in time; The processor, Calculating a rate of change over time for each of the plurality of time series data; comparing the distribution of rates of change to a predetermined probability distribution; Relatively evaluating the change rates of the plurality of time series data by determining, as peculiar data, that the degree of deviation of the change rate from the predetermined probability distribution satisfies a condition for peculiar data determination; an information processing apparatus which repeatedly executes a process of comparing a distribution of the change rates of the plurality of time series data excluding the time series data determined to be peculiar data with the predetermined probability distribution while changing a condition for the peculiar data determination so that the number or a ratio of the time series data determined to be peculiar data satisfies a predetermined condition, and determining, as peculiar data, the time series data whose degree of deviation of the change rate from the predetermined probability distribution satisfies the condition for the peculiar data determination.

2. An information processing device according to claim 1, The processor, generating a plurality of probability distributions by assuming that the distributions of the rates of change are based on different probability distribution models; comparing the distribution of the rate of change to the plurality of probability distributions; determining, as the predetermined probability distribution to be compared for determining whether data is anomalous, the probability distribution having the smallest degree of deviation from the rate of change.

3. An information processing device, A processor for executing a program and a storage device for storing the program, the storage device holds a plurality of time series data each including data at two or more points in time; The processor, Calculating a rate of change over time for each of the plurality of time series data; comparing the distribution of rates of change to a predetermined probability distribution; Relatively evaluating the change rates of the plurality of time series data by determining, as peculiar data, that the degree of deviation of the change rate from the predetermined probability distribution satisfies a condition for peculiar data determination; the predetermined probability distribution is a distribution based on a predetermined probability distribution model which the distribution of the change rate is assumed to follow; The processor determines, as anomalous data, the time series data in which the rate of change falls outside a confidence interval corresponding to a predetermined confidence coefficient of the predetermined probability distribution; an information processing apparatus which repeatedly executes a process of comparing a distribution of the change rates of the plurality of time series data excluding the time series data determined to be peculiar data with the predetermined probability distribution while changing the reliability coefficient so that the number or ratio of the time series data determined to be peculiar data satisfies a predetermined condition, and determining that the time series data whose change rate falls outside the reliability interval is peculiar data.

4. An information processing device according to claim 1, further comprising an output device; The information processing apparatus according to claim 1, wherein the output device displays a quantile-quantile plot based on the distribution of the change rates and the predetermined probability distribution.

5. An information processing method executed by an information processing device, comprising: The information processing device includes a processor that executes a program and a storage device that stores the program; the storage device holds a plurality of time series data each including data at two or more points in time; The information processing method includes: A step of the processor calculating a rate of change with respect to time for each of the plurality of time series data; the processor comparing the distribution of the rate of change to a predetermined probability distribution; a step of relatively evaluating the change rates of the plurality of time series data by determining, by the processor, that the time series data is peculiar data when the degree of deviation of the change rate from the predetermined probability distribution satisfies a condition for peculiar data determination, and an information processing method comprising: a step of relatively evaluating the change rates of the plurality of time series data; a step of repeatedly executing a process of comparing a distribution of the change rates of the plurality of time series data excluding the time series data determined to be peculiar data with the predetermined probability distribution while changing a condition for the peculiar data determination so that a number or a ratio of the time series data determined to be peculiar data satisfies a predetermined condition; and determining, as peculiar data, the time series data whose degree of deviation of the change rate from the predetermined probability distribution satisfies the condition for the peculiar data determination.

6. An information processing program for controlling an information processing device, comprising: the information processing device includes a processor that executes the information processing program and a storage device that stores the information processing program; the storage device holds a plurality of time series data each including data at two or more points in time; The information processing program includes: calculating a rate of change over time for each of the plurality of time series data; comparing said distribution of rates of change to a predetermined probability distribution; a step of relatively evaluating the change rates of the plurality of time series data by determining, as peculiar data, the time series data whose degree of deviation of the change rate from the predetermined probability distribution satisfies a condition for peculiar data determination; the step of relatively evaluating the change rates of the plurality of time series data, the information processing program repeatedly executes a process of comparing a distribution of the change rates of the plurality of time series data excluding the time series data determined to be peculiar data with the predetermined probability distribution while changing a condition for the peculiar data determination so that a number or a ratio of the time series data determined to be peculiar data satisfies a predetermined condition, and determining, as peculiar data, the time series data whose degree of deviation of the change rate from the predetermined probability distribution satisfies the condition for the peculiar data determination.

Citation Information

Patent Citations

  • Association rule mining method for multivariate time series monitoring data

    CN111046084A

  • Method and device for monitoring abnormality of equipment

    JP1994004789A

  • Time sequential data analyzer, time sequential data analysis system, time sequential data analysis method, program and recording medium

    JP2008117381A

  • Device, method and program for visualization of analysis result

    JP2010250769A

  • Abnormality detection device, program, and abnormality detection method

    JP2013205894A