An anomaly detection method and computer-readable storage medium for a heterogeneous data set

Abstract

The invention discloses an anomaly detection method of a heterogeneous data set and a computer-readable storage medium. The invention selects several unused classification indexes from a preset classification index set, and based on the selected classification indexes, detects heterogeneity The data set is subjected to index threshold segmentation processing to generate data subsets after segmentation and classification under the selected classification index, and to perform anomaly detection on each data subset, that is to say, the present invention classifies the classification index based on the selected classification index The data under the index threshold segmentation process is performed to obtain multiple data subsets under the selected classification index. By performing anomaly detection on the data subsets, it is possible to accurately perform high-dimensional unlabeled heterogeneous data sets. abnormal detection.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to an anomaly detection method and a computer-readable storage medium for a heterogeneous data set. Background technique [0002] At present, the anomaly detection of data sets is mainly carried out through statistical hypothesis testing and isolation forest method. Specifically, statistical hypothesis testing needs to assume that the data obeys a certain distribution, which is only applicable to one-dimensional data, while isolation forest requires each random Select the dimension and threshold to split the data set until each set has only one piece of data, forming an isolated tree. The fewer the number of splits, the higher the outlier score. However, due to the different anomaly detection thresholds of heterogeneous data sets, the existing statistical hypothesis testing and isolation forest methods cannot detect anomalies in heterogeneous data sets. Contents of the invention...

AI Technical Summary

Problems solved by technology

[0003] The present invention provides an anomaly detection method for a heterogeneous data set and a computer-readable storage medium to solve the problem in the prior art that the anomaly detection of a heterogeneous data set cannot be performed well

Images