Unlock instant, AI-driven research and patent intelligence for your innovation.

A data abnormal point detection method, device, system, and storage medium

A data anomaly and point detection technology, applied in neural learning methods, instruments, biological neural network models, etc., can solve the problems of single definition, inaccurate detection results, and single prediction algorithm, so as to improve accuracy and increase flexibility Effect

Active Publication Date: 2021-12-17
KEY & CORE TECH INNOVATION INST OF THE GREATER BAY AREA +1
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this type of method has the problems of single prediction algorithm, single definition of abnormality, inflexible process, and inaccurate detection results.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data abnormal point detection method, device, system, and storage medium
  • A data abnormal point detection method, device, system, and storage medium
  • A data abnormal point detection method, device, system, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] see figure 1 , is a flow chart of the data outlier detection method provided by Embodiment 1 of the present invention. In this embodiment, according to different requirements, figure 1 The order of execution of the steps in the flowcharts shown may be changed, and certain steps may be omitted.

[0053] Step S1: Receive the data to be detected, and perform preprocessing on the data to be detected. In some of these embodiments, the data to be detected is satellite telemetry time series data or other types of time series data.

[0054] Further, in some of the embodiments, the step S1 includes the following steps.

[0055] Step S1.1: Carry out initialization settings of the program, such as reading configuration files, etc.

[0056] Step S1.2: Perform an operation of eliminating wild points on the received data to be detected, for example, eliminate data points that exceed the specified range (such as 20%) of the normal working range.

[0057] Step S1.3: Use the mean v...

Embodiment 2

[0122] see image 3 , is a schematic structural diagram of the device provided by Embodiment 2 of the present invention.

[0123] In some of these embodiments, the device 2 may include, but not limited to, a memory 21 and a processor 22 coupled to the memory 21, and the memory 21 and the processor 22 may be communicatively connected to each other through a system bus. It should be pointed out that, image 3 Only device 2 is shown with components 21 and 22, but it is to be understood that embodiment 2 does not show all components of device 2 and that device 2 has more or fewer components that may alternatively be implemented. Wherein, the device 2 may be a computing device such as a rack server, a blade server, a tower server, or a cabinet server, and the device 2 may be an independent server or a server cluster composed of multiple servers.

[0124] The memory 21 stores program instructions for implementing the above-mentioned data anomaly detection method. The memory 21 in...

Embodiment 3

[0128] see Figure 4 , is a schematic structural diagram of the data outlier detection system provided by Embodiment 3 of the present invention.

[0129] In this embodiment, the data anomaly detection system 3 can be divided into one or more program modules, and the one or more program modules are stored in the memory 21 and executed by one or more processors (such as the processor 22) to complete the present invention. For example, in Figure 4 In the above, the data outlier detection system 3 can be divided into a data preprocessing module 31 , an algorithm prediction module 32 , and an outlier detection module 33 . The program module referred to in the present invention refers to a series of computer program instruction segments capable of completing specific functions, which are more suitable than programs for describing the execution process of the data anomaly detection system 3 in the device 2 . The functions of each program module 31-33 will be described in detail b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data abnormal point detection method, comprising the following steps: preprocessing the data to be detected; splitting the preprocessed data to be detected to obtain a training sample set and a test sample set; inputting the training sample set The selected prediction algorithm is iteratively trained to obtain a trained algorithm model; the test sample set is input into the trained algorithm model to obtain a predicted initial value of the test sample set, and the predicted initial value is reversed to obtain a prediction Normal value; input the test sample set and the predicted normal value into a variety of pre-set abnormal definitions, respectively use the various abnormal definitions to detect abnormal points; detect the various abnormal definitions The outliers of the outliers are jointly voted to determine the final outliers. In addition, the present invention also provides a data abnormal point detection device, system, and storage medium. The invention can improve the accuracy of data abnormal point detection.

Description

technical field [0001] The present invention relates to the technical field of data detection, in particular to a data abnormal point detection method, device, system and storage medium. Background technique [0002] With the continuous development of the commercial aerospace industry, the safe and effective operation of satellites in orbit is the focus of technical attention. Timely discovery of abnormally changing data points from satellite telemetry time series data (satellite telemetry parameters) through technical means can improve the active detection and identification capabilities of satellite faults, and provide reliable decision support for the safe and stable operation of satellites. In the prior art, the detection of abnormal points in the satellite telemetry time-series data usually first predicts its "normal value", and then realizes the abnormal point detection by comparing the predicted value with the real value. However, this type of method has the problems...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62G06N3/08
CPCG06N3/08G06F18/2433G06F18/214
Inventor 陈振安范潇杰
Owner KEY & CORE TECH INNOVATION INST OF THE GREATER BAY AREA