An abnormal data detection method and device

An abnormal data detection and data technology, applied in the field of data processing, can solve the problems of multiple false alarms and cumbersome configuration process, and achieve the effect of reducing manual dependence, simplifying the detection process, and reducing false alarms

Active Publication Date: 2019-06-28
TENCENT TECH (SHENZHEN) CO LTD
View PDF9 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Since the detection of abnormality using the threshold method is too manual, not only the configuration process is cumbersome, but also there are many false alarms, the embodiment of the present invention provides a method and device for abnormal data detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An abnormal data detection method and device
  • An abnormal data detection method and device
  • An abnormal data detection method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0078] In a possible implementation manner, the abnormal conditions of multiple target objects are input into a preset decision matrix to determine the abnormal type.

[0079] Specifically, a decision matrix may be constructed in advance based on expert experience, and the decision matrix represents the relationship between abnormal conditions and abnormal types of each target object.

[0080] In a possible implementation manner, abnormal conditions of multiple target objects are input into a classification model to determine an abnormal type, and the classification model is obtained by learning a mapping relationship between abnormal conditions and abnormal types of multiple target objects.

[0081]Specifically, the classification model may be a binary classification model or a multi-classification model. In a specific implementation, the classification model includes but is not limited to a decision tree and a neural network model. When building a classification model, for e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides an abnormal data detection method and device, and relates to the technical field of data processing, and the method comprises the steps: obtaining to-be-detected data of a target object, traversing each random binary tree in an isolated forest model based on the to-be-detected data of the target object, and determining the position of the target object on each random binary tree; determining an abnormal score of the target object according to the position of the target object on each random binary tree, and then determining an abnormal condition of thetarget object according to the abnormal score of the target object. Due to the fact that the isolated forest model is adopted to detect the abnormal condition of the target object, dependence on manpower is reduced, and the detection process is simplified. When the isolated forest model is trained, the characteristics of the training sample at least comprise the time sequence characteristics of the target object, so that when the isolated forest model detects the abnormal condition of the target object, the influence of the time sequence characteristics of the target object on the abnormal condition is considered, the accuracy of abnormal detection is improved, and false alarms are reduced.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of data processing, and in particular, to a method and device for detecting abnormal data. Background technique [0002] There are many kinds of Internet daily operation data, and the curve characteristics of the operation indicators in different scenarios are different, and the fluctuation range of the same indicator in different businesses is also different. How to ensure the accuracy of the alarm while taking into account the versatility, so that the anomaly detection method is applicable to different businesses in various scenarios, without relying too much on human factors, is the main difficulty faced by anomaly detection. [0003] Currently, anomaly detection methods include the threshold method, that is, based on the analysis of the fluctuation range of the curve to be detected, an alarm threshold is set. This method relies on manual experience, and requires separate configurat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62
Inventor 程超金欢
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap