Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Online data anomaly detection method and device, storage medium and equipment

A technology of data anomaly and detection method, which is applied in the field of data processing, can solve problems such as the unknown value range of online data, and achieve the effect of accurate detection

Pending Publication Date: 2021-10-01
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present application provides an online data anomaly detection method, device, storage medium and equipment, which can simply and efficiently solve the problem that the numerical range of the online data to be detected is unknown, and can be used for long-term abnormal detection of online data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online data anomaly detection method and device, storage medium and equipment
  • Online data anomaly detection method and device, storage medium and equipment
  • Online data anomaly detection method and device, storage medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present application provides an online data abnormality detecting method, device, storage medium, and device, which can simply and efficiently solve the problem of unknown online data value range to be detected, and can be used for anomaly detection for online data for a long time. .

[0025] The embodiments of the present application will be described below with reference to the accompanying drawings.

[0026] In some online data abnormal detection methods, it is usually used to utilize a data density assessment method, a data distance based evaluation method, based on the evaluation method of time series detection, an assessment method based on the regression strategy, a clustering evaluation method, and projection method. These detection methods are mostly based on data-based similarity, that is, the new data points are required to evaluate the European distance, cosine distance, and the like of the new data point. And the calculation of the similarity measurement al...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses an online data anomaly detection method and device, a storage medium and equipment, is applied to the technical field of data processing, and is used for solving the problem that the numerical range of online data to be detected is unknown. The method comprises the following steps: firstly, acquiring to-be-detected online data by utilizing a preset window, converting the to-be-detected online data into multi-dimensional vector data, and then taking each data point in the multi-dimensional vector data as a to-be-detected point; then sending multi-dimensional vector data to a preset number of pre-constructed unit binary trees for counting, then when a data value of a to-be-detected point exceeds a preset numerical value range of nodes in the unit binary trees, executing an online variable range updating operation on the nodes, and when the total count of all the nodes in the binary trees reaches a preset window threshold value, executing a window updating operation; and according to the node position of the to-be-detected point divided into each binary tree and the count and depth of the node, calculating the abnormal score of the to-be-detected point so as to determine the abnormal condition of the to-be-detected point.

Description

Technical field [0001] The present application relates to the field of data processing, in particular, to an online data abnormality detection method, device, storage medium, and device. Background technique [0002] With the rapid development of network technology, more and more network data needs real-time processing, for example, in a computer system, operating system system core requests and types, network traffic, hard disk read and write ratio, etc. Both are generated in the interaction of the operating system and the user. Such interactions are normal operations in most cases. However, if the value of such base online data is significantly different from most cases, an abnormally online data may occur, thereby need to perform real-time abnormal detection of online data to excavate an online data point in which an abnormal online data is required. And thereby discovering potential system vulnerabilities or risk. [0003] The currently common online data abnormality detectio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06K9/62
CPCG06F11/3072G06F18/2433
Inventor 苏玉鑫吕荣聪凌晓
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com