CDN flow anomaly detection device and method based on improved hierarchical time memory network

A technology of time memory and anomaly detection, which is applied in the direction of neural learning methods, biological neural network models, electrical components, etc. It can solve the problem of diagnosing abnormal types with little involvement, cannot give a good solution, and cannot meet the needs of large-traffic network chains In order to achieve the effect of improving performance, improving accuracy and reducing the probability of false positives

Active Publication Date: 2019-11-15
NANJING UNIV OF SCI & TECH
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1. The execution efficiency needs to be further improved, and at the same time, it cannot meet the response time requirements for abnormal detection of large-traffic network links;
[0005] 2. In the detection algorithm, it is very depende

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • CDN flow anomaly detection device and method based on improved hierarchical time memory network
  • CDN flow anomaly detection device and method based on improved hierarchical time memory network
  • CDN flow anomaly detection device and method based on improved hierarchical time memory network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0086] combine figure 1 , the present invention is a CDN traffic anomaly detection device based on an improved layered temporal memory network, comprising a data collection module, a data preprocessing module, a data storage module, a system scheduling module, an anomaly detection module and a display module;

[0087] Described data collection module, use distributed search engine ElasticSearch, log parsing tool Logstash, analysis and visualization platform Kbana to collect the native log of Nginx, use the log file that is installed on the server to monitor specified log file and obtain change information;

[0088] The data preprocessing module is used to perform data analysis on the sub-fields of the original log, and aggregate the data of the parsed time and flow value fields according to the time granularity to obtain the CDN log flow time series;

[0089]The data storage module includes a distributed search engine Elasticsearch query database and a Mysql common database, w...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a CDN flow anomaly detection device and method based on an improved hierarchical time memory network. The device comprises a data acquisition module, a data preprocessing module, a data storage module, a system scheduling module, an anomaly detection module and a display module. The method comprises the steps that a data collection module collects data of a native log, converts the data into a json format and sends the data to a data preprocessing module; feature extraction is carried out to obtain CDN flow time sequence representation, and the log data of the data acquisition module and the CDN data of the data preprocessing module are stored by the data storage module; the anomaly detection module acquires flow time series data through the system scheduling module, inputs the flow time series data into the time series anomaly detection model based on the improved hierarchical time memory network for online learning, completes anomaly possibility calculation and outputs a detection result of anomaly possibility judgment, and the display module visually displays a key process. The method has the advantages of high detection speed and high accuracy.

Description

technical field [0001] The invention relates to the technical field of CDN traffic anomaly detection, in particular to a CDN traffic anomaly detection device and method based on an improved layered temporal memory network. Background technique [0002] In recent years, with the continuous improvement of Internet infrastructure, the digital strategy has been systematically explained, Internet services have continued to penetrate, and the number of Internet users has maintained a steady growth. In order to reduce the pressure on the network due to the rapid growth of user groups and huge data transmission volume, Content Delivery Network (CDN) came into being. CDN can serve the Internet in different locations through large-scale distributed deployment of server infrastructure. The inherent distribution of CDN brings popular applications and hot content as close as possible to users, which greatly reduces network delays, improves users' access speed and quality of experience, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/06G06N3/04G06N3/08
CPCG06N3/049G06N3/08H04L63/0227H04L63/1416H04L63/1425H04L69/22
Inventor 王永利郭相威刘聪赵宁张伟卜凡朱亚涛罗靖杰刘森淼彭姿容朱根伟
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products