Unmarked multi-source network flow data drift detection method and device

A network traffic and drift detection technology, applied in transmission systems, electrical components, etc., can solve problems such as multi-source network traffic data that cannot adapt to dynamically changing environments

Pending Publication Date: 2022-04-26
NAT UNIV OF DEFENSE TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Based on this, it is necessary to address the above technical problems and provide an unlabeled multi-source network traffic data drift detection method and device that can solve the problem that drift detection in a supervised environment cannot adapt to a dynamically changing environment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmarked multi-source network flow data drift detection method and device
  • Unmarked multi-source network flow data drift detection method and device
  • Unmarked multi-source network flow data drift detection method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0051] In one embodiment, such as figure 1 As shown, an unlabeled multi-source network traffic data drift detection method is provided, including the following steps:

[0052] Step 102: Deploy network traffic collectors in multiple network flow data sources respectively, and for each network flow data source, when the drift detection period is reached, obtain the network traffic data collected by the network traffic collectors within the drift detection period.

[0053] The network traffic data includes multiple data samples and each data sample corresponds to multiple sa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an unmarked multi-source network flow data drift detection method and device. The method comprises the following steps: deploying network flow collectors in a plurality of network flow data sources respectively, when a drift detection period is reached, obtaining network flow data collected by the network flow collectors in the drift detection period, obtaining a data feature matrix of the network flow data according to sample features of data samples, and sending the data feature matrix to a server; further obtaining a dimension reduction data feature matrix and a feature transformation matrix, and transmitting the dimension reduction data feature matrix and the feature transformation matrix to a concept drift detection module; according to the feature transformation matrix, feature transformation is carried out on the stored historical concept data to obtain a historical concept data feature matrix, and according to the JS divergence between the dimension reduction data feature matrix and the historical concept data feature matrix, a drift detection mechanism is set to detect the concept drift of the real-time unlabeled multi-source network flow data. By adopting the method, unsupervised drift detection can be carried out.

Description

technical field [0001] The present application relates to the technical field of flow data analysis, in particular to a method and device for detecting drift of unmarked multi-source network flow data. Background technique [0002] Due to the dynamic and complex changing characteristics of network space, the characteristics of network traffic data will change accordingly, which will cause the phenomenon of concept drift in which data characteristics and data label mapping functions change. Currently, most of the research on this problem is in a supervised setting, so when the model error increases significantly, the system will sound an alarm, which triggers some adaptation mechanism (such as retraining the model). However, this method of operation is not applicable in many real-world scenarios, since the ground truth labels are not readily available, expensive and time-consuming to obtain. Contents of the invention [0003] Based on this, it is necessary to address the a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L43/08H04L43/04H04L41/147
CPCH04L43/08H04L43/04H04L41/147
Inventor 黄松平张航梁伟刘蔚柯刘斌朱承朱先强刘毅周鋆丁兆云
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap