Traffic identification and feature extraction method based on deep learning

A feature extraction and traffic recognition technology, applied in neural learning methods, character and pattern recognition, special data processing applications, etc., can solve problems such as waste of model information, poor interpretability, and difficult data packets

Pending Publication Date: 2020-10-30
上海乘安科技集团有限公司
View PDF6 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are still some problems that have not been resolved: 1. The classification accuracy on data sets with a large number of classifications needs to be improved; 2. The model is trained with pre-prepared data sets. Data packet optimization model; 3. The interpretability of deep learning application on traffic classification is relatively poor. The trained neural network model can only perform traffic classification, wasting the rich information inside the model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Traffic identification and feature extraction method based on deep learning
  • Traffic identification and feature extraction method based on deep learning
  • Traffic identification and feature extraction method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0033] Step 1: Capture of data packets:

[0034] Use the process packet capture tool openQPA to capture packets. The data packets generated by each process are stored in a separate pcap file. According to the characteristics of some applications, the data packets of a single application are further separated. For example, the WeChat data packets are divided into WeChat chat data packets, WeChat picture data packets, WeChat video call data packets, etc., to provide finer granularity classification.

[0035] Step 2: The establishment of the data set

[0036] The Scapy library is an open source network traffic packet parsing library. The Scapy library is used to process pcap files and remove information such as the MAC address and IP address in the header. This information has nothing to do with the application type of the data packet and belongs to interference information, so it should generally be removed. However, if there is a need to filter data packets based on IP addres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a traffic identification and feature extraction method based on deep learning. The method comprises the steps of data packet capture, data set establishment, convolutional neural network establishment, model training, model self-study and optimization, and network data packet feature extraction. According to the method, the good performance of the convolutional neural network in data processing application is fully utilized, and the convolutional neural network which is rapid and accurate and is suitable for network message processing is designed; and flow classification prediction is carried out by utilizing the trained model, data packets with insufficient probabilities of prediction errors and classification under a correct type in a result are selected out and re-fused into a training set training model, thereby realizing autonomous optimization of the model. According to the method, a class activation mapping method is utilized to carry out feature extraction on the traffic, extracted feature fields can enable people to know the features of data packets of specific types, and the feature fields not only can be used for a traditional DPI technology, butalso are suitable for application scenarios where DPI traffic classification has been deployed.

Description

technical field [0001] The present invention relates to the technical field of data deep learning algorithms, in particular to a traffic identification and feature extraction method based on deep learning. Background technique [0002] Network traffic classification is an important task in modern communication networks. It provides judgment basis and underlying technical support for application fields such as network resource allocation, network intrusion detection, malware detection, operator regulation and pricing. At the same time, with the development of technologies such as SD-WAN and SRv6, the provision of personalized network services and traffic engineering have put forward higher requirements for traffic classification technology. The vigorous development of today's mobile Internet and the emergence of a large number of new network applications have resulted in today's network traffic showing the characteristics of large-scale network traffic data, various types of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08G06F16/951
CPCG06N3/08G06F16/951G06N3/045G06F18/214G06F18/2414G06F18/2415
Inventor 刘畅
Owner 上海乘安科技集团有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products