A network traffic and protocol message analysis platform based on massive data

A technology of network traffic and protocol messages, which is applied in the field of network traffic and protocol message analysis platforms based on massive data, can solve problems such as difficult addressing, large storage space, and occupation of system resources, and achieve rapid retrospective analysis of historical data, Accurate tracking and positioning, accurate security and evidence collection

Active Publication Date: 2020-01-03
STATE GRID INFORMATION & TELECOMM BRANCH +1
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] However, expanding the intranet and Internet egress bandwidth cannot fundamentally solve the problem of normal access to some application systems, and it is necessary to collect and analyze all traffic
In addition, in order to ensure the traceability of subsequent network security issues, network traffic data needs to be stored regularly or in real time, which will take up a huge storage space, and a corresponding address information table needs to be established during storage, which will also take up System resources cause addressing difficulties

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A network traffic and protocol message analysis platform based on massive data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] The present invention aims at the problem of storage and analysis of network traffic and protocol messages of massive data in the information intranet of State Grid Corporation of China and Internet outlets. This embodiment provides a network traffic and protocol message analysis platform based on massive data, which is used for Data in the network is processed and stored.

[0032] The network flow and protocol message analysis platform includes: a network flow collector, a flow data storage, and an ETL data extraction tool, the three are interconnected, and the user can select according to its needs, (1) the network flow collector collects directly store the data, and then use the ETL data extraction tool for data extraction, or (2) perform ETL data extraction on the data collected by the network traffic collector first, and store the extracted data, or (3) pair (1) and (2) ) data are stored.

[0033] The network traffic collector is used to collect the traffic in the...

Embodiment 2

[0055] In this embodiment, the main focus is on the storage of network traffic data. The data volume of network traffic data is huge, and the cost of setting up storage devices for it alone is relatively high. Therefore, in this embodiment, the network traffic data is packaged through storage virtualization The access device stores it in the physical storage of the analyzed target. The storage virtualization access device mentioned here may use a virtual storage controller or other devices. When it is necessary to store network traffic data, compress the network traffic data into a compressed package of predetermined size and send it to the virtual storage controller. The virtual storage controller is used to control the storage of the analyzed target, and the virtual storage controller stores the network traffic data compressed package. In the corresponding physical storage, multiple physical storages constitute distributed storage through a virtual storage controller.

[00...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a network flow and protocol message analysis platform based on massive data. The network flow and protocol message analysis platform is used to process and store data in the network. The network flow and protocol message analysis platform includes : Network traffic collector, traffic data storage, ETL data extraction tool. The present invention can realize the storage of massive data on the information intranet and Internet outlets and fast retrospective analysis of historical data, so that network analysis can break through the time limit and be more accurate and efficient in data mining, tracking and positioning, and security evidence collection, thereby improving network operation and maintenance Level.

Description

technical field [0001] The invention relates to the communication field, in particular to a network flow and protocol message analysis platform based on massive data. Background technique [0002] In recent years, with the continuous innovation and development of State Grid Corporation's informatization in the company's power production and operation management, various network applications have emerged one after another, and information technology personnel have more and more demands for various application systems. While these applications meet the business needs of electric power informationization, they also bring more and more problems. [0003] Apps have brought more and more security vulnerabilities, which have become a security risk for all personnel; at the same time, some apps will upload personal private information, resulting in personal information leakage. [0004] Some applications wantonly consume network bandwidth, which will affect the use of the network b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/24H04L12/26H04L12/851H04L29/08
CPCH04L41/0631H04L41/14H04L41/147H04L43/028H04L43/045H04L47/2441H04L67/568
Inventor 李雨泰陈亮程杰尚智婕董希杰王洋
Owner STATE GRID INFORMATION & TELECOMM BRANCH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products