Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing system and method for network flow monitoring

A data processing system and network traffic technology, which is applied in the field of data processing systems for network traffic monitoring, can solve a large number of data processing and analysis problems, achieve efficient data organization forms and systems, avoid leakage risks, and enhance security.

Pending Publication Date: 2022-07-22
INFORMATION & COMM BRANCH OF STATE GRID JIANGSU ELECTRIC POWER
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Purpose of the invention: The purpose of the invention is to provide a data processing system and method for network traffic monitoring, so as to solve the problems faced by the processing and analysis of a large amount of data generated by the operation of network equipment in the power grid information system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing system and method for network flow monitoring

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The technical solutions of the present invention will be further described below with reference to the accompanying drawings.

[0028] A data processing system for network traffic monitoring, comprising a data acquisition layer, a data processing layer and a data output and display layer, specifically:

[0029] Data collection layer: collect network traffic monitoring data. There are two sources of network traffic monitoring data. One is the interaction information between the user's intranet client and the server collected by the Kelai probe. The data is passed in through kafka and the format is json. The information mainly includes client_ip, server_ip, client_port, Server_port, flow_end_time and other fields, through which offline statistics and real-time calculations can be performed. The data in Kafka is written to S3 and clickhouse for storage after cleaning and conversion. Clickhouse only saves data for nearly seven days for data query and For ad hoc computing, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing system and method for network flow monitoring, the system comprises a data acquisition layer, a data processing layer and a data output and display layer, the data acquisition layer is used for acquiring network flow monitoring data; the data processing layer mainly comprises an offline calculation module and a real-time calculation module; and the data output and display layer is used for displaying, analyzing and processing results after data calculation. According to the invention, a multi-level hierarchical division data processing architecture is adopted, so that the network flow monitoring system has an efficient data organization form and system; the service data with high real-time requirement is processed and calculated, so that the user can be helped to find and solve problems in time; and the network flow data adopts an intranet security isolation storage mode, so that the security of the data is enhanced, and the risk of sensitive data leakage is avoided.

Description

technical field [0001] The invention relates to power grid data management, in particular to a data processing system and method for network flow monitoring. Background technique [0002] With the continuous cross-integration of the power grid system and informatization, more and more services are carried in the information network, and the structure of the network is becoming more and more complex. At the same time, the network data traffic is also ushering in explosive growth. Handling is a new challenge. The power grid enterprises need to be safe, stable, fast, and well adapted to various network environments for information system network data to avoid problems such as data security, data loss, and data distortion. Therefore, it is necessary to monitor the network traffic data. Through the analysis of the data, the overall operation status of the network can be understood, and the problems and hidden dangers in the network can be discovered and solved in time. SUMMARY...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L43/04H04L43/12
CPCH04L43/04H04L43/12
Inventor 王翀许梦晗刘凯顾颖程孙博宋玉程环宇
Owner INFORMATION & COMM BRANCH OF STATE GRID JIANGSU ELECTRIC POWER
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com