Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

A large flow ip analysis system and method based on deduplication of multi-node flow data

A traffic data and analysis system technology, applied in digital transmission systems, transmission systems, data exchange networks, etc., can solve problems such as large data volume, unavailability of original traffic data, and unavailability of administrators

Active Publication Date: 2017-06-13
CERNET CORP
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, after the traffic data is collected, it is necessary to analyze and organize the traffic data first, extract valuable summary information and report it to the network administrator, but the raw traffic data collected directly is not available, because although detailed reports File-level information can reflect network conditions without loss, but due to the huge amount of data, it is completely unavailable to administrators

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A large flow ip analysis system and method based on deduplication of multi-node flow data
  • A large flow ip analysis system and method based on deduplication of multi-node flow data
  • A large flow ip analysis system and method based on deduplication of multi-node flow data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0025] According to one aspect of the present invention, a large flow independent IP analysis system based on deduplication of multi-node flow data is provided, such as figure 1 As shown, the system includes: a flow collection module, a filter module, a flow aggregation module FlowMerge, a flow sorting module FlowTopK and a flow drilling module FlowLookup, wherein:

[0026] The flow collection module is connected to the filter module for collecting flow data, and sending the collected flow data to the filter module;

[0027] The collection of traffic data includes collecting fixed IP address segments, collecting IP address pairs, and / or collecting all traffic data generated within a certain period of time between two node...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a large-flow independent IP analysis system based on deduplication of multi-node flow data. The system includes: a flow collection module for collecting flow data; a filtering module for filtering flow data; a flow aggregation module for Aggregate the filtered traffic data; the traffic sorting module is used to sort the traffic aggregation results; the traffic drill-down module is used to drill down and analyze multiple IP addresses with large traffic to find the cause of the large traffic. The invention also discloses a large flow independent IP analysis method based on deduplication of multi-node flow data. The present invention makes the knowing of the specific traffic more targeted, purposeful, and non-blindly queried from a large amount of data, and can provide more convenient and effective information compared with the high controllability requirements of the administrator for the traditional traffic collection data. Highly customized data, more intuitive and practical.

Description

technical field [0001] The invention belongs to the technical field of large flow and big data analysis, in particular to a large flow IP analysis system and method based on deduplication of multi-node flow data. Background technique [0002] In order to manage the network in a timely manner, it is necessary to grasp the traffic information on the link at any time, and then perform targeted optimization, deployment and scheduling of various resources. At the same time, after the traffic data is collected, it is necessary to analyze and organize the traffic data first, extract valuable summary information and report it to the network administrator, but the raw traffic data collected directly is not available, because although detailed reports File-level information can reflect network conditions without loss, but due to the huge amount of data, it is completely unavailable to administrators. [0003] From the perspective of practical application, traffic reports should provi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/26
Inventor 郝健邓斌黄友俊李星吴建平
Owner CERNET CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com