High speed filtering and stream dividing method for keeping connection features

A high-speed, characteristic technology, applied in the field of network information, can solve problems such as fast search, limited data processing capacity, increased resource consumption, and lack of data collection.

Inactive Publication Date: 2005-01-12
上海光华如新信息科技股份有限公司
View PDF0 Cites 58 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current load balancing processing mechanism is to save the address information of the TCP connection in the form of a connection table. With the expansion and complexity of the network scale, the connection table will grow exponentially with the expansion of the network scale.
In addition, there are still a large number of useless false connections on the network, and the continuous expansion of the data scale of the connection table will increase the resource consumption in the table lookup process. Even if a high-performance NPU is used, it is difficult to meet the processing requirements of super large connection data.
[0005] 3. The problem of quick lookup of the connection table limits the improvement of data processing capabilities
The disadvantage of this product is that in order to ensure the consistency of bidirectional data packet processin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High speed filtering and stream dividing method for keeping connection features

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Such as figure 1 As shown, in the core backbone network environment, multiple intrusion detection devices, auditing devices and network monitoring devices are connected to monitor the operation status of the network system. These security devices need to extract the information required for their own processing from the massive data in the core backbone network as the basis for back-end analysis and judgment. By adopting the technical scheme proposed in the present invention, it is possible to satisfy the requirement that a large-capacity data forwarding processor cannot meet the classification and forwarding processing of data. Specific embodiments of the technical solution of the present invention are set forth below.

[0043] group number

output port ID

1

3;2;0;2

2

1;4

3

5;7;5;6;7

4

0;4

[0044] Ports classified into the same group indicate that they will process the same type of data packets, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

First, the invention sets up output port grouping rule and filtering tapping rule. Then, data filtering tapping process is carried out. IP data packets are picked up from original data packets received from network based on protocol analysis. Based on filtering tapping rule, data relevant to following processes are partitioned to group of each output port. Hash operation is carried out for address of data packet and port information in partitioned each group. Modular operation is carried our between the said Hash value and total number of port. The result is number of output port for the corresponding data packet in the group the data packet belongs to. Under high-speed backbone network, the invention meets need for clustering process and forwarding at high speed for mass data stream.

Description

technical field [0001] The invention relates to a high-flow data processing method of a broadband network, in particular to a high-speed filtering and splitting method suitable for maintaining connection characteristics of broadband network data, and is used in the field of network information technology. Background technique [0002] In the past two years, the construction of my country's backbone network and metropolitan area network has reached a considerable scale, and the bandwidth of the backbone network is usually above 2.5G. The performance of current network security products such as firewalls, intrusion detection systems, and network security audits on network data packets is the primary prerequisite for ensuring that the system can make correct and effective analysis and judgments on security events that occur in the network. Existing security products have great limitations for the massive data processing requirements of broadband networks above 2.5G and 10G: ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/721H04L29/06
Inventor 张世永严明郭巍
Owner 上海光华如新信息科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products