Efficient flow processing method based on software definition complex rule

Abstract

The invention discloses an efficient flow processing method based on a software-defined complex rule. The method comprises the following steps: step 1, configuring a file according to the rule; step 2, reading configuration; step 3, preparation before data receiving; fourthly, formal work is started; 5, the consumption thread receives the packet; step 6, data analysis; 7, performing session management; 8, checking the rule; and 9, an output stage. According to the processing method, a memory pool is prepared before a program runs, memory system expenses are prevented from being applied and released in the using process, multi-thread and lock-free queue management is achieved, each thread corresponds to one lock-free queue, each thread corresponds to one network card, and the enqueue and dequeue operation of receiving and sending packets and data packets avoids time expenses and context switching expenses for searching, so that the processing efficiency is improved. With the arrival of network data packets, the data packets can be quickly consumed without being blocked, so that the processing efficiency and performance are improved.

Description

technical field [0001] The invention relates to the field of physics, in particular to a method for processing network traffic data, in particular to an efficient traffic processing method based on software-defined complex rules. Background technique [0002] With the full application of computer technology, the rise of the Internet and the rapid development of network technology, as well as the rise of smart devices, the information explosion has accumulated to the extent of causing changes. The world generates huge amounts of data every day, and the speed is also crazily accelerating. The Internet, mobile Internet, Internet of Things, Internet of Vehicles, GPS, medical imaging, security monitoring, finance, and telecommunications are all generating data crazily. [0003] According to IDC (Internet Data Center) monitoring, the amount of data generated by humans is growing exponentially, doubling about every two years, and this rate will continue until 2020, which means that...

AI Technical Summary

Problems solved by technology

Wireshark can select one or several network cards, which are similar to tcpdump collection conditions, but it has more regular expressions to capture packets and matches the packet capture conditions based on exact strings. There is a serious problem of packet loss under high-speed traffic

[0037] Therefore, network packet analysis software, including Wireshark and tcpdump, intelligently supports protocol packet capture under small traffic, filtering of simple rules such as IP, port, HTTP and logical operations, and cannot meet the conditions of large traffic data and support complex advanced fine rules. Ability to extract and analyze data efficiently and quickly

Images