Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A dpdk-based high-speed network data packet capture splitting and caching method

A high-speed network and network data technology, applied in the transmission system, electrical components, etc., can solve the problems of non-compliance, inability to high-speed shunt and cache, no data packet shunt and cache requirements, etc., to achieve the effect of high-speed capture

Active Publication Date: 2022-03-25
南京知常容信息技术有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Although there are related data processing methods based on DPDK in the prior art, the following problems generally exist, for example: there is no requirement for splitting and caching of data packets or high-speed splitting and caching is not possible, which does not meet the current trend requirements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A dpdk-based high-speed network data packet capture splitting and caching method
  • A dpdk-based high-speed network data packet capture splitting and caching method
  • A dpdk-based high-speed network data packet capture splitting and caching method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0046] Step 1: Network Data Capture

[0047] Step 1-1: Install the DPDK driver;

[0048] Step 1-2: Use the packet capture interfaces rte_eth_rx_burst and rte_ctrlmbuf_data to obtain data packets, set the network card queue to 4, start four packet capture threads at the same time, and bind the packet capture threads to 0-3 cores of the CPU.

[0049] Step 2: Parse the captured data packet, extract the quintuple information, parse the data packet into a custom format CDetectionElement, and cache it in the lock-free queue concurrent_queue. The specific method is:

[0050] Step 2-1: Analyze the data packet, extract information such as source IP, destination IP, source port, destination port and protocol type, and encapsulate it into a class CDetectionElement to be detected;

[0051] Step 2-2: Put CDetectionElement into the buffer queue, the queue uses the concurrent_queue lock-free queue in intel TBB;

[0052] Step 3: The thread polls the cache queue, and when the data in the qu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a DPDK-based high-speed network data packet capture splitting and caching method. First, the Intel DPDK interface is used to capture the original network data message, and then the captured message is encapsulated into a self-defined format CDetectionElement and stored in the concurrent_queue lock-free cache queue , and then use the polling method to read the data packet from the queue, extract the five-tuple information and use a specific hash algorithm to calculate the hash value, and finally find and store it in a specific hash list according to the obtained hash value middle. The present invention finally realizes the real-time capture, distribution and buffering of data packets in a 10 Gigabit network environment, and has higher data processing capabilities than existing methods. Cache handling.

Description

technical field [0001] The invention relates to a network data packet distribution and cache method, in particular to a DPDK-based network data packet capture distribution and cache method. Background technique [0002] In the field of network security, data packet capture and caching is a basic technology, which is used in many network security application scenarios such as IDS (Intrusion Detection Systems), IPS (Intrusion Prevention system), and network data review. In the network environment, how to capture data packets efficiently, completely and quickly is the basis for accurate analysis of network data and the key technology of network security protection system. [0003] The traditional packet capture scheme has two forms: software and hardware. The cost of the hardware solution is too high. The software methods mainly include three methods: BPF, libpcap and pf_ring. [0004] Berkeley Packet Filter BPF (Berkeley Packet Filter) is an original interface of the data lin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L47/20H04L47/10H04L47/625H04L45/7453H04L49/9005H04L49/9015
CPCH04L45/7453H04L47/20H04L47/29H04L47/625H04L49/9005H04L49/9015
Inventor 翟江涛杨路辉金钰赵玉鑫
Owner 南京知常容信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com