High-speed big data detection method and device
A big data and high-speed technology, applied in the field of data processing, can solve the problems of low efficiency of network data detection and processing, and achieve the effect of high-speed and stable operation
Inactive Publication Date: 2017-02-01
北京中测安华科技有限公司
View PDF5 Cites 9 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The technical problem solved by the solution provided according to the embodiment of the present invention is that the detection and processing efficiency of network data is low under the bandwidth of 10 Gigabit (10G) or even higher speed of 20G or more
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0040] The preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described below are only used to illustrate and explain the present invention, and are not intended to limit the present invention.
[0041] figure 2 It is a flow chart of a high-speed big data detection method provided by an embodiment of the present invention, such as figure 2 shown, including:
[0042] Step S201: Copy the network data received by each queue of the network card to the corresponding kernel cache by utilizing the one-to-one correspondence between the multiple queues of the network card and the multiple kernel buffers of the operating system kernel. in the district;
[0043] Step S202: use a plurality of data set processing units whose number is equivalent to the number of network card queues to process the network data copied to the kernel buffer, and each data set ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a high-speed big data detection method and device. The method comprises the following steps that a plurality of one-to-one correspondence first virtual data stream transmission channels built among a plurality of network card queues and a plurality of core cache regions of an operating system core are used for copying the network data received by each network card queue into the corresponding core cache region; a plurality of data set processing units with the sane quantity as the network card queue quantity are used for processing network data copied into the core cache region; each data set processing unit processes network data received and coped into the core cache region by one corresponding network queue; according to the network data type obtained by processing the network data by each data set processing unit, corresponding second virtual data stream transmission channels are selected from the plurality of second virtual data stream transmission channels; network data of different network data types are written into the application layer memory through the selected second virtual data stream transmission channels.
Description
technical field [0001] The invention relates to the technical field of data processing, in particular to a detection method and device for high-speed big data. Background technique [0002] Today, the high-speed application of the Internet has already penetrated into every corner of life. It is hard to imagine how to live and work without the Internet, and even the management and operation of the country and the military cannot do without the Internet. As a result, network security has become the focus of public attention. [0003] The first line of defense for network security is network data detection. However, with the rapid development of high-speed and ultra-high-speed Ethernet networks, the traditional gigabit network data detection methods can no longer adapt to the current high-speed growth. In the traditional network detection system, from the perspective of data acquisition, the data enters the logical hardware layer through the network adapter of the physical la...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50H04L12/863H04L29/06
CPCG06F9/5077G06F2209/5018H04L47/50H04L69/22
Inventor 孙彦钊凌晨刘晓晨赵洪宇王振远范汇川张跃吴岳峰
Owner 北京中测安华科技有限公司