Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Flow processing method and system based on cold and heat separation

A technology of separation and processing of cold and heat, applied in transmission systems, digital transmission systems, special data processing applications, etc., can solve the problems of frequent replacement and high recording efficiency

Active Publication Date: 2021-09-10
NAT UNIV OF DEFENSE TECH
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the technical problems in the above-mentioned background technology, the present invention provides a flow processing method and system based on cold and hot separation, which can solve the existing problem of frequent replacement based on the Sketch statistical structure, under the limited storage space Accurately record the large number of flows in large-scale data flows with high recording efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Flow processing method and system based on cold and heat separation
  • Flow processing method and system based on cold and heat separation
  • Flow processing method and system based on cold and heat separation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] refer to figure 1 , this embodiment provides a flow processing method based on cold and hot separation, which specifically includes the following steps:

[0042] Step S101: Obtain stream data and related data packet information.

[0043] In a specific implementation, the data packet information can be represented by 5-tuple information, for example: (source IP, destination IP, source port, destination port, protocol type).

[0044] It should be noted here that those skilled in the art may also use other tuple information to represent the data packet information.

[0045] Step S102: Separate the cold flow and hot flow of the flow data and store them in the cold part and the hot part of the Countmax flow statistics structure, accurately record the hot flow information in the hot part, and only record the number of cold flows in the cold part without recording the cold flow. flow information.

[0046] In the specific implementation, the Countmax traffic statistics struc...

Embodiment 2

[0055] Such as Figure 6 As shown, this embodiment provides a flow processing system based on cold and hot separation, which includes:

[0056] Flow data obtaining module 11, it is used for obtaining flow data and relevant packet information;

[0057] Cold and hot separation recording module 12, which is used to separate the cold flow and hot flow of the flow data and store them in the cold part and the hot part of the Countmax flow statistics structure, accurately record the heat flow information in the hot part, and only record in the cold part Number of cold streams without recording cold stream information;

[0058] The recording result output module 13 is used for outputting the recording result of cold and hot traffic separation by the Countmax traffic statistics structure, so as to be used for attack detection.

[0059] What needs to be explained here is that each module of the flow processing system based on cold and heat separation in this embodiment corresponds to ...

Embodiment 3

[0061] This embodiment provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the steps in the flow processing method based on cold and hot separation as described in the first embodiment above are implemented.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the field of flow processing, and provides a flow processing method and system based on cold and heat separation. The method comprises the following steps: acquiring stream data and related data packet information; separating and storing cold flow and hot flow of the flow data in a cold part and a hot part of a Countmax flow statistical structure respectively, accurately recording the hot flow information in the hot part, and recording only the number of the cold flow in the cold part, wherein the cold flow information is not recorded; and outputting a cold and hot flow separation recording result by the Countmax flow statistical structure for attack detection.

Description

technical field [0001] The invention belongs to the field of flow processing, and in particular relates to a flow processing method and system based on cold and heat separation. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] Large-scale data flow recording results can be used for flow frequency estimation or DDOS detection, etc. In large-scale data streams, if you want to record all the information of all streams, it will consume a lot of storage resources, and in the case of limited storage resources, Sketch is a classic statistical structure in the existing traffic statistics technology , the typical idea of ​​the existing large-flow statistical structure based on sketch is to separate the cold flow and hot flow and count separately, but the inventors found that there are two typical problems in the existing solution: ① The cold flow i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/851H04L29/06H04L12/26G06F16/22
CPCH04L47/2441H04L63/1408H04L63/1441H04L63/1458H04L43/0876G06F16/2255G06F16/2282Y02D30/50
Inventor 吕高锋乔冠杰谭靖李韬赵国鸿毛席龙杨惠
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products