Network flow measurement method and system based on approximate zero error probability measurement data structure Sketch

A technology for network traffic and measurement data, applied in the fields of natural language processing and compressed sensing, which can solve problems such as insufficient query accuracy and unsupported instantaneous query

Active Publication Date: 2020-02-21
PEKING UNIV
View PDF16 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem that the existing Elastic Sketch algorithm has insufficient query accuracy for the flow in the light part, and overcome the defect that the existing Counter Braids method does not support instantaneous query, the present invention provides an improved Elastic Sketch algorithm that can store the flow label in the light part Sketch algorithm, and the processing rate is equivalent. At the same time, using the decoding algorithm idea proposed in CounterBraids, it can restore statistical information almost error-free.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Network flow measurement method and system based on approximate zero error probability measurement data structure Sketch
  • Network flow measurement method and system based on approximate zero error probability measurement data structure Sketch
  • Network flow measurement method and system based on approximate zero error probability measurement data structure Sketch

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0065] Use Elastic Sketch to maintain information about all incoming flows. For the flow entering the light part, the algorithm uses CM Sketch to store its flow information, but does not save the label of the corresponding flow. Therefore, the traffic can only be obtained through query, but the information of this part of the stream cannot be decoded and restored with high precision.

[0066] Here, the Zero-Error Sketch of version 1 of the present invention can be used to meet this requirement. When a flow is inserted into the light part, a query needs to be performed to obtain an estimated value that is not less than the real value. Using this estimate, match against the values ​​corresponding to the arrays storing the labels. If the match is successful, the label will be directly added to the end of the corresponding array; if the match fails, it may be because the hash value of other streams collided with the stream, and the label will not be saved at this time.

[0067]...

specific example

[0074] Such as Figure 4 , in the data center, the administrator can deploy multiple measurement nodes on the switch, and these measurement nodes collect the information of the incoming flow, and store the flow information in the relevant data structure proposed by the present invention. When a measurement task initiates a query request, if it is a fast query request, the measurement node will return the result from Elastic Sketch; if the request expects to get an error-free query result, the measurement node will save the label information and The stored information is handed over to the controller for calculation and processing, and the calculation result is replied after completion.

[0075] Based on the same inventive concept, another embodiment of the present invention provides a computer / server, which includes a memory and a processor, the memory stores a computer program, the computer program is configured to be executed by the processor, and the computer The program i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a network flow measurement method and system based on an approximate zero error probability measurement data structure Sketch. The method comprises the steps that a CM-Sketchdata structure used for storing small flow information and a data structure used for storing labels are set; when the table entry is updated in the network flow measurement process, the CM-Sketch is firstly updated, and then the data structure of the storage label is updated based on the observation of the CM-Sketch. When information of a new stream is inserted, label information and a timestamp of the new stream are stored in a designed data structure used for storing labels; when the flow information needs to be restored, the equation set can be solved according to the label stored in the data structure, and the accurate flow information is obtained. According to the method, on the premise that the algorithm time complexity is not obviously improved, the defect that Elastic Sketch is insufficient in small flow information query accuracy is overcome, and instantaneous query can be supported.

Description

technical field [0001] The invention relates to multiple important fields such as natural language processing, compressed sensing, network data flow analysis, distributed data sets, etc., and is specifically an improved method and system for network flow measurement based on Elastic Sketch. Background technique [0002] At present, the network measurement method based on Sketch (sketch) is the current mainstream and has a wide range of applications and prospects. And Count-Min (CM) Sketch (G.Cormode and S.Muthukrishnan.An improved data stream summary: the count-min sketch and its applications.Journal of Algorithms,55(1):58–75,2005.), namely counting -The smallest sketch, which is the most used, the best performance, and the most popular Sketch for all kinds of data. It can store traffic characteristic information in real time in a high-speed network environment, occupy only a small space resource, and has a theoretically provable balance between estimation accuracy and memo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/26G06F17/12
CPCG06F17/12H04L43/0876
Inventor 杨仝李雨欣
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap