Supercharge Your Innovation With Domain-Expert AI Agents!

A method for reordering network stream data

A streaming data and reordering technology, applied in the field of computer network, can solve the problems such as the need to improve the compression effect of streaming data, high data entropy, unable to guarantee the similarity of streaming data, etc. fast effect

Active Publication Date: 2017-12-08
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

That is to say, the oLSH algorithm cannot guarantee that the stream data with adjacent storage positions after reordering have high similarity. Therefore, the data entropy of the stream data storage scheme based on the oLSH algorithm is still relatively high, and the compression effect of the stream data has yet to be achieved. improve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for reordering network stream data
  • A method for reordering network stream data
  • A method for reordering network stream data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] According to one embodiment of the present invention, a method for storing network flow data is provided. Generally speaking, a Hash table is created in memory, and then the received network flow data is processed through low-complexity data processing according to certain rules. Quickly store in the corresponding position of the Hash table to realize the reordering of network flow data, so that similar flow data can be integrated and stored together.

[0038] figure 1 It is a flowchart of a method for storing stream data in an embodiment of the present invention, and the method for storing network stream data includes the following steps 1 to 4.

[0039] Step 1: Create a Hash table. The length of the Hash table can be set as required. For the convenience of description, the length of the Hash table is taken as 65535 in the following. Each index value in the Hash table corresponds to a Hash bucket. A Hash table with a length of 65535 has 65535 Hash buckets, and any nu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method for storing network stream data, comprising: 1) receiving stream data, for each stream data, calculating an index value according to the network segment to which the source IP address belongs and the network segment to which the destination IP address belongs, and according to the calculated The index value finds the corresponding Hash bucket in the Hash table, where the Hash table is a pre-established data structure for caching flow data; 2) In the Hash bucket, according to the difference between the flow data five-tuple The data is grouped, and stream data of the same group are arranged together. The invention can greatly improve the storage performance of the network stream data storage system, reduce data entropy, increase the compression ratio, reduce the space required for stream data storage, and accelerate the stream data query speed.

Description

technical field [0001] The invention relates to the technical field of computer networks, in particular, the invention relates to a method for reordering network stream data. Background technique [0002] With the rapid development of the Internet, a lot of data is generated in the network every day. Due to the continuous high speed and complexity of modern networks, network operators are paying more and more attention to the current changes in network conditions. In order to deal with network security issues well, it is necessary to conduct network data analysis, behavior model simulation and prediction, etc., and these need to be supported by massive data, and long-term continuous streaming data is required as the source of statistical analysis, so streaming data analysis is to discover security issues , one of the important means to find the source of the problem and trace the cause of the event. [0003] Different from other ordinary data, in network flow, streaming dat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/06G06F17/30
CPCH04L61/255G06F16/2255H04L67/5651H04L67/566
Inventor 董尚文张广兴付乔宾贺泰华彭群
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com