Supercharge Your Innovation With Domain-Expert AI Agents!

Network stream data reordering method

A streaming data and network streaming technology, applied in the field of computer networks, can solve problems such as the need to improve the compression effect of streaming data, high data entropy, and the inability to guarantee the similarity of streaming data, etc., to speed up query speed, reduce data entropy, and insert data fast effect

Active Publication Date: 2015-05-13
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF4 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

That is to say, the oLSH algorithm cannot guarantee that the stream data with adjacent storage positions after reordering have high similarity. Therefore, the data entropy of the stream data storage scheme based on the oLSH algorithm is still relatively high, and the compression effect of the stream data has yet to be achieved. improve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Network stream data reordering method
  • Network stream data reordering method
  • Network stream data reordering method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] According to an embodiment of the present invention, a method for storing network flow data is provided. Generally speaking, a Hash table is created in memory, and then the received network flow data is processed through low-complexity data processing according to certain rules Quickly store in the corresponding position of the Hash table to realize the reordering of network flow data, so that similar flow data can be integrated and stored together.

[0038] figure 1 It is a flowchart of a method for storing stream data in an embodiment of the present invention, and the method for storing network stream data includes the following steps 1 to 4.

[0039] Step 1: Create a Hash table. The length of the Hash table can be set as required. For the convenience of description, the length of the Hash table is taken as 65535 in the following. Each index value in the Hash table corresponds to a Hash bucket. A Hash table with a length of 65535 has 65535 Hash buckets, and any numb...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a network stream data storage method. The method comprises 1) receiving stream data, for each stream datum, calculating index values according to a source IP address network segment and a target IP address network segment, and finding a corresponding Hash value from a Hash table according to the calculated index values, wherein the Hash table is a pre-established data structure for caching the stream data; 2) grouping the stream data in the barrel according to the differences among the quintuple of the stream data, wherein the stream data of the same group are arranged together. By the aid of the method, the storage performance of the network stream data storage system can be improved greatly, the data entropy is reduced, the compression ratio is improved, space required by stream data storage is reduced, and the stream data search speed is improved.

Description

technical field [0001] The invention relates to the technical field of computer networks, in particular, the invention relates to a method for reordering network stream data. Background technique [0002] With the rapid development of the Internet, a lot of data is generated in the network every day. Due to the continuous high speed and complexity of modern networks, network operators are paying more and more attention to the current changes in network conditions. In order to deal with network security issues well, it is necessary to conduct network data analysis, behavior model simulation and prediction, etc., and these need to be supported by massive data, and long-term continuous streaming data is required as the source of statistical analysis, so streaming data analysis is to discover security issues , one of the important means to find the source of the problem and trace the cause of the event. [0003] Different from other ordinary data, in network flow, streaming dat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/06G06F17/30
CPCH04L61/255G06F16/2255H04L67/5651H04L67/566
Inventor 董尚文张广兴付乔宾贺泰华彭群
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com