Efficient network flow processing method and system based on dynamic array

A dynamic array and network flow technology, applied in computer software technology and network fields, to achieve a wide range of practical values ​​and application scenarios, reduce waste of memory space, and low space consumption

Inactive Publication Date: 2020-03-31
INST OF INFORMATION ENG CHINESE ACAD OF SCI
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method is aimed at the result caching method in the case of high concurrent flow, and uses the memory pool method as a prototype to reduce the waste of memory space and meet the requirements of efficient processing performance and low space consumption of online systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Efficient network flow processing method and system based on dynamic array
  • Efficient network flow processing method and system based on dynamic array
  • Efficient network flow processing method and system based on dynamic array

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below through specific embodiments and accompanying drawings.

[0044] The main idea of ​​the present invention is to design a cache manager, and design a lightweight dynamic array based on the cache manager to realize dynamic storage of system calculation results. Such as figure 1 As shown, each cache manager can apply for N superblocks at most, and N can be dynamically adjusted according to changes in actual system requirements. In this embodiment, it is assumed that N is 512, and each superblock contains 2^20 basic blocks. A basic block can store 8 elements. Wherein, the super block is a larger piece of memory space (or memory block), and then the memory space is divided into a certain number of small memory spaces of fixed size, which are basic blocks. In order to ensure the versatility of the data stru...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an efficient network flow processing method and system based on a dynamic array. The method comprises: allocating a cache manager to each thread, wherein the cache managers apply for memory blocks with super blocks as units, and each super block comprises a plurality of basic blocks; setting a dynamic array, and storing a scanning result of the network flow in the super block applied by the cache manager of the thread to which the scanning result belongs through the dynamic array; creating a required thread in an initialization stage, and initializing a cache manager,network flow in the thread and a dynamic array; and performing operations of applying for the memory, obtaining the next element and returning the memory in the memory use stage. Waste of memory spacecan be reduced, and the requirements for efficient processing performance and low space consumption of an online system are met.

Description

technical field [0001] The invention belongs to the fields of computer software technology and network technology, and in particular relates to an efficient dynamic array-based network traffic processing method and system. Background technique [0002] Storing calculation results is one of the most basic operations in all information systems, and the data structure used to store settlement results is also one of the basic data structures of information systems. For a high-concurrency online real-time system that needs to process a large amount of data, the data storage data structure must not only meet the fast access of data, but also its memory usage should not be too large. Taking a real-time network traffic processing system as an example, it needs to process millions of TCP connections concurrently. Assume that the computer running the system supports a maximum of 32 threads, and each thread manages 100,000 concurrent TCP connections. The concurrent maintenance of the c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/861
CPCH04L49/90H04L49/9005H04L49/9063
Inventor 卢毓海王晓琳刘燕兵张春燕谭建龙郭莉
Owner INST OF INFORMATION ENG CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap