Event library, expandable data management system and management method thereof

A technology for managing systems and expanding data, applied in the computer field, can solve the problems of increasing resource overhead of network waiting and context switching, blocking interface does not make good use of the characteristics of large memory and multi-core new hardware, etc., and achieves the goal of reducing time overhead Effect

Inactive Publication Date: 2018-05-18
EAST CHINA NORMAL UNIV
View PDF2 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] (1) The blocking interface does not make good use of the new hardware features of large memory and multi-core;
[0005] (2) A one-size-fits-all worker thread processing method is adopted for all data that needs to be transmitted and processed in the system, which will increase the resource overhead of network waiting and context switching due to more I / O-intensive short tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Event library, expandable data management system and management method thereof
  • Event library, expandable data management system and management method thereof
  • Event library, expandable data management system and management method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Example 1: Use of the application layer server

[0043] The server first initializes the thread pool of onev_io_e through the onev_create_io of the event library, and adds the callback function of the monitoring observer and thread observer for each thread. Table 1 lists the observer types of the event library application libev, and the callback function of each event is completed through the operation box of the corresponding observer. Register interested events with libev, such as socket readable events, libev will manage the source of the registered time, and trigger the corresponding program when the event occurs.

[0044] At the beginning of a connection, all threads in the server thread pool open the listening port, and set the event loop body to listen to the socket accept event. When the event arrives, a thread in the thread pool triggers the accept operation on the listening file handle, creating Connect and initialize the read-write observer and timeout obser...

Embodiment 2

[0054] Embodiment 2: the use of application layer client

[0055] The application layer client can choose to send requests in two ways: synchronous and asynchronous.

[0056] Before sending the package, first create onev_session_e to allocate memory space for sending, pack the request into the session, set the server address of the session target server, and associate it with the message. Note here that each session contains a request, and each message can contain multiple sessions, such as Figure 4 .

[0057] Calling onev_client_dispatch afterwards means that the application layer needs the client to send requests asynchronously, and calling onev_client_send means that the application layer needs the client to send requests synchronously. The former will set the timeout time of the session through the onev_session_set_timeout macro before sending. After sending, the event library will select the I / O thread from the I / O thread pool, add the session to it and wake up the thr...

Embodiment 3

[0058] Example 3: Memory allocation in resource management

[0059] Use the memory pool scheme of fixed allocation of large memory and variable length application of small memory to manage memory, and then manage the allocation and release of resources such as network I / O, connections, and requests. Resources at all levels are maintained in the form of linked lists. Memory management is based on connections, that is, memory is released in units of connections, and resources between connections do not interfere with each other.

[0060] exist Figure 4 In , each database request corresponds to a specific request packet in the application layer, which runs through the entire process of request input, processing and output. When the client sends a request packet, it needs to encapsulate the request into a message, set the input buffer for decoding, the input buffer corresponding to the connection, set the processing function and the timeout observer. A message can contain only...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of a computer and discloses an expandable data management system-oriented high performance event library. According to the event library, multithread processing network I / O is realized through adoption of an asynchronous non-blocking technology, I / O intensive short tasks can be processed relatively efficiently and multi-core processor performance undernew hardware trend is exerted sufficiently. According to the event library, in a bottom layer, events are registered and modified through adoption of an event loop model, synchronous and asynchronousnetwork transmission is supported, moreover, a network program and a network protocol are isolated, and packet receiving and transmitting logic is processed by connection between servers in a management system and connected input and output cache areas. According to the event library, configuration is carried out in a mode of mounting the library, so the event library can be applied to developmentof system software. The event library is expandable and the performance of processing the short tasks is improved clearly.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to an event library, an extensible data management system and a management method thereof. Background technique [0002] The vigorous development of Internet applications has created higher requirements for massive data storage and processing. Traditional stand-alone database management systems and their vertical expansion methods have been unable to meet such requirements. With the development of computer network and communication technology, scalable data management system has become the choice of many Internet companies. The scalable data management system adopts a cluster architecture, and the biggest difference from traditional databases is that it logically distributes the database management system. The system distributes and stores data in some nodes, and another part of nodes is responsible for parallel processing of queries and transactions. Therefore, in s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/06G06F17/30
CPCH04L69/162G06F16/25H04L67/01
Inventor 肖冰钱卫宁周傲英
Owner EAST CHINA NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap