Multi-thread message processing method based on lookup operation
A message processing and message technology, which is applied in the direction of multi-programming devices, electrical digital data processing, special data processing applications, etc., can solve the problems of upper-level application performance fluctuations, high time consumption, etc., and achieve message processing time saving and wide application prospects , design principle and reliable effect
Pending Publication Date: 2020-10-02
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF3 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
If there is a time-consuming message processing operation in the previous n-1 messages, such as network delay, etc., it will cause high time-consuming messages after the message in the queue, and has never caused multiple consecutive performance fluctuations of the upper-layer application
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0031] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.
[0032] Key terms appearing in the present invention are explained below.
[0033] figure 1 is a schematic flowchart of a method in one embodiment of the present invention.
[0034] like figure 1 As shown, the method 100 includes:
[0035] Step 110, obtaining the message queue for which the distributed file system needs to perform lo...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a multi-thread message processing method based on lookup operation, which comprises the following steps: adding a lookup message processing thread pool, and setting the minimumprocessing capacity of the thread pool; setting an initial position and traversing a message queue, and screening out a to-be-processed message queue according to the minimum processing capacity; averagely distributing the messages in the to-be-processed message queue to the threads of the thread pool, wherein all the threads carry out lookup processing operation at the same time. According to theinvention, the lookup messages sent to the MDS in a centralized manner are actively transferred to the corresponding thread pools in the message queue, and the lookup processing operation is executedat the same time, so that the overall message processing time of the message queue is greatly saved.
Description
technical field [0001] The technical field of distributed file processing of the present invention particularly relates to a multi-threaded message processing method based on lookup operation. Background technique [0002] In the current distributed file system, in many scenarios, it is necessary to perform at least one lookup operation before performing actual operations, such as performing a lookup operation before creating a file or deleting a file in a certain directory to determine whether the file really exists, thereby assisting Whether the upper module can perform actual operations. Among all the messages, the lookup operation in many scenarios is only to obtain the basic attributes of the file, but not to write and change the file. Such operations will not affect the consistency and accuracy of the data. [0003] In practical applications, such lookup operation messages are often sent to the MDS message queue in a short period of time. In MDS, all messages must wai...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/54G06F16/182
CPCG06F9/546G06F16/182
Inventor 李伟李雪生
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD