Implementation method for highly concurrent message queues

Abstract

The invention discloses an implementation method for highly concurrent message queues. The method comprises the steps of creating a doubly linked list of an FIFO (First Input First Output) as a globalmessage queue, and a message queue thread corresponding to the global message queue; creating a global thread pool, wherein the global thread pool is provided with a certain amount of work threads and data source job linked lists; enabling the message queue thread to detect that messages exist in the global message queue, sequentially taking out each message from an egress of the global message queue to generate jobs, inserting the jobs into the data source job linked list of the global thread pool, and then broadcasting the work threads; and enabling different work threads of the global thread pool to respectively take out one job from the data source job linked list, executing callback functions of the corresponding messages according to types of the jobs to perform corresponding business processing, and respectively returning processing results to corresponding clients after completion of the execution. According to the implementation method for the highly concurrent message queues, a relatively large data request concurrent amount can be borne; after pushing the messages to the message queues, a consumer does not need to wait for return results; the response speed is improved;and the consumption of system resources is reduced.

Description

technical field [0001] The invention relates to computer communication technology, in particular to a method for realizing a high concurrent message queue. Background technique [0002] Message Queue (Message Queue, MQ) is a communication method between applications. Messages can be returned immediately after sending. The message system ensures the reliable delivery of messages. The message publisher only publishes the message to MQ and does not care who will Fetch, message users only get messages from MQ regardless of who publishes them. [0003] MQ is often used in scenarios such as business decoupling, eventual consistency, broadcasting, and off-peak flow control. For example, as the business develops and the order volume increases, the performance of system services needs to be improved. At this time, some services that do not need to take effect immediately Operations are split and executed asynchronously, such as sending red envelopes, sending SMS notifications, etc. ...

AI Technical Summary

Problems solved by technology

[0008] The technical problem to be solved by the present invention is that the existing message queue cannot carry a large amount of concurrency, the consumer needs to wait for the return result after pushing the message to the message queue, and needs to create a worker thread to execute the content of the message when fetching the message from the message queue

Images