Device and method for improving message queue system performance

Abstract

The invention discloses a device and a method for improving the message queue system performance. The device comprises a producer module, a Thrift Server transferring layer module, a consumer module, a central node database, automatic tools and a hyper text transfer protocol (HTTP) server. The producer module is used for achieving the functions of transmission strategy and connection management; the Thrift Server transferring layer module is used for achieving connection management, inquiring and maintenance of correspondence of a queue and the host machine where the queue is located, the statistic function, the quotas administration function and the message releasing function; the consumer module is mainly used for achieving the functions of connection management, inquiring and maintenance of the correspondence of the queue and the main machine where the queue is located and message obtaining; the central node database is used for achieving the unified rear end storage, and serving as the metamessage of a central node maintenance system through Redis; the automatic tools comprise a series of automatic tools; and the HTTP server is used for supplying RESTful access interfaces for reading and transmitting message queue messages. By means of the device and method, the shortcoming that example internal memory boom can occur to the RabbitMQ cluster characteristics, the RabbitMQ performance of the message queue can be improved, and the processing capability can be improved.

Description

technical field [0001] The invention relates to an inter-program communication mechanism and a message queue processing technology, in particular to a device and a method for improving the performance of a message queue system. Background technique [0002] Message Queue (Message Queue) is a method of process communication between applications. Applications communicate by writing and reading application-specific data (messages) to and from the queue, without requiring a dedicated connection. Messaging refers to the communication between programs by sending data in messages rather than through remote procedure calls. The use of queues removes the requirement that the receiving and sending applications need to be executed at the same time, and achieves the purpose of decoupling between programs. [0003] A message queue is a typical producer and consumer model. One end continuously writes messages to the message queue, while the other end can read or subscribe to the message...

AI Technical Summary

Problems solved by technology

[0009] 2) Multiple producers (because the producer is related to the upstream processing capacity of the message queue, its number is not controlled by the message queue);

[0010] 3) Producers will send messages to multiple queues, and the arrival of messages is uneven, resulting in the possibility that multiple producers may continue to send messages to one queue at the same time;

[0013] At this time, the cluster feature of RabbitMQ will cause the memory of a single instance of RabbitMQ to skyrocket

Images