A message middleware ecological compatibility system and method based on zk

Abstract

The present invention provides a message middleware ecological compatibility system and method based on ZK, which relates to the technical field of Internet system construction, including: ZK, ZK is isolated between a client and a cluster, the client includes a RabbitMQ client and an IDMM client, the cluster includes an IDMM cluster and a RabbitMQ cluster, and the IDMM cluster includes an IDMM proxy module; the AMQP protocol obtained by protocol analysis of the RabbitMQ cluster is integrated into the IDMM proxy module; the IDMM proxy module of the IDMM cluster registers a path on ZK; the IDMM client and the RabbitMQ client both obtain addresses according to the path of the IDMM proxy module on ZK to achieve communication. The present invention uses a protocol-level compatible method, through the compatibility of the IDMM protocol and the AMQP protocol, to solve the problem of large-scale business transformation required in the process of domestic substitution of message middleware.

Description

Technical Field

[0001] The present invention relates to the technical field of Internet system construction, and in particular to a ZK-based message middleware ecological compatibility system and method. Background Art

[0002] In the process of Internet system construction, with the development of business diversity, in order to solve scenarios such as asynchronous notification, decoupling between systems (microservices), peak shaving and valley filling, cache synchronization, and real-time computing, message middleware is increasingly relied upon as the throat of data transmission.

[0003] RabbitMQ occupies a certain proportion in the current data processing business platform, especially in the mobile cloud platform of telecom operators. The use of domestic alternatives to RabbitMQ has gradually become the mainstream. At present, in the process of using domestic alternatives to RabbitMQ, it is necessary to stop the service for large-scale business transformation, which has an impact on the data processing business platform. Therefore, how to avoid large-scale business transformation during the replacement process has become the focus of research. Summary of the invention

[0004] In response to the above problems, the present invention provides a ZK-based message middleware ecological compatibility system and method to solve the problem of large-scale business transformation required in the process of domestic substitution of message middleware, and ensure the normal operation of the data processing business platform.

[0005] To achieve the above object, the present invention provides a message middleware ecological compatibility method based on zk, comprising: zk, wherein the zk is isolated between a client and a cluster, wherein the client comprises a rabbitmq client and an idmm client, wherein the cluster comprises an idmm cluster and a rabbitmq cluster, and wherein the idmm cluster comprises an idmm proxy module;

[0006] Integrate the AMQP protocol obtained by protocol analysis of the rabbitmq cluster into the idmm proxy module;

[0007] The idmm agent module of the idmm cluster registers the path on zk;

[0008] The idmm client and the rabbitmq client both obtain addresses according to the path of the idmm proxy module on the zk to achieve communication.

[0009] As a further improvement of the present invention, the AMQP protocol is integrated into the idmm agent module in the form of a component.

[0010] As a further improvement of the present invention, the protocol of the idmm cluster is parsed as idmm protocol, and the idmm proxy module is connected via the idmm protocol.

[0011] As a further improvement of the present invention, the idmm agent module of the idmm cluster registers a path on zk; including:

[0012] Register paths for the AMQP protocol and the idmm protocol respectively;

[0013] The idmm client obtains the address according to the idmm protocol path registered by the idmm proxy module on the zk to achieve communication;

[0014] The rabbitmq client obtains the address according to the AMQP protocol path registered by the idmm proxy module on the zk to achieve communication.

[0015] As a further improvement of the present invention, the registration path of the idmm agent module of the idmm cluster on zk is idmm / broker.

[0016] As a further improvement of the present invention, the idmm cluster further includes an idmm memory sorting module, and the idmm memory sorting module registers a path on zk as idmm / ble;

[0017] The idmm client and the rabbitmq client both obtain the address according to the path of the idmm memory sorting module on the zk and save the communication information.

[0018] As a further improvement of the present invention, the idmm memory sorting module is connected to a memory, and the communication information is stored in the memory.

[0019] The present invention also provides a method for a message middleware ecological compatibility system based on ZK, comprising:

[0020] Configure the idmm proxy module and enable the AMQP protocol;

[0021] Configure the idmm memory sorting module and enable the AMQP protocol plug-in adaptation;

[0022] Patrol without stopping hot loading, so that the rabbitmq client obtains the address according to the path of the idmm proxy module on the zk to achieve communication;

[0023] Test the cluster changes during the RabbitMQ client communication implementation process;

[0024] Complete the compatibility of idmm protocol with AMQP protocol and realize the replacement of rabbitmq system by idmm system.

[0025] Compared with the prior art, the present invention has the following beneficial effects:

[0026] The present invention discloses a method and system for a message middleware compatible with RabbitMQ based on ZK. The method utilizes protocol-level compatibility and is compatible with the IDMM protocol and the AMQP protocol. In the process of domestic substitution of the message middleware, the method realizes rapid deployment and replacement of the message middleware, a componentized management mode, simple development, low replacement cost, and low later maintenance cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 The present invention is a schematic diagram of a ZK-based message middleware ecological compatibility system disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] The present invention is further described in detail below in conjunction with the accompanying drawings:

[0030] like Figure 1 As shown, a message middleware ecological compatible system based on zk provided by the present invention includes: zk, zk is isolated between the client and the cluster, the client includes a rabbitmq client and an idmm client, the cluster includes an idmm cluster and a rabbitmq cluster, and the idmm cluster includes an idmm proxy module;

[0031] Integrate the AMQP protocol obtained by parsing the protocol of the rabbitmq cluster into the idmm proxy module;

[0032] The idmm agent module of the idmm cluster registers the path on zk;

[0033] Both the idmm client and the rabbitmq client obtain the address according to the path of the idmm proxy module on zk to achieve communication.

[0034] in,

[0035] The AMQP protocol is integrated into the idmm agent module as a component.

[0036] The protocol of the idmm cluster is parsed as idmm protocol, and the idmm proxy module is connected through idmm protocol.

[0037] Furthermore,

[0038] The IDMM agent module of the IDMM cluster registers the path on ZK; including:

[0039] Register paths for AMQP protocol and idmm protocol respectively;

[0040] The idmm client obtains the address according to the idmm protocol path registered by the idmm proxy module on zk to achieve communication;

[0041] The rabbitmq client obtains the address according to the AMQP protocol path registered by the idmm proxy module on zk to achieve communication.

[0042] Specifically,

[0043] The idmm agent module of the idmm cluster is registered on zk in the path idmm / broker.

[0044] The idmm cluster also includes the idmm memory sorting module, and the registration path of the idmm memory sorting module on zk is idmm / ble;

[0045] Both the idmm client and the rabbitmq client obtain the address according to the path of the idmm memory sorting module on zk and save the communication information.

[0046] The idmm memory sorting module is connected to a memory, and communication information is stored in the memory.

[0047] The present invention also provides a method for a message middleware ecological compatibility system based on ZK, comprising:

[0048] S1. Configure the idmm proxy module and enable the AMQP protocol;

[0049] in,

[0050] Modify the broker config file of the node and enable the cluster plug-in AMQPprotocol true;

[0051] S2. Configure the idmm memory sorting module and enable the AMQP protocol plug-in adaptation;

[0052] in,

[0053] Modify the ble config file of the node and enable the cluster plug-in AMQPprotocol true;

[0054] S3, patrol without stopping hot loading, so that the rabbitmq client obtains the address according to the path of the idmm proxy module on zk to achieve communication;

[0055] Among them, it also includes:

[0056] Perform rolling hot loading, business testing and stress testing of upgraded nodes, and corresponding business testing of configured topics;

[0057] S4. Test the cluster changes during the RabbitMQ client communication implementation process;

[0058] in,

[0059] That is: test with the AMQP native client (modify the direction);

[0060] S5. Repeat the above process until all businesses have completed the replacement.

[0061] Among them, the idmm protocol is made compatible with the AMQP protocol, and the idmm system replaces the rabbitmq system.

[0062] Advantages of the present invention:

[0063] The present invention discloses a method and system for a ZK-based message middleware compatible with RabbitMQ ecology, which achieves a soft load isolation effect by utilizing a protocol-level compatible method, and realizes rapid deployment and replacement of message middleware in the process of domestic substitution of message middleware through the compatibility of IDMM protocol and AMQP protocol, and a componentized management mode, which has the advantages of simple development, low replacement cost and low later maintenance cost.

[0064] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A message middleware ecological compatible system based on zk, characterized in that: include: zk, the zk is isolated between the client and the cluster, the client includes a rabbitmq client and an idmm client, the cluster includes an idmm cluster and a rabbitmq cluster, the idmm cluster includes an idmm proxy module, the protocol of the idmm cluster is parsed as idmmprotocol, and the idmm proxy module is connected through the idmm protocol; Integrate the AMQP protocol obtained by protocol analysis of the rabbitmq cluster into the idmm proxy module; wherein the AMQP protocol is integrated into the idmm proxy module in the form of a component; The idmm agent module of the idmm cluster registers a path on zk; specifically including: registering paths for the AMQP protocol and the idmm protocol respectively; The idmm client and the rabbitmq client both obtain addresses according to the path of the idmm proxy module on the zk to achieve communication; specifically including: the idmm client obtains the address according to the idmmprotocol path registered by the idmm proxy module on the zk to achieve communication; the rabbitmq client obtains the address according to the AMQP protocol path registered by the idmm proxy module on the zk to achieve communication.

2. The system according to claim 1, characterized in that: The registration path of the idmm agent module of the idmm cluster on zk is idmm / broker.

3. The system according to claim 1, characterized in that: The idmm cluster also includes an idmm memory sorting module, and the idmm memory sorting module registers a path on zk as idmm / ble; The idmm client and the rabbitmq client both obtain the address according to the path of the idmm memory sorting module on the zk and save the communication information.

4. The system according to claim 1, characterized in that: The idmm memory sorting module is connected to a memory, and the communication information is stored in the memory.

5. A method for a ZK-based message middleware ecological compatibility system based on any one of claims 1 to 4, characterized in that: include: Configure the idmm proxy module and enable the AMQP protocol; Configure the idmm memory sorting module and enable the AMQP protocol plug-in adaptation; Patrol without stopping hot loading, so that the rabbitmq client obtains the address according to the path of the idmm proxy module on the zk to achieve communication; Test the cluster changes during the RabbitMQ client communication implementation process; Complete the compatibility of idmm protocol with AMQP protocol and realize the replacement of rabbitmq system by idmm system.

Images