A method and system for orderly processing messages based on ignite
A message and orderly technology, applied in the field of big data processing, can solve problems such as difficulty in ensuring message order, inflexibility, and cumbersome settings, and achieve the effects of fast reading and writing, expanding processing capabilities, and ensuring continuity
Active Publication Date: 2022-04-05
中电福富信息科技有限公司 +1
View PDF11 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
like figure 1 As shown, if the messages are required to be processed in an orderly manner and concurrently as much as possible, then the message source must use multi-queue MQ, which is not only cumbersome to set up, but also not flexible enough
Since messages cannot be saved in STORM, when a node in the STORM cluster fails during message processing, it is difficult to ensure the order of messages
Ignite's own lack of guarantee for message transmission
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0028] like Figure 2-4 As shown in one, the present invention discloses a method and system for orderly processing messages based on Ignite. Ignite is a high-performance, integrated and distributed memory platform, using Ignite's internal integrated distributed message components and distributed memory components, using Ignite and MQ to achieve orderly and concurrent processing of real-time messages .
[0029] A method for orderly processing messages based on Ignite, comprising the following steps:
[0030] S1, the sending node receives the message sent from the external single-queue MQ, and uses the single-queue MQ to send the message so that the external system does not need to use cumbersome multi-queue MQ;
[0031] S2, the sending program writes the data into the distributed memory named according to the business field in the message according to the business field in the message;
[0032] S3, the sending program defines the subject of the message as the business field...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an Ignite-based message orderly processing method and system. The system includes a single-queue MQ and an Ignite server for sending messages, a distributed message component and a distributed memory component integrated inside the Ignite server, and a distributed message The components include a sending node connected to the distributed memory component and more than two receiving nodes. A sending program is set on the sending node, a service grid runs on the receiving node, and a receiving program runs on the service grid. The present invention utilizes the distributed message component and the distributed memory component integrated inside Ignite, and uses Ignite and MQ to cooperate to realize orderly and concurrent processing of real-time messages.
Description
technical field [0001] The invention relates to the field of big data processing, in particular to an Ignite-based message orderly processing method and system. Background technique [0002] For application scenarios that need to process messages generated in real time, in the prior art, a message queue (MQ) is usually used to cooperate with a distributed real-time computing system such as STORM. like figure 1 As shown, if the messages are required to be processed in an orderly manner and concurrently as much as possible, then the message source must use multi-queue MQ, which is not only cumbersome to set up, but also not flexible enough. Since messages cannot be saved in STORM, when a node in the STORM cluster fails during message processing, it is difficult to ensure the order of messages. Ignite's own lack of guarantee for message transmission. Contents of the invention [0003] The purpose of the present invention is to overcome the deficiencies of the prior art and...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/172G06F16/182G06F9/54
CPCG06F9/546G06F16/172G06F16/182
Inventor 郭海涛连城孙而焓
Owner 中电福富信息科技有限公司