Unlock instant, AI-driven research and patent intelligence for your innovation.

Message data processing method, device and equipment and readable storage medium

A technology of message data and processing methods, applied in the direction of electrical digital data processing, special data processing applications, multi-programming devices, etc., can solve problems such as difficulty in improving data sharing performance, slowness, and performance bottlenecks in different information systems

Active Publication Date: 2020-06-02
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, the message queue persists messages to the file system to store and cache messages. Since the read and write of the disk is slower than that of the CPU or DRAM (Dynamic Random Access Memory, dynamic random access memory), this makes message persistence a priority for message queue applications. Performance bottleneck, difficult to improve data sharing performance between different information systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Message data processing method, device and equipment and readable storage medium
  • Message data processing method, device and equipment and readable storage medium
  • Message data processing method, device and equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] Please refer to figure 1 , figure 1 It is a flow chart of a message data processing method in an embodiment of the present invention, and the method includes the following steps:

[0059] S101. The distributed message queue system receives message data published by a message producer.

[0060] In this embodiment, in order to ensure that the message data can be persisted in the non-volatile memory. Before the distributed message queuing system receives the message data submitted by the message producer, it can also detect the system hardware configuration to determine whether non-volatile memory is configured; if so, set the non-volatile memory to the application direct access mode. That is, non-volatile memory hardware is added to the server where the Broker of the distributed message queue system is located; the non-volatile memory used in the system is PMM (Persistent Memory Module), which can directly use the DIMM interface technology by setting it to the memory mo...

Embodiment 2

[0090] Corresponding to the above method embodiments, an embodiment of the present invention also provides a message data processing device, and the message data processing device described below and the message data processing method described above can be referred to in correspondence.

[0091] see Figure 7 As shown, the device includes the following modules:

[0092] The data acquisition module 101 is used for the distributed message queuing system to receive the message data issued by the message producer;

[0093] The data storage module 102 is configured to use the storage interface of the non-volatile memory to persistently store the message data in the non-volatile memory;

[0094] The data search module 103 is used to search the target message data matching the consumption request from the non-volatile memory when receiving the consumption request sent by the message consumer;

[0095] The data sending module 104 is configured to copy the target message data to the...

Embodiment 3

[0107] Corresponding to the above method embodiment, the embodiment of the present invention also provides a message data processing device, and a message data processing device described below and a message data processing method described above may refer to each other correspondingly.

[0108] see Figure 8 As shown, the message data processing equipment includes:

[0109] memory D1 for storing computer programs;

[0110] The processor D2 is configured to implement the steps of the message data processing method in the above method embodiment when executing the computer program.

[0111] Specifically, please refer to Figure 9 , is a specific structural diagram of a message data processing device provided in this embodiment. The message data processing device may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPUs) ) 322 (eg, one or more processors) and memory 332, one or more storag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a message data processing method, device and equipment, and a readable storage medium. The method comprises the following steps: a distributed message queue system receiving message data published by a message producer; persistently storing the message data into a nonvolatile memory by utilizing a storage interface of the nonvolatile memory; when a consumption request sentby a message consumer is received, searching target message data matched with the consumption request from the nonvolatile memory; and after copying the target message data to a memory cache, sendingthe target message data to a message consumer by utilizing a socket. According to the method, when message data is persisted, a caching step is omitted, and the nonvolatile memory has the characteristics of high read-write speed and no loss in power failure, so that the persistence process is simplified, the read-write speed of the message data is increased, and the data sharing performance amongdifferent information systems is improved.

Description

technical field [0001] The present invention relates to the technical field of data sharing and interaction, in particular to a message data processing method, device, equipment and readable storage medium. Background technique [0002] Distributed application systems and big data technologies are increasingly widely used. In order to realize data sharing between different information systems, data needs to be encapsulated into messages, and data sharing and interaction between different systems can be realized through Message Queue (MQ). The message queue is a first-in first-out message storage area. Messages are sent and received in order. Once the message is consumed and processed, the message will be deleted from the queue. [0003] Internet applications generate massive logs every day, and message queues can be used as message containers for log aggregation. The message queue can quickly and efficiently publish the business data of the application system to the big dat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/54G06F16/27
CPCG06F9/546G06F9/544G06F16/27
Inventor 胡德鹏魏健
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD