A message data processing method, apparatus, device and readable storage medium

A technology of message data and processing methods, applied in the direction of electronic digital data processing, special data processing applications, multi-programming devices, etc., can solve performance bottlenecks, difficulty in improving data sharing performance of different information systems, slowness and other problems, and achieve faster reading Effects of writing speed, improving data sharing performance, and simplifying the persistence process

Active Publication Date: 2022-07-22
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, the message queue persists messages to the file system to store and cache messages. Since the read and write of the disk is slower than that of the CPU or DRAM (Dynamic Random Access Memory, dynamic random access memory), this makes message persistence a priority for message queue applications. Performance bottleneck, difficult to improve data sharing performance between different information systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A message data processing method, apparatus, device and readable storage medium
  • A message data processing method, apparatus, device and readable storage medium
  • A message data processing method, apparatus, device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] Please refer to figure 1 , figure 1 It is a flowchart of a method for processing message data in an embodiment of the present invention, and the method includes the following steps:

[0059] S101. The distributed message queue system receives message data published by a message producer.

[0060] In this embodiment, in order to ensure that the message data can be persisted in the non-volatile memory. Before the distributed message queuing system receives the message data submitted by the message producer, the system hardware configuration can also be detected to determine whether the non-volatile memory is configured; if so, the non-volatile memory is set to the application direct access mode. That is to add non-volatile memory hardware to the server where the Broker of the distributed message queuing system is located; the non-volatile memory used in the system is PMM (Persistent Memory Module), which can directly use the DIMM interface technology, by setting it to m...

Embodiment 2

[0090] Corresponding to the above method embodiments, the embodiments of the present invention further provide a message data processing apparatus, and the message data processing apparatus described below and the message data processing method described above may refer to each other correspondingly.

[0091] see Figure 7 As shown, the device includes the following modules:

[0092] The data acquisition module 101 is used for the distributed message queuing system to receive the message data released by the message producer;

[0093] The data storage module 102 is configured to use the storage interface of the non-volatile memory to persistently store the message data in the non-volatile memory;

[0094] The data search module 103 is configured to search for target message data matching the consumption request from the non-volatile memory when receiving the consumption request sent by the message consumer;

[0095] The data sending module 104 is configured to use the socket...

Embodiment 3

[0107] Corresponding to the above method embodiments, the embodiments of the present invention further provide a message data processing device, and a message data processing device described below and a message data processing method described above may refer to each other correspondingly.

[0108] see Figure 8 As shown, the message data processing device includes:

[0109] a memory D1 for storing computer programs;

[0110] The processor D2 is configured to implement the steps of the message data processing method of the above method embodiments when executing the computer program.

[0111] For details, please refer to Figure 9 , a schematic diagram of a specific structure of a message data processing device provided in this embodiment, the message data processing device may have relatively large differences due to different configurations or performance, and may include one or more processors (central processing units, CPUs) ) 322 (eg, one or more processors) and memor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a message data processing method, device, equipment and readable storage medium. The method includes the following steps: a distributed message queue system receives message data released by a message producer; using a non-volatile memory storage interface, Persistently store the message data in the non-volatile memory; when receiving the consumption request sent by the message consumer, find the target message data matching the consumption request from the non-volatile memory; copy the target message data to the memory cache Then, use the socket to send the target message data to the message consumer. When the method persists the message data, the caching step is omitted, and the non-volatile memory has the characteristics of fast read and write speed and no loss when power off, which not only simplifies the persistence process, but also speeds up the read and write speed of the message data. , which improves the data sharing performance between different information systems.

Description

technical field [0001] The present invention relates to the technical field of data sharing and interaction, and in particular, to a message data processing method, apparatus, device and readable storage medium. Background technique [0002] Distributed application systems and big data technologies are increasingly used. In order to realize data sharing between different information systems, it is necessary to encapsulate data into messages, and realize data sharing and interaction between different systems through Message Queue (MQ). The message queue is a first-in, first-out message storage area. Messages are sent and received in order. Once the message is consumed and processed, the message will be deleted from the queue. [0003] Internet applications generate massive logs every day, and message queues can be used as message containers for log aggregation. The message queue can quickly and efficiently publish the business data of the application system to the big data a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/54G06F16/27
CPCG06F9/546G06F9/544G06F16/27
Inventor 胡德鹏魏健
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap