Message processing method and system

A message processing and message technology, applied in the field of data processing, can solve problems such as system blocking and message backlog, and achieve the effect of avoiding system blocking, avoiding message squeeze, and improving processing efficiency

Active Publication Date: 2021-02-26
SHANGHAI BILIBILI TECH CO LTD
View PDF13 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiment of the present application is to provide a message processing method, system, computer equipment, and computer-readable storage medium, which are used to solve the problem of internal production and consumption of the system, which is easy to cause a backlog of messages due to too many messages, resulting in system congestion.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Message processing method and system
  • Message processing method and system
  • Message processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040]figure 1 It schematically shows a flowchart of a message processing method according to Embodiment 1 of the present application. It can be understood that the embodiments of the present application may be executed in the computer device 12. Such asfigure 2 As shown, the message processing method may include steps S100 to S104, where:

[0041]Step S100: Store multiple queue nodes corresponding to multiple messages in the target message queue, and the multiple queue nodes include multiple compressible nodes.

[0042]As an example, the target message queue is a first-in first-out queue for consumers to read and consume in the order of the queue.

[0043]As an example, the multiple queue nodes may include two types of nodes, where one type of node is an incompressible node (NormalNode), and the other type of node is a compressible node (MergeNode). That is, the target message queue may include multiple incompressible nodes and multiple compressible nodes, or multiple compressible nodes.

[00...

Embodiment 2

[0061]This embodiment is to provide an intelligent automatic compression scheme, which can monitor the message queue in real time to intelligently determine whether to compress, thereby reducing message accumulation in time, or restoring full consumption, and thereby achieving a balance between consumption processing efficiency and processing volume.

[0062]Such asFigure 6 As shown, the message processing method may include steps S600 to S604, where:

[0063]In step S600, a plurality of queue nodes are stored in the target message queue, and the plurality of queue nodes includes a plurality of compressible nodes.

[0064]Step S602: Determine the working mode of the target message queue, so as to determine whether to compress the target message queue according to the working mode.

[0065]In this embodiment, at least two working modes are provided for the target consumption queue: normal mode and compressed mode.

[0066]In the normal mode, the target message queue is not compressed.

[0067]The comp...

Embodiment 3

[0092]Picture 11 Schematically shows a block diagram of a message processing system according to the third embodiment of the present application. The message processing system can be divided into one or more program modules, one or more program modules are stored in a storage medium, and are composed of one or more program modules. Executed by multiple processors to complete the embodiments of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments capable of completing specific functions. The following description will specifically introduce the function of each program module in this embodiment.

[0093]Such asPicture 9 As shown, the message processing system 1100 may include a storage module 1110, a compression module 1120, and a consumption module 1130, where:

[0094]The storage module 1110 is configured to store multiple queue nodes corresponding to multiple messages through the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a message processing method, and the method comprises the steps: storing a plurality of queue nodes corresponding to a plurality of messages through a targetmessage queue, wherein the plurality of queue nodes comprises a plurality of compressible nodes; compressing the plurality of compressible nodes to obtain a compressed target message queue; and consuming each queue node in the compressed target message queue. According to the embodiment of the invention, the number of the messages (corresponding to the corresponding queue nodes) in the target message queue can be reduced, so that the throughput of processing the messages can be improved, the message processing efficiency is improved, and message extrusion and system congestion caused by excessive messages are avoided.

Description

Technical field[0001]This application relates to the field of data processing technology, and in particular to a message processing method, system, computer equipment, and computer-readable storage medium.Background technique[0002]The production and consumption of data or messages within the system is usually realized based on a certain queue thread or thread pool consumption. Between systems, the production and consumption of messages between systems are decoupled through professional message middleware (such as Kafka). Message middleware will increase system complexity and overhead, and is not suitable for use as a message component within the system.[0003]Currently, production and consumption within the system are prone to message backlogs due to too many messages, causing system congestion.Summary of the invention[0004]The purpose of the embodiments of the present application is to provide a message processing method, system, computer equipment, and computer readable storage med...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/58H04L29/06H04L29/08
CPCH04L51/18H04L67/10H04L69/04
Inventor 韩志华
Owner SHANGHAI BILIBILI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap