Message delay processing method and system

A delay processing and message technology, applied in the computer field, can solve problems such as low data transmission efficiency, and achieve the effect of avoiding subsequent delay problems

Active Publication Date: 2021-01-22
SHANGHAI BILIBILI TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiment of the present application is to provide a message delay processing method, system, computer equipment and computer-readable storage medium, which can be used to solve the following problem: the problem of low data transmission efficiency caused by delay

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Message delay processing method and system
  • Message delay processing method and system
  • Message delay processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051]figure 2 It schematically shows the operating environment diagram of the message delay processing method of the present application, which may have the following combination parts:

[0052]The client 30 is an application program running in the server, and is used to send the message in the data source 1 to the server cluster. The message delay processing method may be a part of the client 30 or a plug-in in the form of code. It can be seen that the execution subject of the message delay processing method described in this embodiment is the device running the client 30.

[0053]The server cluster 31, such as a Kafka cluster, is used to store messages.

[0054]The other server cluster 32 is a cluster different from the server cluster 31 and may be a standby cluster of the server cluster 31.

[0055]Cluster management components, such as Kafka guradian, can collect operating information of server clusters.

[0056]Distributed service coordination components, such as Zookeeper, are used for serv...

Embodiment 2

[0074]Figure 4 It schematically shows a flowchart of a message processing method according to the second embodiment of the present application.

[0075]Such asFigure 4 As shown, the message delay processing method may include steps S400 to S404, where:

[0076]Step S400: Send multiple messages to multiple partitions in the server cluster.

[0077]The client 30 can send each message to one of the partitions under the corresponding Topic according to the attributes, identifiers, etc. of each message. The multiple messages may be sent to one or more partitions in the server cluster 31.

[0078]When the client 30 sends the multiple messages, it may be sent one by one or batch by batch. Taking the client 30 sending messages to partition A in batches as an example, the client 30 sends 1000 messages to partition A in batches.

[0079]Step S402: Obtain the message sending status of the server cluster in the current time window based on a time sliding window, where the message sending status includes the r...

Embodiment 3

[0129]Picture 11 Shows a block diagram of a message delay processing system according to the third embodiment of the present application. The message delay processing system can be divided into one or more program modules, one or more program modules are stored in a storage medium, and Executed by one or more processors to complete the embodiments of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments capable of completing specific functions. The following description will specifically introduce the function of each program module in this embodiment. Such asPicture 11 As shown, the message delay processing system 1100 may include the following components:

[0130]The sending module 1110 is used to send multiple messages to multiple partitions in the server cluster;

[0131]The obtaining module 1120 is configured to obtain the message sending status of the server cluster, where the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a message delay processing method. The method comprises the following steps: sending a plurality of messages to a plurality of partitions in a server cluster; acquiring a message sending condition of the server cluster, wherein the message sending condition comprises a response delay condition of each partition; and fusing the target partition when the response delay condition of the target partition in the plurality of partitions meets a fusing condition. According to the method and the device, fusing operation can be actively carried out on the partitions which do notaccord with requirements according to the response delay condition of each partition, so that the problem of subsequent delay is avoided.

Description

Technical field[0001]The embodiments of the present application relate to the field of computer technology, and in particular, to a method, system, computer device, and computer-readable storage medium for message delay processing.Background technique[0002]The current streaming message delay processing system generally consists of a message delay processing layer (such as a gateway), a data buffer layer, a data distribution layer (controller), and a data storage terminal. When the data source has data to report, the data source will finally flow the reported data to the data storage terminal via the message delay processing layer, the data buffer layer, and the data distribution layer.[0003]With the rapid increase in the number of users, the amount of data also increases rapidly. For example, PB-level data may be generated every day, and the data buffer layer may need thousands of servers and tens of thousands of topics to process these messages. In the prior art, when a large amoun...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/54
CPCG06F9/546G06F2209/548Y02D30/50
Inventor 张辰安白鑫郑志升
Owner SHANGHAI BILIBILI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap