Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Message consumption method and device and readable storage medium

A technology of message and target message, applied in the field of communication, can solve the problem of low rate of message consumption

Active Publication Date: 2019-12-03
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a message consumption method, device, and readable storage medium to solve the problem that the rate of message consumption in the Kafka server by the consumption client is relatively low at present

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Message consumption method and device and readable storage medium
  • Message consumption method and device and readable storage medium
  • Message consumption method and device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0026] It should be understood that the specific embodiments described here are only used to explain the present invention, only a part of the embodiments of the present invention, not all the embodiments, and are not intended to limit the present invention.

[0027] In order to introduce the embodiment of the present invention more clearly, hereby combine figure 1 The message consumption solution provided by the prior art is introduced. refer to figure 1 , figure 1 A system architecture diagram for implementing message consumption provided by the prior art. The system includes a production client 101 , a Kafka server 102 and a consumption client 103 . The production client 101 sends the message to the Kafka server 102, and th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a message consumption method and device and a readable storage medium. fThe message consumption method comprises the following steps: caching each message to afirst target message queue corresponding to a target partition, sending the maximum offset of the message in each message to a Kafka server to obtain at least one message after the maximum offsetd, so that the at least one message after the maximum offset can be obtained without waiting for the completion of the processing of a batch of obtained messages, and the rate of obtaining the messages from the Kafka server is increased to a certain extent. The messages can be acquired from the first target message queue through the plurality of first threads in the thread pool corresponding to the first target message queue, and the messages are consumed, so that the message consumption efficiency is improved.

Description

technical field [0001] The present invention relates to the communication field, in particular to a message consumption method, device and readable storage medium. Background technique [0002] Kafka is a distributed message queuing system developed by Linkedin. The main goal of Kafka development is to build a data processing framework for processing massive log user behavior and website operation statistics. A Kafka cluster contains one or more Kafka servers. Each message published to a Kafka server has a topic, which is called a Topic. A Kafka server can accommodate multiple Topics, and each Topic contains one or more partitions. The production client can send messages to the Kafka server, and the consumer client can consume the messages in the Kafka server. [0003] At present, before the business accesses the Kafka server, it is necessary to estimate the throughput of the production client and the consumption client to determine the number of partitions of the configur...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/863H04L29/08G06F9/50
CPCH04L67/1008H04L67/1097H04L47/50G06F9/5027G06F2209/5011Y02D10/00
Inventor 柯登科段光磊王平赫振军周正张大虎王杨徐婷
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com