Automatic capacity expanding and reducing control method and device, storage medium and processor

A control method and processor technology, applied in the field of data processing, can solve the problems of resource waste and data backlog in distributed clusters, and achieve the effect of improving utilization

Active Publication Date: 2020-04-07
BEIJING GRIDSUM TECH CO LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the problem that often occurs in traditional solutions is that once a backlog of data in the queue is found, it is likely that there is already a large backlog of data, and developers may not be able to

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic capacity expanding and reducing control method and device, storage medium and processor
  • Automatic capacity expanding and reducing control method and device, storage medium and processor
  • Automatic capacity expanding and reducing control method and device, storage medium and processor

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0058] see figure 1 , this embodiment discloses a control method for automatic capacity expansion and contraction, which specifically includes the following steps:

[0059] S101: Monitor the total number of messages published by the message producer to the message queue middleware, the rate at which the message producer publishes messages, and the rate at which each message consumer consumes messages in the message queue middleware...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automatic capacity expanding and reducing control method. The method includes the steps of periodically monitoring the total number of messages in message queue middleware,the message publishing rate of a message producer and the message consumption rate of each message consumer, triggering a preset distributed application capacity expansion mechanism when the current total message number is greater than a preset maximum message number threshold, and triggering a preset distributed application capacity reduction mechanism when the current total message number is less than a preset minimum message number threshold. According to the method, the capacity expansion and reduction control of the distributed application is automatically realized, the state of higher load and the state of lower load of the message queue middleware are monitored in time, the capacity is reasonably expanded when the load is higher, and the capacity is reasonably reduced when the loadis lower, so that the utilization rate of distributed cluster resources is improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, and more specifically, to a control method, device, storage medium and processor for automatic capacity expansion and contraction. Background technique [0002] Distributed applications will use a message queue as the message middleware architecture. Under this architecture, if the rate of message production is greater than the rate of message consumption, the data will be backlogged in the message queue middleware. The message queue middleware generates load pressure, and the unstable middleware will crash and lose data. [0003] The traditional solution is generally for software developers to manually start one or more copies of distributed applications, thereby increasing the message consumption rate of the message queue middleware, making the message consumption rate greater than the message production rate, so that as few messages as possible are backlogged in the message In...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L29/08
CPCH04L41/0896H04L67/562H04L67/566
Inventor 王明阳
Owner BEIJING GRIDSUM TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products