Service elastic expansion and contraction method based on emergency detection

An emergency and elastic technology, applied in the field of cloud computing, can solve problems such as inaccurate elastic scaling strategy, error in forecast results, and slow response speed, so as to improve scheduling accuracy, maintain scheduling stability, and reduce operation and maintenance costs Effect

Pending Publication Date: 2022-05-13
SUN YAT SEN UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, this method will not achieve optimal scaling results
[0007] Second, the prior art method does not analyze and process the prediction error of the workload prediction model
However, in practice, if the differential integrated moving average autoregressive model (ARIMA) is used, there must be prediction errors, such as the general predictive scaling method, which will deal with this part of the error
However, this method cannot perform corresponding processing, and the elastic scaling strategy determined on this basis must be inaccurate
[0008] Third, the existing technology does not perform well for workloads with large fluctuations
[0010] However, the scaling of the responsive method is limited by the preset maximum number of scaling instances, which may not be able to catch up with the changing speed of the workload, and the response speed is slow; at the same time, the prediction results of the predictive method based on the time series prediction method may be There will be a large error, and the scaling strategy based on this is unstable

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Service elastic expansion and contraction method based on emergency detection
  • Service elastic expansion and contraction method based on emergency detection
  • Service elastic expansion and contraction method based on emergency detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0061] like figure 1 As shown, a service elastic scaling method based on emergency detection, the method includes the following steps:

[0062] S1: Start with the status of the obtained service as a work cycle;

[0063] S2: Obtain the previous workload data of the service, and input the trained long-term prediction model for multi-step probability prediction to obtain prediction results at multiple future time points. The prediction results include the prediction results at each time point, the possible range of workloads;

[0064] S3: Calculate the multi-step deviation vector according to the prediction results of multiple future time points;

[0065] S4: and update the upper bound value of the confidence interval of the multi-step probability prediction result according to the prediction results of multiple future time points;

[0066] S5: if there are at least two values ​​in the multi-step deviation vector that are both greater than the preset threshold, it is considere...

Embodiment 2

[0084] Based on the service elastic scaling method described in Embodiment 1, this embodiment further provides a service elastic scaling system based on emergency detection, such as figure 2 , image 3 As shown, the system includes a monitoring component C100, a workload prediction component C110, an emergency situation judgment component C120, and an elastic scaling component C130; wherein the workload prediction component C110 includes a long-term probability prediction module C111, a long-term probability prediction module C112, a trend prediction module C113; the elastic scaling component C130 includes a non-emergency scaler C131 and an emergency scaler C132.

[0085] Starting with the state of the service obtained by the monitoring component C100 as the work cycle, at this time, the monitoring component C100 will store the index data representing the current state of the service in the external time series database, wherein the index data includes the average of the serv...

Embodiment 3

[0107] For the prediction model involved in the workload prediction component C110, the machine learning and neural network training methods commonly used in the industry can be used, and details are not described here.

[0108] In the non-burst scaler C131, the near-end policy optimization model in the non-burst scaler C131 is trained using the following reward function to ensure that the method can work properly.

[0109]

[0110]

[0111] r=a×vc+(1-a)×vr

[0112] Among them, vc represents the reward function component related to the CPU, vr represents the reward function component related to the average response time, r is the reward function value calculated according to the current CPU occupancy rate and response time, and a is a hyperparameter used to adjust The weight of CPU and response time is generally 0.5; cpu is the average CPU usage of the service instance, and the value ranges from 0 to 100. res is the average response time of the service instance, in mill...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a service elastic expansion and contraction method based on emergency detection. The method comprises the following steps: taking an obtained service state as a work cycle; obtaining work load data before the service, and inputting the work load data into the long-term prediction model to carry out multi-step probability prediction to obtain prediction results of a plurality of time points in the future; calculating a multi-step deviation vector; updating a confidence interval upper bound value of the multi-step probability prediction result; if at least two values in the multi-step deviation vector are greater than a preset threshold value, determining that the current state is an emergency; otherwise, the emergency situation is not present; generating a trend prediction result; calculating the number of instances required by the service at the moment according to the preset workload upper limit of a single instance; obtaining the workload data of the previous service from the time sequence database, and carrying out single-step prediction to obtain a single-step prediction result; obtaining a future instance number of the service based on a base point offset method; and scheduling is carried out, so that a work cycle is completed.

Description

technical field [0001] The invention relates to the technical field of cloud computing, and more particularly, to a service elastic scaling method based on emergency detection. Background technique [0002] The existing elastic scaling methods of services can be divided into reactive scaling methods and predictive scaling methods: [0003] Among them, responsive scaling methods include threshold method and reinforcement learning-based method. This method will only scale the instance after getting the changes of the current service. Because the workload is changing all the time, the previous scaling may not be accurate enough after completion. In addition, the number of instances that can be scaled at a time is limited by the preset maximum number of instances. When the workload changes more than expected, the number of scaled instances will not keep up. [0004] The predictive method uses a method based on time series prediction to model and analyze the workload, so as to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06F16/33G06N3/04G06N3/08H04L41/5019
CPCG06F9/505G06F9/5027G06F16/3346G06N3/04G06N3/08H04L41/5019
Inventor 余阳吴天扬
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products