Online identification method and system for high-frequency consecutive failure tasks in cloud computing system

Abstract

The invention discloses an online identification method and system for high-frequency consecutive failure tasks in a cloud computing system. Off-line analysis and study are performed on the basis of time series according to off-line monitoring data, so that the failure frequency threshold capable of representing all the failure frequency characteristics of the non-high frequency consecutive failure tasks at a certain confidence level is obtained; then, identification is carried out, so that high frequency consecutive failure tasks in the online data are obtained. According to the invention, the tasks in the cloud computing system are analyzed from the perspective of events and resources, so that the occurring frequency of a failure event and system resources consumed by the tasks in a time period are obtained; through the analysis of the failure frequency characteristics of the tasks and the resource use time series model, the high frequency consecutive failure tasks which fail repeatedly and are hard to repair in the cloud computing system are identified in real time, and the cloud computing system is informed of adopting a proactive failure recovery measure in advance, so that system resources are saved, and the reliability and availability of the cloud computing system are improved.

Description

technical field [0001] The invention belongs to the technical field of cloud computing, and in particular relates to an online identification method and system for high-frequency continuous failure tasks in a cloud computing system. Background technique [0002] With its on-demand consumption model, cloud computing is gradually widely used in various fields such as finance and business. The high availability of the system in the cloud computing environment is increasingly becoming the key to the maturity of cloud computing technology. However, due to the gradual expansion of the scale and heterogeneity of the cloud computing system, various types of failures frequently occur in the cloud computing system, which has become one of the key factors that threaten the availability and reliability of the cloud computing system. In a cloud computing system, a task, as the smallest scheduling unit running on a single node, is the basic guarantee for the normal execution of user appli...

AI Technical Summary

Problems solved by technology

However, the existing technology does not have an effective method for identifying high-frequency continuous failure tasks

Although high-frequency continuous failure tasks will be rescheduled by the system immediately after each failure, they cannot be quickly recovered by restarting, but will fail repeatedly after repeated scheduling.

Repeated failures not only cause a lot of waste of system resources, but also increase the load of the cluster scheduler, bringing potential harm to the cloud computing system, making it difficult to meet the high availability requirements of the cloud computing system

Images