Online Optimal Scheduling Method for Workflow Groups with Deadline Constraints in Hybrid Cloud Environment

Abstract

The invention relates to an online optimized scheduling method for workflow groups with deadline constraint in a mixed cloud environment. The method comprises the steps of: preferentially processing a workflow smallest and longest load capacity according to space-time correlations of workflows arriving in real time and a limit characteristic of the private cloud processing capability, increasing the workflow completion rate, and reducing the data transmission cost; based on characteristics of the workflows, dividing tolerance time for the deadlines in an equal-weighted manner according to subtask weights so as to meeting the requirements of deadline constraint and service quality; utilizing a greedy choice strategy to searching for a suitable example lowest in subtask execution cost increment on line, and further reducing the execution cost; and according to the characteristics of the mixed cloud environment, designing an integral mapping scheme from the workflows to the execution examples, and ensuring that the service quality of the workflows are met on line and the execution cost is simultaneously lowered. On the premise that the requirements of the deadline constraint of existing practical workflow groups are met, the online optimized scheduling method is capable of effectively improving the completion rate of the workflow groups, and the execution cost is substantially lowered.

Description

technical field [0001] The invention relates to the field of online optimal scheduling of workflow groups for parallel and distributed high-performance computing, in particular to an online optimal scheduling method for workflow groups with deadline constraints in a hybrid cloud environment. Background technique [0002] The cloud computing network, which effectively integrates resources such as computing and storage through virtualization technology and provides users with pay-as-you-go, is the most promising and effective means to achieve efficient resource utilization in the IT industry. Cloud computing technology has become a hot topic of research in recent years. Many information technology companies, such as IBM, Amazon, Google, Microsoft, etc., have successively proposed the basic framework of their own cloud computing systems and provided corresponding cloud services. Enterprises often have private cloud centers with certain computing and storage capabilities to hand...

AI Technical Summary

Problems solved by technology

However, many research works only consider the cost-optimized scheduling of workflows with constraints in a single cloud environment, or analyze the completion rate of workflow groups based on cost-driven in an offline environment; Execution cost impact; or pursue cost optimization in a hybrid cloud environment, while ignoring other constraints, such as deadlines; or ignore the complex dependencies between tasks and only consider the batch task scheduling problem in a hybrid cloud environment; or reduce workflow In the cost process, the basic nature of cloud environment pay-as-you-go and range-based pricing is not considered

Therefore, in a hybrid cloud environment, the online optimization scheduling problem of large-scale workflow groups with deadline constraints based on execution cost-driven completion rate improvement has not been properly resolved.

Images