Load-monitoring-based hybrid scheduling method under Hadoop cloud platform

A technology of load monitoring and hybrid scheduling, applied in resource allocation, multi-programming devices, etc., can solve the problems of resource occupation, failure to execute, and long average job completion time, so as to improve fairness, reduce scheduling consumption, and The effect of reducing the average completion time
CN103455375AActive Publication Date: 2013-12-18金数信息科技(苏州)有限公司
4 Cites 10 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
金数信息科技(苏州)有限公司
Publication Date
2013-12-18

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a load-monitoring-based hybrid scheduling method under a Hadoop cloud platform. A load-monitoring-based hybrid scheduling scheme is provided by analyzing scheduling effects and respective application scenarios of a Max-D algorithm, an FIFO algorithm and a fair scheduling algorithm. The one the most proper for the current load condition is selected from the three algorithms by monitoring a system load in real time. Compared with the single application of one scheduling algorithm, the scheme has significant advantages and is adaptive to changes in the load in a Hadoop system, so that the system can retain good performance.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to a cloud platform job scheduling method, in particular to a load monitoring-based hybrid job scheduling method under a Hadoop cloud platform. technical background

[0002] Wireless sensory network technology is a technology that has gradually emerged in recent years. It integrates sensor technology, embedded computing technology, distributed information processing technology and communication technology, and is a new information acquisition and processing technology. It is different from traditional networks in terms of theoretical design, application realization, and development direction, so the theoretical basis and system design of sensor networks are very different from traditional network systems. Hadoop is a distributed system with high reliability and good scalability. It can run applications on clusters composed of a large number of cheap hardware devices, and provides a set of stable and reliable interfaces for applica...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More