Dynamic adjustment method for node task slot based on node state feedbacks

A technology of dynamic adjustment and node status, applied in the direction of multi-programming devices, etc., can solve the problems that cannot truly reflect the processing capabilities of sub-nodes, fierce competition for node resources, and waste of resources

Active Publication Date: 2013-09-11
中科育成(北京)科技服务有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage is that the maximum number of task slots (hereinafter referred to as MTS: Maximum Task Slot) of a child node cannot be changed when the distributed computing cluster processes jobs, and its configuration cannot truly reflect the processing capacity of the child node.
If the MTS setting is large, the number of tasks executed in parallel on the child nodes is relatively large, which will inevitably cause fierce competition for node resources, and the tasks cannot be guaranteed at an optimal execution progress; if the MTS setting is small, it may cause child node resources to be insufficient fully utilized, resulting in waste of resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic adjustment method for node task slot based on node state feedbacks
  • Dynamic adjustment method for node task slot based on node state feedbacks
  • Dynamic adjustment method for node task slot based on node state feedbacks

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to express the object, technical solution and advantages of the present invention more clearly, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0038] First, the variables are defined as follows:

[0039] Divide the value range [0, 1] of the child node load value workload into three intervals: light load area, suitable load area and heavy load area, such as figure 1 shown. In the figure, LL (lower limit) represents the lower limit of suitable load, and UL (upper limit) represents the upper limit of suitable load. Since the node load is not known when the cluster is initialized, LL=33% and UL=66% are initially set, that is, the range of load values ​​is divided equally. Then dynamically adjust LL and UL during the running of the job. But the adjusted LL and UL must have a certain range. We limited LL to [20%, 33%] and UL to [65%, 90%].

[0040] The throughput rate ntr ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a dynamic adjustment method for a node task slot based on node state feedbacks. According to the dynamic adjustment method provided by the invention, related information including real-time load condition and the like of a subnode is collected and analyzed firstly; an MTS (Microsoft Transaction Server) of the subnode is adjusted according to analyzed results; and therefore resources of the subnode can be utilized sufficiently and reasonably. The dynamic adjustment method for the node task slot based on the node state feedbacks comprises seven steps, and has the advantages and effects that: the MTS of the subnode can be adjusted based on the real-time load condition of the subnode in proper time, so that cluster node resources can be utilized more effectively, and excess competition of a plurality of tasks on a node on the node resources is avoided.

Description

technical field [0001] The invention relates to a method for dynamically adjusting task slots of computing nodes in a cluster, in particular to a method for dynamically adjusting task slots of nodes based on node state feedback, and belongs to the technical field of computers. Background technique [0002] A computer program running on a distributed computing cluster is called a distributed computing program, and a running distributed computing program is called a distributed computing job. Usually, a distributed computing job can be divided into several subtasks. In the distributed computing framework of the master-slave architecture, the master node is responsible for receiving and initializing jobs and generating several subtasks, and each subtask is processed by the subnodes. [0003] A child node can execute multiple subtasks of a job at the same time. The number of subtasks that a child node can execute at the same time is called the size of the task slot of the node....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/46
Inventor 阮利肖利民庞瑜毛宏
Owner 中科育成(北京)科技服务有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products