Resource management system for distributed programming framework

A resource management system, distributed technology, applied in the direction of resource allocation, multi-programming device, etc., can solve the problems of poor compatibility, low resource utilization, low programming framework efficiency, etc., to achieve good compatibility and flexibility, guarantee performance effect

Active Publication Date: 2016-02-24
INST OF INFORMATION ENG CHINESE ACAD OF SCI
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] To sum up, the current cluster resource management system has the following problems: it is difficult to support the data processing programming framework, and the compatibility is poor; the resource utilization rate in the multi-programming framework coexistence cluster is not high, and data sharing is difficult; resource competition leads to the efficiency of the coexisting programming framework not tall

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource management system for distributed programming framework
  • Resource management system for distributed programming framework
  • Resource management system for distributed programming framework

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The principles and features of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0041] The machines mentioned in this article refer to the computers in the cluster.

[0042] figure 1 It is an overall architecture diagram of the distributed programming framework-oriented resource management system of the present invention. The resource management system oriented to the distributed programming framework of the present invention is a master-slave management framework. Such as figure 1 As shown, the distributed programming framework-oriented resource management system of the present invention includes a master part (master) and a slave part (slave). Among them, the slave part is used to start the programming framework executor, monitor the running status of the programming framework executor, re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a resource management system for a distributed programming framework. The resource management system for the distributed programming framework comprises a master portion and a slave portion, wherein the slave portion is used for starting a programming framework actuator, monitoring the running state of the programming framework actuator and reporting resource use information of the slave portion and resource use information of the programming framework actuator on the slave portion to the master portion. The master portion comprises a collector and a scheduler, wherein the collector is used for receiving and storing the resource use information of the slave portion and the resource use information of the programming framework actuator on the slave portion and storing cluster resource information and comprises a monitor for monitoring the resource use information of the programming framework actuator on the slave portion and transmitting the task of increasing or decreasing resources for the programming framework to the scheduler according to a resource adjustment decision trigger customized by the programming framework, and the scheduler is used for scheduling, issuing and controlling the task transmitted by the monitor. The resource management system is fine in compatibility and flexibility.

Description

technical field [0001] The invention relates to the computer field, in particular to a resource management system oriented to a distributed programming framework. Background technique [0002] Parallel computing depends on large-scale clusters. The popularity of parallel computing has promoted the development of cluster management systems. Cluster management systems for parallel computing have begun to appear, such as LSF (Load Sharing Facility, load sharing facilities) systems, PBS (ProtableBatchSystem, portable batch processing operating system) system, etc. These systems are oriented to parallel computing, process traditional batch jobs, manage cluster resources, and are widely used in industrial production and scientific research environments. With the rise of distributed computing, various new parallel programming frameworks continue to emerge. Due to its own system design and structure, the traditional cluster management system cannot well support new programming fram...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
Inventor 张章陈竞韩冀中戴娇孟丹
Owner INST OF INFORMATION ENG CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap