Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

YARN based resource management method, device and system

A technology of resource management and resource manager, applied in resource allocation, multi-program device, electrical digital data processing, etc., can solve problems affecting the scheduling efficiency of resource scheduler

Active Publication Date: 2016-04-20
XFUSION DIGITAL TECH CO LTD
View PDF4 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the cluster resource representation dimension is too high will also affect the scheduling efficiency of the resource scheduler

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • YARN based resource management method, device and system
  • YARN based resource management method, device and system
  • YARN based resource management method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0069] The terms "first" and the like in the specification, claims, and above-mentioned drawings of the present invention are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a YARN based resource management method, device and system; a work message carries an application program and application program configuration written through an expansion calculating framework, wherein the application program configuration comprises an application program label and each subtask needed resource container description, the resource container description comprises resource types and resource quantity, and in the resource container description of the subtask need speeding up, the resource types comprise a FPGA resource type; the method comprises the following steps: distributing calculating resource for AM according to all NM idle resource container description and resource labels in a cluster, and using resource labels to mark FPGA needed by each subtask for speeding in the application program; the expanded cluster resource represents that a model is only related to calculating framework types supported by the cluster; when the FPGA is added into the YARN, the method and system can solve the YARN resource dimension dynamic expansion problems caused by calculating resource specificity, thus enhancing YARN resource management flexibility.

Description

technical field [0001] Embodiments of the present invention relate to communication technologies, and in particular to a resource management method, device and system based on YARN. Background technique [0002] A Field Programmable Gate Array (Field Programmable Gate Array, referred to as: FPGA) is a highly parallel, low power consumption, programmable hardware device, and its hardware computing performance is better than that of a general-purpose central processing unit (Central Processing Unit, referred to as: CPU). Using CPU and FPGA to build heterogeneous multi-core systems, using CPU to provide general-purpose computing capabilities, and using FPGA chips as dedicated hardware accelerators have become an important development trend in the field of high-performance computing. [0003] Another resource coordinator (YetAnotherResourceNegotiator, referred to as: YARN), as Hadoop 2.0 native resource scheduling system, can manage and allocate resources for various computing f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F15/02G06F9/50
CPCG06F9/5016G06F9/5038G06F9/5066G06F15/17356
Inventor 李瑞轩辜希武吴文哲
Owner XFUSION DIGITAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com