Heterogeneous cluster-orientated task processing method and device

一种异构集群、任务处理的技术，应用在电数字数据处理、软件部署、程序控制设计等方向，能够解决维护成本大、不便软件快速迭代、开发成本大等问题，达到快速开发、降低开发维护成本的效果

Active Publication Date: 2018-02-09
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF6 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1. The development cost is huge: In order to write hardware device programs, project developers need to learn certain hardware knowledge, which is not convenient for rapid iteration of software
[0006] 2. Huge maintenance cost: Since there is a version of the code for each hardware platform, it is necessary to maintain multiple codes with unified functions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous cluster-orientated task processing method and device
  • Heterogeneous cluster-orientated task processing method and device
  • Heterogeneous cluster-orientated task processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0042] In order to facilitate the understanding of the present invention, the system architecture involved in the present invention is firstly described. Such as figure 1 As shown in , the system provided by the present invention mainly includes: a client device, a heterogeneous cluster scheduling server, and a heterogeneous cluster. In the embodiment of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a heterogeneous cluster-orientated task processing method and device. The method comprises the following steps that: receiving a task request and a basic execution environment;according to the task request, dispatching heterogeneous equipment; compiling the basis execution environment into an execution environment corresponding to the dispatched heterogeneous equipment, and deploying to the dispatched heterogeneous equipment; and enabling the dispatched heterogeneous equipment to execute the task request. By use of the method, a user only needs to provide the basic execution environment by aiming at a task, the user does not need to independently compile one version of execution environment by aiming at each type of hardware platform, the quick development of the code of the heterogeneous equipment is realized, and development and maintenance cost is lowered.

Description

【Technical field】 [0001] The invention relates to computer application technology, in particular to a heterogeneous cluster-oriented task processing method and device. 【Background technique】 [0002] With the development of big data and deep learning technology, the method of training and learning massive data through deep learning methods, and finally learning a set of accurate deep models has been paid more and more attention by various technology companies. A more complex and powerful in-depth model can deeply reveal the complex and rich information carried in massive data, and make more accurate predictions for future or unknown events. Deep learning applications include speech recognition, image recognition, natural language processing, search advertising CTR estimation, etc. Since deep learning applications usually rely on huge computing and communication, using a heterogeneous cluster of CPU+ heterogeneous accelerators (GPU, FPGA, etc.) for training and online has be...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/60
CPCG06F8/60G06F9/4881G06F9/5027G06F9/5072G06F8/41
Inventor 温圣召周汉清刘传秀张家军
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap