Cluster task processing method and device, electronic equipment and storage medium

A task processing and clustering technology, which is applied in the field of electronic equipment, storage media, devices, and cluster task processing methods, can solve problems such as low task distribution efficiency, reduce network connection hops, improve return efficiency, and improve execution efficiency. Effect

Active Publication Date: 2020-11-03
DAWNING INFORMATION IND BEIJING
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiment of the present application is to provide a cluster task processing method, device, electronic equipment and storage medium to solve the problem of low task distribution efficiency in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cluster task processing method and device, electronic equipment and storage medium
  • Cluster task processing method and device, electronic equipment and storage medium
  • Cluster task processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

[0028] In order to solve the problem of low task distribution efficiency in the prior art, the embodiment of the present application provides a cluster task processing method, which selects the corresponding task distribution structure according to the size of the task overhead to be executed, for example: for tasks with small task overhead, Then you can choose the default task distribution structure of the cluster, and for tasks with high task overhead, you can choose the configured task distribution structure. Wherein, the task distribution structure refers to a collection of paths that a cluster task passes from the master node to each node in the cluster, and is a logical structure. The efficiency of task distribution is improved through the above method. For specific methods, see figure 1 ,in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a cluster task processing method and device, electronic equipment and a storage medium. The method comprises the steps that a login node in a cluster receives task information,wherein the task information comprises task parameters and task distribution structure parameters; the login node determines and selects a corresponding target task distribution structure according tothe task distribution structure parameters, wherein the target task distribution structure is pre-configured; and the login node distributes the task information to computing nodes in a cluster by using the target task distribution structure, so the computing nodes execute corresponding tasks according to the task parameters. According to the embodiment of the invention, the plurality of task distribution structures are configured in advance, and different task distribution structures are selected according to the tasks with different overhead, so the tasks can be distributed to each computing node as soon as possible, and the task distribution efficiency is improved.

Description

technical field [0001] The present application relates to the technical field of computer clusters, and in particular, to a cluster task processing method, device, electronic equipment, and storage medium. Background technique [0002] With the development of society and the advancement of technology, human beings have higher and higher demands on computing power. In recent years, large supercomputing clusters have emerged in an endless stream. While the computing power is increasing day by day, the number of cluster nodes is also increasing, and clusters with thousands or even tens of thousands of nodes are no longer rare. Such a large-scale cluster brings great challenges to cluster operations such as debugging, management, and maintenance, such as installing operating systems in batches, checking node status, distributing files, and so on. If ordinary operations on a single node or a small-scale cluster are performed serially on a large-scale cluster, the execution time...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L29/06
CPCH04L67/10H04L63/08Y02D10/00
Inventor 张驭洲
Owner DAWNING INFORMATION IND BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap