Distributed task processing method and device

A technology of distributed tasks and processing methods, applied in the field of distributed task processing, can solve problems such as the limited computing power of computing node groups, and achieve the effect of avoiding restrictions and flexible scale

Inactive Publication Date: 2017-09-12
ALIBABA GRP HLDG LTD
View PDF4 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the embodiments of the present application is to provide a distributed task processing method and device to solve the problem in the prior art that the scale of the computing node group is limited by the computing power of the above-mentioned control nodes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed task processing method and device
  • Distributed task processing method and device
  • Distributed task processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described The embodiments are only some of the embodiments of the present application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0024] figure 1 It is a frame diagram of a task processing device including several computing nodes in the embodiment of this application, such as figure 1 As shown, the task processing system includes one or more computing nodes 101 , one or more task pools 102 , and a network 103 for connecting the computing nodes 101 and the task pool...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a distributed task processing method and device. The distributed task processing method comprises the steps that calculating nodes monitor at least one health index value of the calculating node through a daemon process; the calculating nodes judge whether the calculating node has the permission of taking subtasks from a task pool prestored with a plurality of subtasks or not according to the health index values and preset threshold values corresponding to the health index values; if yes, the calculating nodes take at least one subtasks from the task pool prestored with a plurality of subtasks; the calculating nodes generate task threads corresponding to the taken subtasks and utilize the task threads to execute the subtasks. By utilizing the embodiment, the problem that in an existing distributed task processing technology, the scale of calculating node groups is limited due to the fact that the subtasks are dispatched to a plurality of calculating nodes through connection between control nodes and a plurality of calculating nodes and through the control nodes can be solved.

Description

technical field [0001] The present application relates to the field of computer application technology, in particular to a method and device for distributed task processing. Background technique [0002] In a distributed environment, a distributed task to be processed is usually split into multiple subtasks, and each subtask obtained after splitting is distributed to several computing nodes for processing. [0003] In the prior art, the subtask processing method in a distributed environment is generally implemented by control nodes and computing nodes, which may specifically include the following process: the control node establishes a heartbeat connection with each computing node to obtain the health status of each computing node Status information (for example: number of database connections, CPU usage and memory usage, etc.). The control node distributes the pre-stored subtasks in the task pool to corresponding computing nodes for processing according to the acquired hea...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5027G06F9/5044G06F9/5083G06F2209/5011G06F2209/5013
Inventor 张良锋
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap