Task scheduling method and device

A task scheduling and task configuration technology, applied in the field of data processing, can solve problems such as complex task scheduling delays, and achieve the effects of reducing idle waiting time for tasks, reducing complexity, and improving system efficiency

Inactive Publication Date: 2015-06-17
CHINA MOBILE GROUP SICHUAN
View PDF5 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] In order to solve the technical problem of complex task scheduling and delay in the big data system, the present invention proposes a task scheduling method and device

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method and device
  • Task scheduling method and device
  • Task scheduling method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The present invention adopts the idea of ​​task scheduling based on data state. Data status, that is, the existence status of data (ready or not), regards tasks as data processing units, and only pays attention to the data that tasks depend on and output data, and does not pay attention to the status of tasks and the relationship between tasks. The only basis for judging whether to start a task is whether the data that the task depends on is ready. The present invention will be described in detail below in conjunction with the accompanying drawings.

[0027] Such as figure 1 As shown, the present invention provides an embodiment of a task scheduling method, including the following steps:

[0028] Step 101, parsing task configuration items from the task configuration file of the first task;

[0029] Step 102, query the dependency condition of the first task completion according to the task configuration item;

[0030] Step 103, scheduling the first task according to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a task scheduling method and device. The method includes the steps of analyzing task configuration files of a first task to obtain task configuration items, inquiring dependent conditions for completing the first task according to the task configuration items, and scheduling the first task according to the dependent conditions for completing the first task.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a task scheduling method and device. Background technique [0002] With the continuous development of information technology, the amount of information is growing explosively. How to quickly mine valuable information from massive data has become increasingly important. The big data system is just such a data processing and service platform. The service platform usually undertakes hundreds of thousands or even more tasks. The data processing process usually involves complex processes. A complete data processing task usually includes multiple subtasks. How to effectively manage and control these tasks so that they Coordinated work is one of the important factors that affect whether a big data system can realize its value. [0003] Key features of big data systems include: [0004] (1) The amount of data is huge: the system usually has several TB or even PB of data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48
Inventor 简勤刘耕朱泓赖航曾东张聪李明夏峻峰李小东李先富王姝
Owner CHINA MOBILE GROUP SICHUAN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products