Unlock instant, AI-driven research and patent intelligence for your innovation.

HIVE task based task scheduling method and device

A task scheduling and task technology, applied in the computer field, can solve the problems of cumbersome task scheduling process and low scheduling task efficiency, and achieve the effect of high efficiency and simple scheduling process

Active Publication Date: 2015-04-22
GUANGZHOU HUADUO NETWORK TECH
View PDF5 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When there are many tasks, it is necessary to manually control each task, and the task scheduling process is cumbersome
Therefore, the efficiency of scheduling tasks is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • HIVE task based task scheduling method and device
  • HIVE task based task scheduling method and device
  • HIVE task based task scheduling method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0043] Because related technologies need to determine the next task that needs to be scheduled according to the scheduling result of the last scheduled task before each scheduling task, the task can be scheduled. When there are many tasks, the task scheduling process is cumbersome by manually scheduling and controlling each task. Therefore, the efficiency of scheduling tasks is low.

[0044] In order to prevent the above situation, improve the efficiency when scheduling tasks. The embodiment of the present invention provides a HIVE task-based task scheduling method, see figure 1 , the method flow provided by this embodiment includes:

[0045] 101: Determine multiple tasks that need to be scheduled, and determine dependencies between...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a HIVE task based task scheduling method and device and belongs to the technical field of computers. The method comprises the steps that multiple tasks needing scheduling and the dependency between the multiple tasks are determined; a front dependent task and a rear dependent task of each task are determined according to the dependency; tasks currently needing scheduling are selected from all the task needing scheduling, and the selected tasks are obtained; the selected tasks are scheduled according to the scheduling results of the front dependent tasks of the selected tasks; the rear dependent tasks of the selected tasks and all tasks not scheduled are processed in the modes of selecting the selected tasks and scheduling the selected tasks until all the tasks needing scheduling are scheduled. The scheduling results of the front dependent tasks of the selected tasks are determined according to the dependency between the tasks to schedule the selected tasks, so that the task scheduling process is simple, and it can be ensured that the tasks can be executed orderly. The task scheduling efficiency is high.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a HIVE task-based task scheduling method and device. Background technique [0002] With the rapid development of computer technology, in order to execute tasks, the server needs to schedule tasks at different times, especially in the field of scheduling based on HIVE tasks. Among them, HIVE is a data warehouse tool based on Hadoop, and Hadoop is a software architecture capable of distributed processing of large amounts of data. Therefore, HIVE tasks can map structured data files into a database table and provide complete SQL (Structured Query Language, Structured Query Language) query function can convert SQL statements into Map (mapping) and Reduce (simplification) tasks for operation. The scheduling of tasks by the server affects the execution efficiency of subsequent tasks. Therefore, how to schedule tasks based on HIVE tasks is the key to improving the efficiency of task ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/46G06F9/48
Inventor 陈武邱百超
Owner GUANGZHOU HUADUO NETWORK TECH