Task scheduling method and related device

A task scheduling and task technology, applied in the computer field, can solve Oozie's problems such as high work pressure, low task scheduling efficiency, and complicated configuration process, and achieve the effect of reducing pressure, simplifying the process of creating tasks, and simple process

Pending Publication Date: 2020-03-17
PING AN TECH (SHENZHEN) CO LTD
View PDF0 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the workflow in Oozie needs to use xml files to define the execution sequence, which is too complicated. When users need to create multiple associated tasks, they need to write the execution sequence of the tasks into the xml file, and then use Oozie to submit the task. Oozie This task flow will be scheduled. In this way, in the case of big data, a large number of xml file configurations are required when creating a task. The configuration process is complicated, and since all configuration work is performed in Oozie, Oozie's work pressure is high, and task scheduling is difficult. low efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method and related device
  • Task scheduling method and related device
  • Task scheduling method and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The task scheduling method and related devices provided in the embodiments of the present application are beneficial to simplify the process of establishing tasks and improve the efficiency of task scheduling.

[0027] In order to enable those skilled in the art to better understand the solutions of the application, the technical solutions in the embodiments of the application will be clearly and completely described below in conjunction with the drawings in the embodiments of the application. Obviously, the described embodiments are only It is a part of the embodiments of this application, not all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work should fall within the protection scope of this application.

[0028] The terms "first", "second", "third", "fourth", etc. in the specification and claims of this application and the above-mentioned drawings are used to distingui...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a task scheduling method and a related device. The method is applied to a task scheduling system, the task scheduling system comprises a task scheduling platform and a task distribution assembly, and the method comprises the following steps: obtaining a task flow submitted by a user; splitting the task flow through the task scheduling platform to obtain a plurality of tasks,determining submission triggering conditions of the plurality of tasks, and generating a submitted task queue according to the submission triggering conditions of the plurality of tasks; submitting the tasks in the submitted task queue to the task distribution component; and distributing the tasks in the submitted task queue to a target distributed cluster through the task distribution componentto obtain a task running result. According to the technical scheme of the embodiment of the invention, the task establishment process is simplified, and the task scheduling efficiency is improved.

Description

Technical field [0001] This application relates to the field of computer technology, and in particular to a task scheduling method and related devices. Background technique [0002] Oozie is an open source framework based on a workflow engine, closely integrated with the Hadoop ecosystem, and can provide task scheduling and coordination for Hadoop MapReduce and Pig Job. [0003] However, the workflow in Oozie needs to use xml files to define the execution order. The definition is too complicated. When users need to establish multiple associated tasks, they need to write the execution order of the tasks into the xml file, and then use Oozie to submit this task, Oozie This task flow will be scheduled. In this way, in the case of big data, a large number of xml file configurations are required when creating tasks. The configuration process is complicated. And since all configuration work is performed in Oozie, Oozie’s work pressure is relatively high and task scheduling is low effici...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50G06F9/52
CPCG06F9/4881G06F9/5027G06F9/52
Inventor 梁竞雅张观成万书武李均
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap