Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and device for realizing ETL scheduling

A technology for realizing methods and tasks, which is applied in the computer field, can solve problems such as scheduling tasks not being completed on time and meeting business needs, and achieve the effects of improving usability, reducing construction investment, and maximizing production capacity

Active Publication Date: 2019-05-28
HANDAN BRANCH OF CHINA MOBILE GRP HEBEI COMPANYLIMITED
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

As a result, although the resources of the application server have been fully utilized, the scheduling task has not been completed according to the specified time point, which cannot meet the business needs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for realizing ETL scheduling
  • A method and device for realizing ETL scheduling
  • A method and device for realizing ETL scheduling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

[0056] The embodiment of the present invention provides an implementation method of ETL scheduling. figure 1 It is a schematic flow diagram of the implementation method of ETL scheduling in the embodiment of the present invention; as figure 1 As shown, the method includes:

[0057] Step 101: Establish a dependency relationship of tasks to be executed, and obtain a first parameter of the task to be executed based on the dependency relationship; the first parameter is used to represent a calculation amount of a total subsequent task of the task to be executed.

[0058] In this embodiment, a dependency relationship model is established first, and the dependency relationship model is a dependency relationship model among all tasks to be executed. There are intricate dependencies among tasks. A schedule can be dependent on multiple tasks...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention embodiment discloses an ETL scheduling realization method and device; the method comprises the following steps; building a dependence relation of a to-be-executed task, and obtaining a first parameter of the to-be-executed task according to the dependence relation, wherein the first parameter is used for representing a calculated quantity of the subsequent total task of the to-be-executed task; obtaining a second parameter of the to-be-executed task, wherein the second parameter is used for representing the emergency level of the to-be-executed task; generating a third parameter according to the first and second parameters through a first preset rule; executing the task corresponding to the biggest third parameter if a first preset condition is satisfied and the third parameter is the biggest.

Description

technical field [0001] The invention relates to computer technology, in particular to a method and device for realizing ETL scheduling. Background technique [0002] With the advent of the era of big data, data analysis has received extensive attention. As the basic work of data analysis, data extraction, transformation and loading (ETL, Extract-Transform-Load) is also becoming more and more heavy. Especially when the data sources are extensive, the data formats are different, and the data content varies greatly, whether the organization of ETL is reasonable or not affects the timeliness of data analysis to a certain extent. [0003] The problem with the existing technology is that it ignores the limitation of system computing resources and does not mention the distribution of scheduling tasks in the time dimension, especially when the number of tasks is huge, how to select and start an optimal task from multiple tasks at a certain moment In related technologies, there is ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/25G06F9/48
Inventor 李秀清赵景科侯晓冲高梦娇
Owner HANDAN BRANCH OF CHINA MOBILE GRP HEBEI COMPANYLIMITED