Optimization method and device for task scheduling based on metadata

A technology of task scheduling and optimization method, applied in the computer field, can solve problems such as affecting the timeliness of data processing

Active Publication Date: 2018-02-13
XIANGYANG BRANCH CHINA MOBILE GRP HUBEI CO LTD +1
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing technology, the post-post tasks need to rely on the completion of all pr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Optimization method and device for task scheduling based on metadata
  • Optimization method and device for task scheduling based on metadata
  • Optimization method and device for task scheduling based on metadata

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] In order to solve the technical problems existing in the background technology, an embodiment of the present invention provides an optimization method for task scheduling based on metadata, figure 2 It is a schematic diagram of an implementation flow of an optimization method for task scheduling based on metadata in an embodiment of the present invention, as shown in figure 2 As shown, the method includes:

[0027] Step S201, the terminal acquires metadata information;

[0028] Here, the terminals may be devices such as computers, tablet computers, and mobile phones. The metadata information acquired by the terminal may be acquired automatically by the terminal, or the terminal may acquire the metadata information according to the user's input after receiving the user's input. If it is automatically obtained, the step S201 includes: obtaining metadata information from the data warehouse, the metadata information including data warehouse structure information, runnin...

Embodiment 2

[0037] The embodiment of the present invention further provides an optimization method for task scheduling based on metadata, image 3 It is a schematic diagram of the implementation flow of the method for optimizing task scheduling based on metadata in Embodiment 2 of the present invention, as shown in image 3 As shown, the method includes:

[0038] Step S301, the terminal determines a critical path according to the task dependency graph;

[0039] Here, step S301 further includes:

[0040] Step S3011, the terminal calculates the degree of relevance of each task according to the task dependency graph;

[0041] Here, the degree of relevance of a task is the total number of tasks that the task depends on.

[0042] Step S3012, the terminal determines a task node whose degree of association satisfies a second preset condition as a key task node;

[0043] Here, the task node with the highest correlation degree is generally determined as the key task node.

[0044] Step S3013,...

Embodiment 3

[0060] An embodiment of the present invention firstly provides an optimization method for task scheduling based on metadata, and the method includes the following steps:

[0061] Step S401, the terminal collects scheduling information;

[0062] From the existing system, collect the following information related to scheduling (scheduling information): database structure information, running log of the processing process, task name, task start time, task end time, execution script, status and record number , wherein the database structure information includes: table name, field name, field Chinese name, field description, field type and length.

[0063] Step S402, the terminal parses the scheduling information;

[0064] Here, the collected scheduling information is analyzed, and the following metadata information is output: table-level relationship, field-level relationship, constant information analysis, and conditional field analysis. Among them, the table-level relationship ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an optimization method and device for task scheduling based on metadata. The method includes: obtaining metadata information; acquiring a task dependency graph, wherein the task dependency graph is a directed acyclic graph; according to the metadata information and the task dependency graph, determining a task that meets a first preset condition, wherein the first preset condition is that it is only necessary to rely on some of the tasks in the pre-task of the task when running the task; and optimizing the task that meets the first preset condition.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to an optimization method and device for task scheduling based on metadata. Background technique [0002] A data warehouse is a decision-oriented subject-oriented database system that integrates multiple data sources, has current and historical summary data, and focuses on reading. Its purpose is to support decision-making. There are many processes in the data warehouse, including data extraction, conversion, loading, data mart generation, data cube generation process, data warehouse management update, archiving process, and application report generation process. For an enterprise-level data warehouse system, there are tens of thousands of processing programs. How to effectively schedule and manage these tasks is the most important thing in data warehouse management, and it is also the key to improving data warehouse performance and resource utilization. One of the keys to solvin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48
CPCG06F9/4881
Inventor 赵静万纯王全胜
Owner XIANGYANG BRANCH CHINA MOBILE GRP HUBEI CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap