Supercharge Your Innovation With Domain-Expert AI Agents!

Control method, device, computer equipment and storage medium for optimizing job scheduling

A technology for optimizing operations and control methods, applied in computing, structured data retrieval, data processing applications, etc., can solve problems such as reducing the efficiency of workflow operation, and achieve the effect of reducing the amount of data processing and improving operation efficiency

Active Publication Date: 2020-12-01
望海康信(北京)科技股份公司
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the system pulls data in the form of incremental data import. When no new data is imported, the data source provided by this job to the downstream job will not change at this time, but the system will still run all levels in the workflow. job, reducing the efficiency of the workflow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Control method, device, computer equipment and storage medium for optimizing job scheduling
  • Control method, device, computer equipment and storage medium for optimizing job scheduling
  • Control method, device, computer equipment and storage medium for optimizing job scheduling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0065] For details, please refer to figure 1 , figure 1 A schematic flowchart of a control method for optimizing job scheduling in this embodiment.

[0066] Such as figure 1 As shown, a control method for optimizing job scheduling includes the following steps:

[0067] S1100. Obtain a preset workflow job status table, wherein the job status table includes job status information of at least one job and target data information of the job;

[0068] In the big data platform, the job scheduling system plays the core role of job configuration, management and scheduling. In the job scheduling system, the workflow is the smallest scheduling unit. In a workflow, there are multiple jobs, and there are Dependency, a job is only eligible to run when all the jobs it depends on are completed. The job status table is a list used to store the skippable job information in the workflow. During implementation, some jobs can be skipped without affecting the final result. Jobs that pull data ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a control method and device for optimizing operation scheduling, computer equipment and a storage medium, and the method comprises the following steps: obtaining a preset workflow operation state table which comprises the operation state information of at least one operation and the target data information of the operation; setting an execution state of the operation according to the operation state information of the operation; and when the execution state of the operation is a skippable state, skipping the operation, and transmitting the target datacorresponding to the target data information to the next operation. According to the embodiment of the invention, the execution state of the operation is set as the skippable state; when the system executes operation scheduling, the execution of the operation is directly skipped, and the target data of the operation is transmitted to the next operation, so that the operations which do not need tobe operated in the workflow are skipped, the data processing amount when the workflow is executed can be effectively reduced, and the operation efficiency of the workflow is improved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of job scheduling systems, in particular, a control method, device, computer equipment, and storage medium for optimizing job scheduling. Background technique [0002] With the development of science and technology, data processing has provided more convenience to people's life and work. Many companies are building their own big data platforms, in which the job scheduling system plays the core role of job configuration, management and scheduling. In the job scheduling system, the workflow is the smallest scheduling unit. In a workflow, there are multiple jobs, and there are dependencies between jobs. The output data of a job will be used as the data source of the next job. A job is only eligible to run when the upstream jobs it depends on complete. [0003] The operation of the workflow needs to pull data from the external system, that is to say, there are jobs that pull data from the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06Q10/06
CPCG06Q10/06312
Inventor 王世星龙乐乐于奇贾宏超姚亚峰安天元盖守文
Owner 望海康信(北京)科技股份公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More