Operation process scheduling method based on modeling platform model

A scheduling method and platform technology, applied in the field of modeling platforms, can solve problems such as being complex and unable to meet the business needs of complex scheduling scenarios, and achieve the effects of reducing coupling, solving single-machine performance bottlenecks, and improving performance

Pending Publication Date: 2020-02-21
BEIJING GEO POLYMERIZATION TECH
View PDF6 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the development of business, the number of supported algorithms is increasing, the entire machine learning task process is becoming more and more complex, and the complexity of dependencies between tasks is increasing. The previous scheduling method can no longer meet the business needs of complex scheduling scenarios.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Operation process scheduling method based on modeling platform model
  • Operation process scheduling method based on modeling platform model
  • Operation process scheduling method based on modeling platform model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0028] Such as figure 1 and figure 2 As shown, the method for scheduling operation processes based on the modeling platform model in the embodiment of the present invention includes the following steps:

[0029] Step S1, receiving the json file used to define the DAG sent by the machine learning platform, and transmitting the json file to the DAG scheduling platform.

[0030] Specifically, pack the machine learning process into a DAG, define the input and output parameters of each operator, and the configuration parameters of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an operation process scheduling method based on modeling platform model, which comprises the steps: S1, receiving a json file which is sent by a machine learning platform and isused for defining a DAG, and transmitting the json file to a DAG scheduling platform; S2, analyzing the json file by a DAG scheduling platform, converting the json file into structured data, and storing the structured data into a Mysql database; and S3, calling the json file by the DAG scheduling platform, starting scheduling dag to define each operator task, and executing an environment corresponding to an operator task distribution channel according to the operator type of each operator task. According to the invention, the coupling of service codes and scheduling codes can be reduced. Distributed task scheduling is supported, and the performance bottleneck of a single machine under complex scheduling is solved. The DAG can reflect the dependence and time sequence relationship among thetasks, so that the tasks are accurately endowed with priorities in the task selection stage, and the scheduling performance is effectively improved.

Description

technical field [0001] The invention relates to the technical field of modeling platforms, in particular to a method for scheduling operation processes based on modeling platform models. Background technique [0002] With the development of business, the number of supported algorithms is increasing, the entire machine learning task process is becoming more and more complex, and the complexity of dependencies between tasks is increasing. The previous scheduling method can no longer meet the business needs of complex scheduling scenarios. Contents of the invention [0003] The aim of the present invention is to solve at least one of said technical drawbacks. [0004] Therefore, the object of the present invention is to propose a method for scheduling operation processes based on a modeling platform model. [0005] In order to achieve the above object, an embodiment of the present invention provides a method for scheduling a running process based on a modeling platform model...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48
CPCG06F9/4881
Inventor 崔晶晶贾俊芳
Owner BEIJING GEO POLYMERIZATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap