Neural network transfer learning automatic training scheduling method based on ONNX model

A neural network and migration learning technology, applied in the field of automatic training scheduling of neural network migration learning based on the ONNX model, can solve the problem that the model cannot fit the data distribution well, the algorithm and model migration are time-consuming and labor-intensive, and the generalization performance of the model is to be expected Improve and other issues to achieve better generalization performance, easy to expand, and easy to expand

Active Publication Date: 2020-08-14
浙江浙能天然气运行有限公司 +2
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Multiple learning frameworks lead to time-consuming and laborious migration of algorithms and models between different frameworks
[0003] In addition, through the deep learning framework, the model obtained in the training environment often does not work well in the production environment
Due to the conditions of the production environment or other factors, the model obtained in the training environment cannot fit the distribution of the data well, resulting in a decline in the performance of the model
Especially for data that did not appear during training, it may lead to changes in data distribution
Model generalization performance needs to be improved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network transfer learning automatic training scheduling method based on ONNX model
  • Neural network transfer learning automatic training scheduling method based on ONNX model
  • Neural network transfer learning automatic training scheduling method based on ONNX model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] Such as figure 1 As shown, the neural network migration learning automatic training scheduling method based on the ONNX model of the present embodiment includes the following steps:

[0039] S1. Establish a PI database for the collection and storage of process data in the production environment;

[0040] Specifically, the PI database is established for automatic collection, storage and monitoring of process data, which can store years of historical data of each process point online. It is a large-scale real-time database and historical database. At the data center end, by using deep learning Technology, according to different business requirements, mine and analyze PI data, and establish a deep learning model.

[0041] S2. Use different deep learning model training platforms for model training on process data according to different task requirements, and export the obtained models as ONNX models to form ONNX model libraries;

[0042] The data center side extracts data...

Embodiment 2

[0075] The difference between the ONNX model-based neural network migration learning automatic training scheduling method of this embodiment and embodiment 1 is:

[0076] The above step S2 also includes:

[0077] Package all the models in the ONNX model library and their corresponding model dependent environments to form mirror files corresponding to the models one by one, and publish them to the container warehouse;

[0078] Correspondingly, the above step S4 includes: the edge device pulls the image file corresponding to the corresponding target model, starts the container to provide services, and completes the deployment of the target model.

[0079] In addition, the above step S2 also includes:

[0080] Train the new process data to obtain a new target model;

[0081] Package the new target model and its corresponding model dependent environment to form a new image file;

[0082] Update the new image file to the corresponding original image file in the container reposit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a neural network transfer learning automatic training scheduling method based on an ONNX model, and the method comprises the following steps: S1, building a PI database whichis used for the collection and storage of process data of a production environment; s2, respectively adopting different deep learning model training platforms to train the process data according to different task requirements, respectively exporting the obtained models as ONNX models, and forming an ONNX model library; s3, performing matching from the ONNX model library according to the task requirement of the production environment to obtain a corresponding target model; s4, deploying the target model to a corresponding edge device end; s5, enabling the edge equipment end to use the deployedtarget model to complete a corresponding task, and monitoring whether the performance of the target model is reduced or not; and S6, if so, loading new process data, and going to the step S2. According to the method, an automatic training scheduling method is utilized, the adaptability of the model to the production environment is improved, and the generalization performance of the model is better.

Description

technical field [0001] The invention belongs to the technical field of deep learning, and in particular relates to an automatic training scheduling method for neural network migration learning based on an ONNX model. Background technique [0002] At present, all major deep learning frameworks have their own unique characteristics and advantages, and each has its own set of proprietary model representation methods, and its own set of standards to operate and run its own model. Multiple learning frameworks lead to time-consuming and labor-intensive migration of algorithms and models between different frameworks. [0003] In addition, through the deep learning framework, the model derived in the training environment often does not work well in the production environment. Due to the conditions of the production environment or other factors, the model obtained in the training environment cannot fit the distribution of the data well, resulting in a decline in the performance of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08G06F8/71G06F8/65
CPCG06F8/65G06F8/71G06N3/08
Inventor 滕卫明解剑波钱济人张国民杨秦敏范海东李清毅陈积明向星任周君良吴昀丁楠
Owner 浙江浙能天然气运行有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products