Supercharge Your Innovation With Domain-Expert AI Agents!

Model scheduling processing method and device, equipment and storage medium

A scheduling processing and model technology, applied in the field of artificial intelligence, can solve the problems of neglecting model scheduling analysis and adjustment, and the limited performance improvement of multi-network model collaborative work applications, so as to achieve the effect of improving performance.

Pending Publication Date: 2022-01-14
UNIV OF SCI & TECH OF CHINA +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the optimization of multi-network model applications mainly focuses on the analysis and optimization of the performance of the internal operators of the model, completely ignoring the analysis and adjustment of model scheduling, which limits the performance improvement of multi-network model collaborative work applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model scheduling processing method and device, equipment and storage medium
  • Model scheduling processing method and device, equipment and storage medium
  • Model scheduling processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The technical solutions of the embodiments of the present application are applicable to an application scenario in which multiple network models work together, and specifically to an application scenario in which the multi-network models in the application scenario are scheduled. By adopting the technical solution of the embodiment of the present application, the scheduling efficiency of multiple network models can be improved, and each network model can work together according to a scientific and reasonable scheduling strategy, so that the performance of applications based on the multiple network models can be further improved.

[0057] figure 1 A schematic diagram showing an application scenario where multiple network models work together. In this application scenario, there is at least one execution device, a scheduler, and multiple neural network models. Each neural network model mapped to the final inference execution is an inference engine. The scheduler is a gl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a model scheduling processing method and device, equipment and a storage medium, and the method comprises the steps: determining the performance parameters of each network model according to the operation log data of each network model during the execution of a single-path serial task and the operation log data of each network model during the execution of a multi-path parallel task; and determining a scheduling strategy for each network model according to the performance parameters of each network model and the operation log data when each network model executes the target task. According to the scheme, the scheduling strategy of each network model is determined by analyzing the performance parameters of the network models and the operation log data of each network model during execution of the target task, analysis and adjustment of model scheduling are realized, and improvement of the performance of cooperative work application of multiple network models is facilitated.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence, and in particular to a model scheduling processing method, device, equipment and storage medium. Background technique [0002] With the continuous improvement of hardware computing power and the complexity and diversification of application scenarios, the structure and parameter quantity of neural network models increase accordingly, and the application scenarios of multi-network models working together emerge in endlessly. For example, in the image-text translation application scenario, the task process involved includes OCR image-text recognition and text translation, and OCR image-text recognition may involve image cutting, image regularization, image recognition, etc. The neural network models used in the entire business include: Several, there are scheduling dependencies in timing between these several models. In such an application with multiple network scheduling...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/04G06N5/04
CPCG06N3/04G06N5/04
Inventor 张海俊朱亚平姚文军
Owner UNIV OF SCI & TECH OF CHINA
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More