Model reasoning method and device, electronic equipment and storage medium

An inference method and model technology, applied in the field of electronic equipment and storage media, devices, and model inference methods, can solve problems such as inability to provide support for different deep learning frameworks, difficulty in inference implementation optimization, etc. Tampering, the effect of improving security

Inactive Publication Date: 2021-07-20
北京首都在线科技股份有限公司
View PDF8 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

As a key link in the output of artificial intelligence capabilities, the deployment and reasoning efficiency of artificial intelligence models will have a direct impact on the overall performance of the solution, but the model deployment tools commonly used in the existing technology cannot be used in increasingly diverse application scenarios. It provides support for different deep learning frameworks, and it is difficult to optimize reasoning in a more targeted manner

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model reasoning method and device, electronic equipment and storage medium
  • Model reasoning method and device, electronic equipment and storage medium
  • Model reasoning method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0034] In the prior art, model reasoning is generally performed in the following two ways:

[0035] The first is to perform model inference on a physical machine. In this method, the model required for inference, the relevant data required for training, and the programs required for the inference process are installed on a separate physical machine, so that the physical...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a model reasoning method and device, electronic equipment and a storage medium, and relates to the field of model reasoning. A specific implementation scheme comprises: starting a preset artificial intelligence model by using an application container engine mirror image; determining a plurality of target models in the preset artificial intelligence model according to the type and reasoning requirement of the input data; setting priorities of the plurality of target models; and running the plurality of target models according to the priorities for reasoning to obtain a reasoning result. According to the embodiment of the invention, the overall operation of the reasoning process is optimized, the model reasoning efficiency is improved, the model for reasoning is flexibly selected based on different scenes and specific reasoning requirements, and the priority of model execution in the reasoning process is automatically set, so that the whole model reasoning process is more accurate and efficient.

Description

technical field [0001] The present disclosure relates to the technical field of model reasoning, and in particular to a model reasoning method, device, electronic equipment and storage medium. Background technique [0002] As the public cloud has gradually become an important carrier for the deployment of artificial intelligence (AI) in various industries, the overall work efficiency of the AIaaS (AI as a Service, referred to as "artificial intelligence cloud service") solution is getting better and better. more attention. Those skilled in the art have been developing artificial intelligence cloud service solutions with better performance, stronger scalability, easier deployment, and lower total cost of ownership (TCO). As a key link in the output of artificial intelligence capabilities, the deployment and reasoning efficiency of artificial intelligence models will have a direct impact on the overall performance of the solution, but the model deployment tools commonly used ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N5/04G06F8/61G06F9/455G06K9/00G06K9/34G06K9/62
CPCG06N5/04G06F8/63G06F9/45558G06V40/168G06V20/49G06V20/41G06V10/267G06F18/24
Inventor 赵二城
Owner 北京首都在线科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap