Online model reasoning system

An inference system and model technology, applied in the fields of electrical digital data processing, software simulation/interpretation/simulation, software deployment, etc., can solve problems such as different operating environments of inference models and running errors of online inference services.

Pending Publication Date: 2020-07-14
JINGDONG TECH HLDG CO LTD
View PDF7 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the process of realizing the present invention, the inventors found that as the demand for inference services increases, the types of inference models to be deployed increase, and the trainin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online model reasoning system
  • Online model reasoning system
  • Online model reasoning system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present application.

[0040] At present, with the development of big data technology and artificial intelligence technology and the increase of business scenarios, a large number of machine learning technologies are used to improve service quality and intelligent decision-making level. Regarding the operating environment of the machine learning model, the in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an online model reasoning system. According to the embodiment of the invention, the method comprises the steps of: establishing a model warehouse and a container mirror imagewarehouse in which container mirror images required by an inference model are stored; when receiving an online reasoning request of a user, enabling a model micro-service engine to call an inference model required by the user from a model warehouse according to the configuration information of the user; and storing the container mirror image in the container mirror image warehouse, so that the situation that the container mirror image required by the training model is inconsistent with the actual container mirror image is avoided, the inference model can be packaged into inference service capable of being operated in a containerization manner, and online inference service is provided.

Description

technical field [0001] The present application relates to the technical field of distributed storage, in particular to an online model reasoning system. Background technique [0002] With the development of big data technology and artificial intelligence technology, more and more business scenarios, such as financial risk control, online advertising, product recommendation, smart city, etc., use a large number of machine learning technologies to improve service quality and intelligent decision-making level. For specific tasks, after the model is trained in the training environment specified by the model, it needs to be packaged, and then the model is deployed as an online inference service. When the user uses the same operating environment as the training environment, the inference service can be used. [0003] However, in the process of implementing the present invention, the inventors found that as the demand for inference services increases, the types of inference models ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/455G06F8/60G06F8/65G06N5/02
CPCG06F9/45558G06F8/60G06F8/65G06N5/022G06F2009/45562
Inventor 黄绿君高峰斌
Owner JINGDONG TECH HLDG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap