Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for constructing online machine learning project and machine learning system

A machine learning and project technology, applied in the field of machine learning, which can solve the problems of large differences in data set specifications, inability to analyze data and share experiments, and inability to save the experimental running status and data, so as to save storage space and improve Ease of access and improved readability

Pending Publication Date: 2020-11-06
MEGVII BEIJINGTECH CO LTD +1
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The first aspect is poor flexibility, because it is difficult to easily change computing resources due to the use of a single machine; second aspect, the data flexibility and use threshold are high, and the specifications of the data sets vary greatly. Frequent uploading and downloading of data sets will Brings a huge time cost; thirdly, the lack of management of models and data sets will lead to the inability to manage the data on the machine after a long time; fourthly, writing and running code through the command line cannot achieve friendly saving and running experiments Status and data, let alone analyzing data and sharing experiments

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for constructing online machine learning project and machine learning system
  • Method for constructing online machine learning project and machine learning system
  • Method for constructing online machine learning project and machine learning system

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0071] like image 3 As shown, when the service is the model development service, as an example, S102 includes: building a container for running an online programmable notebook in the user service cluster according to the image file; S103 includes: receiving the The user inputs the code data into the programmable notebook and runs the code data; S104 includes: feeding back the running result of the code to the user.

[0072] In order to improve the convenience for users to access codes, such as image 3 As shown, as an example, after S103 or while performing the input operation of S103, the method for constructing an online machine learning project further includes: S105, saving the code data in real time; or, by listening to the saving behavior from the user Or release a new version behavior to save the code data. The embodiment of the present application can save the code data of the user in the programmable notebook. Compared with the existing programmable notebook, the p...

example 2

[0075] like Figure 4 As shown, in some embodiments, the service is a model training service, and S102 includes: building a container for running an online programmable notebook in the user service cluster according to the image file; mounting the container in the container based on the NFS protocol The data set of the first project to which the service belongs; providing the code data of the first project; S103 includes: receiving the request from the user to access the target data set, wherein the target data set belongs to the first project Part or all of the data set; S104 includes: providing the user with the target data set and data within a predetermined range adjacent to the storage location of the target data set on the network storage server for the user to download . The embodiment of the present application uses NFS to mount the data set to the container of the built operating environment. Compared with the existing method of directly downloading the data set for ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An embodiment of the invention provides a method for constructing an online machine learning project and a machine learning system. The method for constructing the online machine learning project comprises the following steps of: receiving a service request from a user; allocating resources of a user service cluster to a service according to the service request, and constructing an online operation environment, wherein the online operation environment is used for executing a model development service or a model training service of machine learning; receiving an operation from the user in the online running environment; and providing operation information to the user based on the operation, wherein the operation information comprises an operation result or an operation state of the model development service or the model training service. According to the method of the invention, the user locally compiles codes to realize model development or locally uses cloud resources to realize modeltraining, and returns a code development running result and a model training result executed at the cloud to a user browser, so that the effect of the user for performing machine learning projects isimproved.

Description

technical field [0001] The present application relates to the field of machine learning, and specifically, the embodiments of the present application relate to a method for constructing an online machine learning project and a machine learning system. Background technique [0002] At present, the common machine learning (for example, deep learning) solution in the industry is to use a physical machine or virtual machine with a high-performance graphics card to download the data set and model to the local disk, and then write the training code through the command line, run the code, Get the training results of the code execution in the standard output or log file for analysis. [0003] The inventors of the present application have discovered that the above related solutions include at least the following four defects. The first aspect is poor flexibility, because it is difficult to easily change computing resources due to the use of a single machine; second aspect, the data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/06H04L29/08G06N20/00
CPCH04L63/0807G06N20/00H04L63/0884H04L63/108H04L67/10H04L67/02H04L67/565H04L67/60
Inventor 张鹏浩
Owner MEGVII BEIJINGTECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products