Method for constructing online machine learning project and machine learning system

A machine learning and project technology, applied in the field of machine learning, which can solve the problems of large differences in data set specifications, inability to analyze data and share experiments, and inability to save the experimental running status and data, so as to save storage space and improve Ease of access and improved readability

Pending Publication Date: 2020-11-06
MEGVII BEIJINGTECH CO LTD +1
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The first aspect is poor flexibility, because it is difficult to easily change computing resources due to the use of a single machine; second aspect, the data flexibility and use threshold are high, and the specifications of the data sets vary greatly. Frequent uploading and downloading of data sets will Brings a huge tim

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for constructing online machine learning project and machine learning system
  • Method for constructing online machine learning project and machine learning system
  • Method for constructing online machine learning project and machine learning system

Examples

Experimental program
Comparison scheme
Effect test

Example

[0070] Example

[0071] like image 3 As shown, when the service is the model development service, S102 includes: a container for running online programmable notebooks in the user service cluster according to a mirror image; S103 includes: receiving the network through a network The user enters the code data to the programmable notebook and runs the code data; S104 includes: feedback to the user's operational results.

[0072] In order to enhance the convenience of users' access to code, such as image 3 As shown, the method of constructing an online machine learning item after S103 or as an input operation of performing S103 is also included: S105, saving the code data in real time; or by listening to the user's save behavior Or release a new version behavior to save the code data. The present application embodiment can save the user's programmable notebook code data, compared with existing programmable notebooks, programmable notebooks with storage functions significantly increase...

Example

[0074] Example 2

[0075] like Figure 4 As shown in some embodiments, the service is a model training service, and S102 includes: a container for running online programmable notebooks in the user service cluster according to a mirroring file; based on NFS protocols Mount The data set of the first item belongs; the code data of the first item is provided; S103 includes: receiving the request of the user access target dataset, wherein the target data set belongs to the first item. Some or all of the data set; S104 includes: providing the user with the target data set and data within a predetermined range adjacent to the storage location of the target dataset for the user. . The present application example uses NFS to mount the data set in the container of the built-built operating environment, and the method of mounting the implementation of the present application embodiment is significantly saved by the user's storage space than the existing model training needs to download the da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention provides a method for constructing an online machine learning project and a machine learning system. The method for constructing the online machine learning project comprises the following steps of: receiving a service request from a user; allocating resources of a user service cluster to a service according to the service request, and constructing an online operation environment, wherein the online operation environment is used for executing a model development service or a model training service of machine learning; receiving an operation from the user in the online running environment; and providing operation information to the user based on the operation, wherein the operation information comprises an operation result or an operation state of the model development service or the model training service. According to the method of the invention, the user locally compiles codes to realize model development or locally uses cloud resources to realize modeltraining, and returns a code development running result and a model training result executed at the cloud to a user browser, so that the effect of the user for performing machine learning projects isimproved.

Description

technical field [0001] The present application relates to the field of machine learning, and specifically, the embodiments of the present application relate to a method for constructing an online machine learning project and a machine learning system. Background technique [0002] At present, the common machine learning (for example, deep learning) solution in the industry is to use a physical machine or virtual machine with a high-performance graphics card to download the data set and model to the local disk, and then write the training code through the command line, run the code, Get the training results of the code execution in the standard output or log file for analysis. [0003] The inventors of the present application have discovered that the above related solutions include at least the following four defects. The first aspect is poor flexibility, because it is difficult to easily change computing resources due to the use of a single machine; second aspect, the data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/06H04L29/08G06N20/00
CPCH04L63/0807G06N20/00H04L63/0884H04L63/108H04L67/10H04L67/02H04L67/565H04L67/60
Inventor 张鹏浩
Owner MEGVII BEIJINGTECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap