Distributed system based machine learning program running method and device

A distributed system and machine learning technology, applied in the field of machine learning program operation, can solve problems such as low operation efficiency, achieve the effect of improving operation efficiency, improving stability and success rate, and facilitating query

Active Publication Date: 2018-10-19
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF12 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Currently popular deep learning frameworks include Tensorflow, Caffe, etc. When using these frameworks for distributed processing, it is necessary to manually log in to each server, co

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed system based machine learning program running method and device
  • Distributed system based machine learning program running method and device
  • Distributed system based machine learning program running method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0035] figure 1 It is a schematic diagram of the main flow of the method for running a machine learning program based on a distributed system according to an embodiment of the present invention, such as figure 1 As shown, the method for running a machine learning program based on a distributed system in the embodiment of the present invention mainly includes:

[0036] St...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed system based machine learning program running method and device, and relates to the technical field of computers. A specific implementation manner of the method includes: acquiring a resource for running the machine learning program in a distributed system according to a running request of a machine learning program; generating a startup parameter according toport information and identification information of a server node in the resource; and transmitting the machine learning program and the startup parameters to a corresponding server node such that theserver node starts running the machine learning program. The method can automatically obtain the resource according to the running request submitted by the user, and generates the startup parameter according to the port information and the identification information of the server node in the obtained resource, so that the machine learning program can be automatically run through the startup server node corresponding to the startup parameter, thereby improving the efficiency of machine learning program running.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a method and device for running a machine learning program based on a distributed system. Background technique [0002] Nowadays, machine learning or deep learning is applied in many fields, such as image recognition, speech recognition, automatic driving and other fields. Currently popular deep learning frameworks include Tensorflow, Caffe, etc. When using these frameworks for distributed processing, it is necessary to manually log in to each server, copy the machine learning program to be run to the server, and manually start the program on the server. In the middle of the operation, there is a problem of low operating efficiency. Contents of the invention [0003] In view of this, the embodiments of the present invention provide a method and device for running a machine learning program based on a distributed system, which can automatically obtain resources accord...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N99/00
Inventor 吴怡燃
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products