Information interaction method and system

A technology of information interaction and gradient information, applied in the computer field, can solve the problems of slave memory consumption, reduce communication efficiency, increase resource consumption, etc., and achieve the effect of improving communication efficiency, reducing communication volume, and reducing consumption.

Active Publication Date: 2016-10-19
ALIBABA GRP HLDG LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, the master and the slave can obtain an approximate optimal solution through multiple rounds of iterations, and can obtain a better training model. However, during the iteration pro

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Information interaction method and system
  • Information interaction method and system
  • Information interaction method and system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0020] The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the application, but should not be understood as a limitation to the application.

[0021] The information interaction method and system of the embodiments of the present application are described below with reference to the drawings.

[0022] figure 1 It is a flowchart of an information exchange method according to an embodiment of the present application. This embodiment is described from the side of the second device, where the second device may be a slave.

[0023] Such as figure 1 As shown, the information interaction method includes:

[0024] S101: Determine whether an exit command is ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application discloses an information interaction method and system. The information interaction method comprises: whether an exit command is received is determined; if not, current weight information is read from a first device and gradient information is calculated based on the read current weight information; and gradient information that is larger than or equal to a preset gradient threshold value is returned to the first device and thus the first device calculates weight information again according to the returned gradient information and uses the weight information that is larger than or equal to a preset weight threshold value as current weight information, and the operations are executed repeatedly until the exit command is received. According to the information interaction method and system, the gradient information that is larger than or equal to the preset gradient threshold value is returned to the first device by at least one second device and the weight information that is larger than or equal to the preset weight threshold value is provided for at least one second device by the first device, so that the communication load between the first device and the second device is reduced substantially and thus the resource consumption is reduced and the communication efficiency is improved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to an information interaction method and system. Background technique [0002] As the core technology of big data processing, machine learning can be widely used in various fields, especially for generating training models. Since the loss function variables (that is, weight information) involved in training the model may exceed hundreds of billions, the training data is very large, and there is no one-step solution to minimize the loss function. It usually takes multiple rounds of iterations to obtain an approximate optimal solution. [0003] Specifically, in machine learning, slave (also known as worker / worker, in a cluster environment, there may be multiple workers) calculates gradient information and sends all gradient information to master (also known as server / server ), then the master calculates the new weights according to the weight update formula and the gradie...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
CPCH04L67/1001
Inventor 周俊
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products