Unlock instant, AI-driven research and patent intelligence for your innovation.

Automatic synchronization of cloned directed acyclic graph

A directed acyclic graph, asynchronous technology, applied in the direction of biological neural network models, probabilistic networks, and other database retrieval, can solve problems such as limited flexibility

Pending Publication Date: 2022-04-22
FORD GLOBAL TECH LLC
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Such near-custom programming may limit the flexibility of computing according to the master-slave model, since any change in the configuration or operation of one or more nodes in a distributed computing network may require reprogramming

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic synchronization of cloned directed acyclic graph
  • Automatic synchronization of cloned directed acyclic graph
  • Automatic synchronization of cloned directed acyclic graph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Building, training, and utilizing neural networks that exceed the computational and / or memory capacity of a single machine is complex. Not only does the processing on different worker nodes need to be precisely synchronized, but there are also important and complex communication patterns between the different nodes.

[0035] Implementing such neural networks with existing frameworks and tools is difficult, time-consuming, and brittle, and even small changes to the network architecture require substantial changes to the underlying code. Also, after training a neural network, there needs to be a mechanism to load the weights and use them to make predictions on new data, but often to make predictions on a different number of machines and / or a different input size than was used to train the model. The current approach would require significant overhauls of the code used for training to support this use case.

[0036] The present disclosure relates to systems and methods fo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides automatic synchronization of cloned directed acyclic graphs. A method for synchronously cloning a directed acyclic graph is disclosed. The method may include identifying a directed acyclic graph ("DAG") including a plurality of vertices linked in a pairwise relationship via a plurality of edges. At least one cloned DAG may be created, which may be the same as at least a portion of the DAG. A corresponding cloned vertex may be identified from the cloned vertices of the at least one cloned DAG for each of the vertices of the DAG. Aggregated gradient data may be calculated based on gradient data from each of the cloned vertices in the DAG and its corresponding vertices, and at least one weight of the DAG and the at least one cloned DAG may be updated based on the aggregated gradient data.

Description

technical field [0001] The present disclosure relates generally to distributed computing systems. Background technique [0002] The use of computers is increasingly dominating engineering design. This improves design quality, but new design challenges are expanding the limitations of current computing systems. For example, a computer can be used to simulate airflow over the exterior body of a car. This requires a lot of input data and computation in order to generate useful simulations. In addition to the sheer amount of data for this simulation, the computational load of this simulation can also be significant due to the potentially complex relationship between input data and output. [0003] Such difficulties can be solved via distributed computing. Currently, distributed computing operates according to a master-slave model, where one node maintains summary and control over the computing operations performed by slave nodes. A slave node performs an action when it rece...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/901G06F16/903G06N3/04G06N3/08
CPCG06F16/9024G06F16/90348G06N3/04G06N3/08G06N3/084G06N7/01G06N3/045G06N3/098
Inventor B·D·萨夫努克
Owner FORD GLOBAL TECH LLC