Graph neural network training method and device

A neural network and training method technology, applied in the computer field, can solve the problems of computing resources and memory usage burden, and achieve the effect of reducing memory usage and computing consumption, reducing memory usage, and reducing computing consumption.

Active Publication Date: 2020-12-15
ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
View PDF6 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Usually, the graph neural network needs to use the information of its multi-order neighbors when determining the embedding expression of a node. However, as the order increases, the number of neighbors will increase exponentially, which will bring great impact on computing resources and memory usage. big burden

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Graph neural network training method and device
  • Graph neural network training method and device
  • Graph neural network training method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Multiple embodiments disclosed in this specification will be described below in conjunction with the accompanying drawings.

[0036] As mentioned earlier, a relational network graph can be abstracted to include a set of nodes and a set of edges, where nodes represent entities in the real world, and edges represent associations between entities. figure 1 A schematic diagram showing a relational network graph, where users are taken as nodes for example. As shown in the figure, users with associated relationships are connected by edges.

[0037] When using the graph neural network model (or graph neural network, GNN network, GNN model) to calculate the embedding expression (or embedding vector) of a node in the relational network graph, the number of neighbor nodes of the node will vary with The increase of the order (or the number of layers, the number of hops) increases exponentially.

[0038] In order to solve the problem of the expansion of the number of nodes, in on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a graph neural network training method, wherein the method comprises the steps: obtaining a relation network graph, wherein each object node corresponds to a sampling probability set, and the sampling probability set comprises the sampling probability of each first-order neighbor node; performing multiple rounds of iterative updating on the graph neural network on the basis of the relation network graph, wherein any round comprises the steps of performing M-order neighbor node sampling by taking a first label node selected in the round as a center, wherein any i-order neighbor node sampling comprises any first node in a sampled i-1-order neighbor nodes; based on a current sampling probability set, sampling a plurality of neighbor nodes from a first-order neighbor node full set, and classifying the neighbor nodes into an i-order neighbor node; performing the current round of updating on the graph neural network based on the sampled neighbor nodes within the M order and the first service label carried by the first label node; and determining a plurality of training feedbacks corresponding to the plurality of neighbor nodes by using theupdated graph neural network, and then updating the current sampling probability set of the first node.

Description

technical field [0001] The embodiments of this specification relate to the field of computer technology, and in particular to a training method and device for a graph neural network. Background technique [0002] The relationship network diagram is a description of the relationship between entities in the real world, and is currently widely used in various computer information processing. Generally, a relational network graph includes a set of nodes and a set of edges. Nodes represent entities in the real world, and edges represent connections between entities in the real world. For example, in a social network, people are entities, and relationships or links between people are edges. [0003] In many cases, it is hoped to analyze the topological characteristics of nodes, edges, etc. in the relational network graph, and extract effective information from them. The computing method to realize this kind of process is called graph computing. Typically, it is desired to repres...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/084G06N3/047G06N3/045
Inventor 吴郑伟刘子奇
Owner ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products