Graph data mining method and device, electronic equipment and machine readable storage medium

A data storage and graph data technology, applied in the field of data processing, can solve problems such as fragmentation, achieve the effects of improving execution efficiency, avoiding frequent data transfer, and efficiently realizing data fusion

Pending Publication Date: 2021-12-31
HANGZHOU HIKVISION DIGITAL TECH
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the current big data processing framework is separated from the graph deep learning framework, which makes the efficient integration of data preprocessing and GNN model training a problem that needs to be solved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Graph data mining method and device, electronic equipment and machine readable storage medium
  • Graph data mining method and device, electronic equipment and machine readable storage medium
  • Graph data mining method and device, electronic equipment and machine readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0028] The terminology used in this application is for the purpose of describing particular embodiments only, and is not intended to limit the application. As used in this application and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise.

[0029] In order to enable those skilled ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a graph data mining method and device, electronic equipment and a machine readable storage medium, and the method comprises the steps: preprocessing original data to obtain graph structure data; according to a training strategy of a distributed graph neural network, segmenting the graph structure data to obtain a plurality of sub-graph data, and storing the sub-graph data in a distributed memory management system; constructing a distributed graph neural network training function, performing distributed graph neural network model training by using the distributed graph neural network training function according to the sub-graph data stored in the distributed memory management system, and storing the obtained Embedding in the distributed memory management system; and training and predicting an ML model according to the Embedding stored in the distributed memory management system. The method can improve the execution efficiency of graph data mining.

Description

technical field [0001] The present application relates to data processing technology, in particular to a graph data mining method, device, electronic equipment and machine-readable storage medium. Background technique [0002] At present, for the processing of large amounts of data, big data processing frameworks represented by Apache Spark have been born. They usually have good scalability and friendly programming interfaces, and can quickly and effectively process large amounts of data. [0003] With the development of artificial intelligence technology, the intelligent application of deep learning methods on European data such as images and texts has achieved great success. But in reality, many data naturally belong to non-European graph structures, such as social networks, knowledge graphs, and molecular structures. Drawing on the achievements of deep learning on European data, researchers have proposed various graph neural network models (Graph Neural Networks, GNN for...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/54G06F16/901G06N3/04G06N3/063G06N3/08
CPCG06F9/544G06F16/9024G06N3/063G06N3/08G06N3/045
Inventor 马卿云方超罗逸璕叶新陈国栋
Owner HANGZHOU HIKVISION DIGITAL TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap