Distributed graph data processing method and device

A processing method and technology of graph data, applied in the field of data processing, can solve problems such as insufficient utilization of computing power, waste of resources, long processing time of graph data, etc., and achieve the effect of reducing the total execution time and avoiding synchronization waiting time

Active Publication Date: 2017-06-09
BEIHANG UNIV
View PDF3 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, the computing power of the slave computing node cannot be fully utilized, resulting in a waste of resources and making the graph data processing time longer

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed graph data processing method and device
  • Distributed graph data processing method and device
  • Distributed graph data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0051] The present invention provides a distributed graph data processing method and device, which can make full use of the computing power of slave computing nodes, reduce synchronization waiting time, optimize execution efficiency, and reduce total execution time.

[0052] The distributed graph data processing method and device provided by the p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed graph data processing method and device. The distributed graph data processing method includes: determining if a second calculation message sent from a second slave calculation node is received or not in a process of waiting to receive a reply response sent by a target slave calculation node when a first slave calculation node executes the current iteration treatment completely, it is determined that a second calculation message to be treated does not exist in a message queue, and it is determined that an active vertex does not exist in a block which is currently treated; and executing next iteration treatment if so, wherein the target slave calculation node can receive a first calculation message sent from the first slave calculation node. The distributed graph data processing method and device can fully utilize the calculation capability of slave calculation nodes, can shorten the synchronization waiting time, can optimize the execution efficiency, and can shorten the total execution time.

Description

technical field [0001] The present invention relates to data processing technology, in particular to a distributed graph data processing method and device. Background technique [0002] Graph data is a data structure consisting of a collection of data objects called vertices and a collection of data objects called edges. Because graph data can intuitively represent many application scenarios in the real world, graph data has been widely used in many fields, such as path planning and recommendation systems. [0003] With the advent of the era of big data, the number of data entries (that is, the number of edges) of graph data is increasing, and the relationship between data and data is more complicated. A single machine is no longer sufficient for processing graph data. At present, graph data is often processed through distributed graph data processing methods. Specifically, the graph data is divided into multiple blocks, so that the blocks of the graph data are distribute...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5083
Inventor 李建欣曹英杰李博张扬扬
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products