Method and device for processing graph data

A graph data and data technology, applied in the field of graph data processing, can solve problems such as low graph data processing efficiency

Active Publication Date: 2020-10-27
HUAWEI TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In the prior art, when the MapReduce system processes the graph data, it only calculates the data item by item for the input file in the Map stage. In the process of processing the graph data, it shows that a single vertex is used as the calculation object, and each vertex contains itself and Outbound information, during each round of MapReduce operations, messages are limited to one-step transmission along the outbound edge for the next round of MapReduce operations. When the scale of graph data is large, multiple rounds of MapReduce operations are required. Inefficient processing of graph data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for processing graph data
  • Method and device for processing graph data
  • Method and device for processing graph data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0028] figure 1 It shows a schematic block diagram of a MapReduce system to which the method for processing graph data according to the embodiment of the present invention can be applied. Such as figure 1As shown, the system may include DFS, Map computing nodes and Reduce computing nodes. The implementation process of processing graph data generally needs to use some traversal method to traverse the graph data, so processing a complete gra...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method and device for processing graph data. The method comprises: determining graph data to be processed, wherein a graph corresponding to the graph data is divided into a plurality of subgraphs (S210); scheduling computing nodes in a MapReduce system, and performing multiple rounds of MapReduce jobs on the graph data to obtain a process result of the graph data, wherein each of the mapped computing nodes in the MapReduce jobs is configured to process vertexes having interconnection relationships in one subgraph of the plurality of subgraphs (S220). The method can increase the efficiency of processing graph data.

Description

technical field [0001] Embodiments of the present invention relate to the field of data processing, and in particular, to a method and device for processing graph data. Background technique [0002] A graph is an abstract data structure that can describe rich information and the dependencies between information. There are many algorithms based on graph data in the prior art, such as the shortest path algorithm, graph simulation algorithm, web page ranking algorithm, and breadth-first search algorithm. Applications of graph data and its associated algorithms are ubiquitous, such as social network analysis, semantic web analysis, bioinformatics, and traffic navigation. [0003] With the rapid development of these applications, the scale of the graph data they involve has also become larger and larger, with hundreds of millions of vertices and billions of edges at every turn. How to efficiently store and process large-scale graph data has also attracted more and more attentio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/182
CPCG06F16/182G06F16/00
Inventor 林学练郑金龙马帅
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap