Graph data processing method and apparatus

A graph data and data technology, applied in the field of graph data processing, can solve problems such as low graph data processing efficiency, and achieve the effect of reducing the number of rounds and improving processing efficiency

Active Publication Date: 2017-05-10
HUAWEI TECH CO LTD
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In the prior art, when the MapReduce system processes the graph data, it only calculates the data item by item for the input file in the Map stage. In the process of processing the graph data, it shows that a single vertex is used as the calculation object, and each vertex contains itself and Outbound information, during each round of MapReduce operations, messages are limited to one-step transmission along the outbound edge for the next round of MapReduce operations. When the scale of graph data is large, multiple rounds of MapReduce operations are required. Inefficient processing of graph data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Graph data processing method and apparatus
  • Graph data processing method and apparatus
  • Graph data processing method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0028] figure 1 A schematic block diagram of a MapReduce system to which the method for processing graph data according to the embodiment of the present invention can be applied is shown. like figure 1As shown, the system may include DFS, Map computing nodes and Reduce computing nodes. The implementation process of processing graph data generally requires a certain traversal method to traverse the graph data, so processing a complete graph data usually...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention disclose a graph data processing method and apparatus. The method comprises the steps of determining to-be-processed graph data, and dividing a graph corresponding to the graph data into a plurality of sub-graphs; and dispatching computing nodes in a MapReduce system, and performing multi-round MapReduce operations on the graph data to obtain a processing result of the graph data, wherein each Map computing node in the MapReduce operation is used for processing vertexes with a mutual connection relationship in one of the sub-graphs. According to the method and the apparatus provided by the embodiments of the invention, the graph data processing efficiency can be improved.

Description

technical field [0001] Embodiments of the present invention relate to the field of data processing, and in particular, to a method and device for processing graph data. Background technique [0002] A graph is an abstract data structure that can describe rich information and the dependencies between information. There are many algorithms based on graph data in the prior art, such as the shortest path algorithm, graph simulation algorithm, web page ranking algorithm, and breadth-first search algorithm. Applications of graph data and its associated algorithms are ubiquitous, such as social network analysis, semantic web analysis, bioinformatics, and traffic navigation. [0003] With the rapid development of these applications, the scale of the graph data they involve has also become larger and larger, with hundreds of millions of vertices and billions of edges at every turn. How to efficiently store and process large-scale graph data has also attracted more and more attentio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/182G06F16/00
Inventor 林学练郑金龙马帅
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap