Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A disk graph processing method and a disk graph processing system based on subgraph construction

A graph processing and subgraph technology, which is applied in the disk graph processing method and system field based on subgraph construction, can solve the problems of high subgraph construction overhead and other problems, achieve the effect of solving high subgraph construction overhead and improving overall performance

Active Publication Date: 2019-01-22
HUAZHONG UNIV OF SCI & TECH
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Aiming at the above defects or improvement needs of the prior art, the present invention provides a disk map processing method and system based on subgraph construction, thereby solving the technical problem of high subgraph construction cost in the existing disk map processing system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A disk graph processing method and a disk graph processing system based on subgraph construction
  • A disk graph processing method and a disk graph processing system based on subgraph construction
  • A disk graph processing method and a disk graph processing system based on subgraph construction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0029] The present invention provides a disk map processing method and system based on subgraph construction, and aims to reduce the high subgraph construction overhead in the existing disk map processing system.

[0030] The disk map processing method based on subgraph construction provided by the embodiment of the present invention, its flow is as follows figure 1 shown, including the followi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a disk graph processing method and a disk graph processing system based on subgraph construction, the method comprises the following steps: organizing graph data into a bi-directional edge block structure; Starting iterative graph computation; Loading graph data into memory; constructing a vertex-centric memory subgraph by an efficient subgraph construction method, updatingthe sub-graph; Writing the updated graph data back to disk; Judging whether the convergence condition is reached; Ending Iteration Graph Calculation. The disk graph processing method based on subgraph construction of the invention continuously organizes vertices and edges needed to be accessed in the process of subgraph construction, Ensure that memory access locality is fully utilized in the process of subgraph construction, solves the problem of high subgraph construction overhead in disk graph processing system, and significantly improves the overall performance of the system.

Description

technical field [0001] The invention belongs to the technical field of computer big data processing, and more specifically relates to a disk graph processing method and system based on subgraph construction. Background technique [0002] Under the current big data background, there are more and more application requirements for analyzing, processing and mining large-scale graph data. In recent years, disk-based graph processing systems have received widespread attention due to their low cost and strong scalability, such as GraphChi from Carnegie Mellon University, X-Stream from the Federal Institute of Technology in Lausanne, GridGraph from Tsinghua University, etc. . These on-disk graph processing divide graph data into subgraphs and load and process one subgraph from disk at a time. In addition, most of these systems adopt a vertex-centric computing model, and before processing each subgraph, a vertex-centric subgraph data structure needs to be built in memory. This sub...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06
CPCG06F3/0607G06F3/0659G06F3/0676
Inventor 王芳徐湘灏冯丹程永利张永选
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products