Method and device for distributed diagram calculation

A graph algorithm and graph computing technology, applied in the computer field, can solve problems such as the inability to guarantee the effective operation of the algorithm, and achieve the effects of reducing the amount of repeated calculations, improving computing efficiency, and improving processing efficiency

Inactive Publication Date: 2017-05-03
TRANSWARP INFORMATION TECH SHANGHAI
View PDF2 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the expansion of the graph scale, single-machine, single-threaded graph processing algorithms are limited by system resources and computing time, which cannot guarantee the successful and efficient operation of the algorithm

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for distributed diagram calculation
  • Method and device for distributed diagram calculation
  • Method and device for distributed diagram calculation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0021] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory.

[0022] Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and / or nonvolatile memory such as read only memory (ROM) or flash RAM. Memory is an example of computer readable media.

[0023] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static rando...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application aims at providing a method and device for distributed diagram calculation. Compared with the prior art, the method provided by the invention comprises the following steps: firstly acquiring original diagram data, and processing the original diagram data according to a diagram algorithm to acquire structured diagram data corresponding to the diagram algorithm, thereby adapting to the diagram algorithms in different types; and then distributing the calculation tasks corresponding to the diagram algorithms to multiple calculation nodes to be executed, wherein a persistence condition should be satisfied in the execution process, the persistence operation is performed, the data dependence is cutoff, the repeated calculation amount is reduced, and the processing efficiency is improved. Furthermore, the application comprises firstly performing a combination operation on the diagram data before an aggregation operation and a connection operation, thereby improving the operation efficiency and relieving the network transmission pressure. Furthermore, the application adopts a data serialization and deserialization method to facilitate the transmission of intermediate data produced in the calculation process between the calculation nodes.

Description

technical field [0001] The present application relates to the field of computers, and in particular to a technology for distributed graph computing. Background technique [0002] With the expansion of graph scale, single-machine and single-thread graph processing algorithms are limited by system resources and computing time, which cannot guarantee the successful and efficient operation of the algorithm. Therefore, parallelizing and distributing the graph processing process is the way to solve the problem. Contents of the invention [0003] The purpose of this application is to provide a method and device for distributed graph computing. [0004] According to one aspect of the present application, a method for distributed graph computing is provided, wherein the method includes: [0005] Get the original graph data; [0006] According to a graph algorithm, processing the original graph data to obtain regular graph data corresponding to the graph algorithm; [0007] The ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/00G06F16/2237G06F16/182
Inventor 王志平吕程
Owner TRANSWARP INFORMATION TECH SHANGHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products