Load dynamic optimization method for principal and subordinate distributed graph manipulation system

A distributed and graph processing technology, applied in the transmission system, electrical components, etc., can solve problems such as load imbalance, and achieve the effect of small overhead, good effect, and obvious load balancing optimization effect

Active Publication Date: 2015-07-15
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This invention can effectively solve the load imbalance problem caused by the graph algorithm and make up for the deficiency of static division

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Load dynamic optimization method for principal and subordinate distributed graph manipulation system
  • Load dynamic optimization method for principal and subordinate distributed graph manipulation system
  • Load dynamic optimization method for principal and subordinate distributed graph manipulation system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0032] figure 1 The execution steps of the load dynamic optimization method of the master-slave distributed graph processing system based on the BSP model are as follows:

[0033] (1) Initialization step: Upload the graph data that needs to be calculated to the distributed graph processing system, and determine the graph calculation operations that the distributed graph processing system needs to perform; the distributed graph processing system performs Hash division on the loaded graph data, and the graph The data is divided into multiple sub-graph data and loaded into each computing node respect...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a load dynamic optimization method for a principal and subordinate distributed graph manipulation system. The method comprises the following steps: a dynamic re-dividing and controlling step for main calculating nodes, a load monitoring step in working calculating nodes, and a load transfer step. The method disclosed by the invention is independent of the initial dividing of graph data. During the iteration execution of the working nodes, dynamic re-dividing is performed according to the instruction execution of the main nodes so as to perform load balancing; in the load monitoring step, the loads of the nodes are calculated, and before the end of the execution of each iteration, the loads are transmitted to other calculating nodes; besides, for the load transferring step, at the beginning of the execution of each iteration, the situation whether the nodes are overloaded or not is judged according to the load information which is received and monitored by other nodes, and the transferring nodes and the transferring amount are determined; when the iteration is completely executed, the load data is transferred to the target node, so that the dynamic load balancing of a distributed graph manipulation system is realized. Through the implementation of the dynamic optimization method disclosed by the invention, the problem that in the distributed graph manipulation system, the load is imbalanced can be effectively solved.

Description

technical field [0001] The invention belongs to the field of distributed graph data processing, and more specifically relates to a distributed graph processing system realized based on a BSP model. Background technique [0002] Graphs are the most commonly used abstract data structures in computer science. Compared with traditional relational data and XML databases, graphs have richer expressive capabilities. Therefore, graph-related applications are almost ubiquitous. However, with the advent of the era of big data, the scale of graphs is increasing day by day. Distributed processing of graphs in a cloud computing environment has become a new research trend. Therefore, there are also a large number of distributed graph processing systems, mainly Pregel-like systems based on the BSP model. The BSP computing model is a synchronous computing model that can perform multiple iteration cycles. One iteration includes three steps: calculation, communication, and synchronization. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 谢夏金海徐曼娜
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap