A processing method and device for load balancing

A processing method and load balancing technology, applied in the direction of network traffic/resource management, digital transmission system, electrical components, etc., can solve problems such as increasing message communication network overhead

Active Publication Date: 2018-06-15
CHINA MOBILE COMM GRP CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] In view of this, the embodiment of the present invention provides a load balancing processing method and equipment, which are used to solve the time-consuming problem of using the load balancing strategy in Giraph in the BSP model at present, and the problem of using Hadoop in the BSP model The speculative execution strategy has the problem of increasing the network overhead of message communication

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A processing method and device for load balancing
  • A processing method and device for load balancing
  • A processing method and device for load balancing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] Such as figure 1 As shown, it is a schematic flowchart of a load balancing method provided by Embodiment 1 of the present invention. The method can be described as follows.

[0052] Step 101: Obtain the running time information of each task in an iteration period of a worker node.

[0053] In step 101, when the task of the working node starts to run, the running time information of each task in the current iteration cycle, the data volume information of the local task, and the messages for the next iteration cycle generated in this iteration cycle The estimated amount information obtained by pre-estimating the amount (it can also be represented by the time information of the read / write checkpoint).

[0054] It should be noted that the data volume information of the local tasks obtained through statistics and the estimated volume information obtained by pre-estimating the amount of messages generated in this iteration cycle for the next iteration cycle will involve the...

Embodiment 2

[0091] Such as image 3 As shown, it is a schematic structural diagram of a load balancing processing device provided by Embodiment 2 of the present invention. Embodiment 2 of the present invention is an invention under the same inventive concept as Embodiment 1 of the present invention. The device includes: an acquisition module 11 , determination module 12 and migration module 13, wherein:

[0092] An acquisition module 11, configured to acquire the running time information of each task in an iteration cycle of a working node;

[0093] A determining module 12, configured to determine the task to be migrated of the working node within the iteration period according to the acquired running time information of each task and the analysis strategy of the task to be migrated;

[0094] The migration module 13 is configured to migrate the task to be migrated to a working node other than the working node whose task processing capacity is less than a set threshold when it is determin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a processing method and equipment for load balancing, comprising: obtaining the running time information of each task in an iteration cycle of a working node; according to the obtained running time information of each task and an analysis strategy for the task to be migrated , determine the task to be migrated by the working node within the iteration period; when the number of tasks determined to be migrated exceeds the set value, migrate the task to be migrated to a task other than the working node whose task processing volume is less than the set threshold In this way, the task migration method is used to perform a task migration in multiple iterations of the work point, effectively achieving task load balancing between the work points, avoiding the problem of time consumption in the load balancing strategy in Giraph, and also avoiding Hadoop The speculative execution strategy in the middle has the problem of increasing the network overhead of message communication, which improves the efficiency of task migration in the BSP model and improves the load balance of the system.

Description

technical field [0001] The present invention relates to the technical field of wireless communication, in particular to a load balancing processing method and equipment. Background technique [0002] The BSP (Bulk-Synchronous Parallel) model is a model based on iterative processing of big data, which is different from the Map Reduce model. In the BSP model, data processing is divided into several tasks, and each task goes through the same iterative phase: synchronization phase, calculation phase and message communication phase. [0003] For the multitasks executed in parallel in the BSP model, dynamic load balancing is a key point in parallel computing. However, the BSP model inevitably has unbalanced load in the high-frequency iteration scenario in the parallel environment. [0004] At present, two solutions are proposed for the problem of load imbalance: one is the load balancing strategy in Giraph; the other is the speculative execution strategy in Hadoop. [0005] Amo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/803H04W28/08
Inventor 邓超郭磊涛钱岭孙少陵
Owner CHINA MOBILE COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap