Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed job processing method and system

A distributed and operational technology, applied in the direction of electrical digital data processing, resource allocation, program control design, etc., can solve problems such as load imbalance and achieve the effect of improving performance

Inactive Publication Date: 2016-06-22
IBM CORP
View PDF7 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although FPGA can accelerate various functions in a distributed job to a certain extent, when the performance requirements in the distributed job change, such as workload imbalance, the FPGA acceleration cannot solve the problem of load imbalance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed job processing method and system
  • Distributed job processing method and system
  • Distributed job processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0018] figure 1 A block diagram of an exemplary computer system / server 12 suitable for use in implementing embodiments of the invention is shown. figure 1 The computer system / server 12 shown is only an example and should not impose any limitation on the functions and scope of use of the embodiments of the present invention.

[0019] Such as figure 1 As shown, computer system / server 12 takes the form of a general purpose computing device. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to distributed processing and discloses a method and a system for processing a distributed job by utilizing an FPGA (Field Programmable Gate Array). The method comprises the steps of obtaining a performance demand in the distributed job; according to the performance demand, determining whether the FPGA is reconstructed or not; and, in response to the situation that the FPGA is determined to be reconstructed, dynamically reconstructing at least one part of the FPGA. Through the method and the corresponding system, the performance of the distributed job can be effectively improved.

Description

technical field [0001] The present invention relates to distributed jobs, and more particularly to methods and systems for processing distributed jobs. Background technique [0002] At present, with the popularity of distributed computing networks, more and more tasks are processed in the form of distributed jobs. These distributed jobs often contain complex workloads. Taking MapReduce as an example, MapReduce has various functions that need to be accelerated, such as compression, decompression, sorting, crc32 (Cyclic Redundancy Check) and so on. In the execution of these distributed jobs, there will be different performance requirements. For example, it is hoped that these distributed jobs can be completed in a shorter time or with less resource occupation, and it is hoped that the load balancing of each unit in the distributed system, etc. , where load imbalance is a very common problem in MapReduce workloads, which will seriously affect the performance of distributed jo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F15/7867G06F9/5083
Inventor 陈冠诚章宇陈飞刘弢王鲲H·P·霍夫斯蒂
Owner IBM CORP