Distributed development platform and calculation method of same

A technology of distributed computing and computing methods, applied in the computer field, can solve the problems of high program running efficiency, low program running efficiency, complex programming implementation, etc., and achieve the effect of simplifying programming complexity, realizing parallel computing, and efficient parallel computing.

Inactive Publication Date: 2015-12-23
HUAWEI TECH CO LTD
View PDF2 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Currently existing distributed platforms, one type can realize automatic data distribution and data transmission fault tolerance, and the programming is simple, but the operation efficiency of the program is low; the other type requires developers to customize distribution data and data transmission fault tolerance strategy, programming implementation Complex, and the use of parallel computing makes the program run more efficiently

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed development platform and calculation method of same
  • Distributed development platform and calculation method of same
  • Distributed development platform and calculation method of same

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0022] figure 1 It is a system block diagram of the distributed development platform of the embodiment of the present invention. Wherein, a plurality of computers form a computer cluster, and each computer is installed with a computer with a local file system and a computing system. Such as figure 1 As shown, a distributed file system (Distributed File System, DFS) is deployed on a computer cluster, and provides a logical mechanism for data storage t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a distributed development platform and a calculation method of the same. The distributed development platform comprises a computer cluster, a distributed document system DFS deployed on the computer cluster and an MPI cluster constituted of an information transmission interface MPI which is deployed on each computer inside the computer cluster, wherein the DFS is used to provide sharing and storage space for each computer inside the computer cluster, and the sharing and storage space stores operation data required when the MPI cluster operates programs; and the MPI cluster is used to divide the programs which are submitted to the MPI cluster into a plurality of MPI tasks and then distribute the tasks to each MPI in the MPI cluster, wherein the computer of each MPI in the MPI cluster receives the MPI tasks, then calculates the operation data stored in the DFS according to the MPI task which is distributed respectively as well as the programs submitted to the MPI cluster, and stores the calculation results in the DFS, so that each computer in the computer cluster can get access to the calculation results.

Description

technical field [0001] The embodiments of the present invention relate to the computer field, and more specifically, to a distributed development platform and a computing method thereof. Background technique [0002] Distributed computing platform is an indispensable tool for processing big data. Currently existing distributed platforms, one type can realize automatic data distribution and data transmission fault tolerance, and the programming is simple, but the operation efficiency of the program is low; the other type requires developers to customize distribution data and data transmission fault tolerance strategy, programming implementation Complicated, and the use of parallel computing makes the program run more efficiently. [0003] Therefore, a suitable solution is needed, which can realize automatic data distribution and data transmission fault tolerance, simplify programming complexity, and realize efficient parallel operation at the same time. Contents of the inv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/45
Inventor 徐君李航
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products