A multi-node mpi collective communication performance modeling method and system

By measuring the multi-core processors and platform network hierarchy information within a node, and combining this with MPI source code analysis, a mathematical formula was established to predict communication time. This solved the problem of low-cost prediction of cross-node MPI set communication overhead and achieved more accurate communication time prediction.

CN119676099BActive Publication Date: 2025-11-28XI AN JIAOTONG UNIV
2 Cites 0 Cited by

Patent Information

Application Number
CN202411941181.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-26
Publication Date
2025-11-28
Estimated Expiration
2044-12-26

AI Technical Summary

Technical Problem

Existing technologies struggle to predict the overhead of cross-node MPI ensemble communication in supercomputing systems at low cost, especially in large-scale scientific computing, where existing models cannot effectively incorporate the hierarchical structure of supercomputing networks for accurate prediction.

Method used

By measuring the multi-core processor information within the node and the platform network hierarchy information, model parameters are determined, MPI source code communication behavior is analyzed, and mathematical formulas are established to predict communication time based on point-to-point communication time under different characteristics, taking into account the supercomputing network hierarchy and communication primitive types.

Benefits of technology

The model can more accurately predict the communication time of multi-node ensemble communication operations, adapt to different hardware platforms, reduce costs, and improve prediction accuracy.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The application discloses a kind of multi-node MPI set communication performance modeling method and system, first according to the information of multi-core processor in node and platform network hierarchy information, determine the model parameters required to be measured;Then measure the communication parameters in node and the inter-node communication parameters located on different network hierarchy on platform;Next, analyze the set communication source code and simulate the communication algorithm behavior, obtain all communication characteristics of each round of communication of algorithm;Finally, the corresponding parameters are selected in combination with the communication characteristics, and the communication time of each round is expressed by the mathematical formula of the corresponding parameters.The application compared with existing model, introduce the supercomputer network hierarchy structure information and the point-to-point communication primitive type used by communication algorithm bottom, expand the model application range from single-node shared memory model to multi-node shared memory and interconnection network hybrid model, and the model can more accurately predict the communication time of multi-node set communication operation.
Need to check novelty before this filing date? Find Prior Art