The invention provides a performance testing method and device for a large
language model and related equipment. The performance testing method comprises the steps that multiple testing platforms for testing, testing scene configuration parameters and a structured testing
data set for testing are determined; on the basis of the
test scene configuration parameters and the structured
test data set, synchronous constraint parameters are generated and distributed to the multiple test platforms, and then a preset
load generator is used for controlling the multiple test platforms to concurrently execute reasoning test tasks about the large
language model; and when the test is executed, collecting
multiple dimension performance indexes of each
test platform in real time for
data analysis, and generating a reasoning
performance comparison evaluation report of the large
language model in the multiple test platforms according to a
data analysis result. According to the method, the cross-platform performance
evaluation period is greatly shortened, and the waste of computing resources is reduced. Manual operation errors are avoided, comparability of multi-platform performance indexes is guaranteed, and more accurate and reliable multi-platform performance test results can be obtained.