System performance prediction model training method, system performance prediction method and device

Abstract

The invention discloses a system performance prediction model training method and device and a system performance prediction method and device, and relates to the technical field of artificial intelligence and the technical field of computing power cluster system performance prediction.The method comprises the steps that sample feature data used for training a system performance prediction model is obtained, the sample feature data comprises cluster feature data of a known computing power cluster and system performance data obtained by performing a benchmark test on the known computing power cluster; the cluster feature data are input into a system performance prediction model, output system performance prediction data are obtained, and the model structure of the system performance prediction model is provided with a residual block stacking layer; based on the system performance prediction data and the corresponding system performance data, determining whether the model training meets a convergence condition or not; and if the convergence condition is not met, adjusting model parameters of the system performance prediction model, and executing next model training. By adopting the method, the system performance of the computing power cluster is accurately predicted.

Description

Technical Field

[0001] The present application relates to the fields of artificial intelligence technology and computing cluster system performance prediction technology, and in particular to a system performance prediction model training method, a system performance prediction method and a device. Background Art

[0002] With the development of artificial intelligence, especially the rapid development of large models, the system has higher and higher requirements for computing power. Building a computing center usually requires thousands of processors, accelerator cards and various high-speed bus facilities, while the overall performance of the system is affected by many factors such as processors, accelerator cards, communication methods, model algorithms and scheduling algorithms. If the system performance and facility investment expenses are not fully evaluated in the early stage of project construction, it is easy to cause waste of computing power or insufficient computing power. Obviously, neither of these two situations is desirable.

[0003] How to recommend a reasonable combination of software and hardware facilities based on actual application needs and combined with historical test data analysis to ensure that the cost and performance of the final system are optimized has become a topic of concern in the industry. Summary of the invention

[0004] The embodiments of the present application provide a system performance prediction model training method, a system performance prediction method and a device to solve the problem existing in the prior art of how to accurately predict the system performance of a computing power cluster.

[0005] The present application embodiment provides a system performance prediction model training method, including: Acquire sample feature data for training a system performance prediction model, the sample feature data including cluster feature data of a known computing power cluster and system performance data obtained by benchmarking the known computing power cluster; Inputting the cluster feature data into the system performance prediction model to obtain output system performance prediction data, wherein the model structure of the system performance prediction model has a residual block stacking layer, and the residual block stacking layer includes residual blocks; Based on the system performance prediction data and the corresponding system performance data, determining whether this model training meets the convergence condition; If the convergence condition is met, it is determined that the training of the system performance prediction model is completed; if the convergence condition is not met, the model parameters of the system performance prediction model are adjusted and the next model training is performed.

[0006] Furthermore, the cluster feature data includes: cluster quantitative feature data and cluster qualitative feature data; The residual block stacking layer includes a plurality of residual blocks connected in series; Each of the residual blocks has two inputs and one output; The inputs of the plurality of residual blocks each include a qualitative feature vector representing the qualitative feature data of the cluster; Another input of the first residual block is a quantitative feature vector representing the quantitative feature data of the cluster, another input of the residual blocks other than the first one is the output of the connected previous residual block, and the output of the last residual block is used as the output of the residual block stacking layer.

[0007] Furthermore, the operations performed in the residual block include the following operations: Multiplying the qualitative feature vector by the correlation matrix to obtain a correlation vector; Adding the association vector to the quantitative feature vector or the output of the previous residual block to obtain a merged feature vector; Multiplying the combined eigenvector by the residual matrix to obtain a residual vector; Adding the residual vector to the quantitative feature vector or the output of the previous residual block to obtain a skip connection feature vector; Normalizing the skip connection feature vector to obtain the output of the residual block; The correlation matrix and the residual matrix are used as model parameters of the system performance prediction model.

[0008] Furthermore, the model structure of the system performance prediction model has an input layer and a feature preprocessing layer; The input layer is used to receive the cluster quantitative feature data and the cluster qualitative feature data; The feature preprocessing layer is used to preprocess the cluster quantitative feature data through a multi-layer perceptron MLP network to obtain a quantitative feature vector, and to generate a qualitative feature vector corresponding to the cluster qualitative feature data by looking up a label code.

[0009] Furthermore, the model structure of the system performance prediction model has a summary layer and an output layer; The summary layer is used to process the output of the residual block stacking layer through the MLP network to obtain the system performance prediction data; The output layer is used to output the system performance prediction data.

[0010] The present application also provides a computing cluster system performance prediction method, including: Obtain cluster feature data of the computing power cluster to be predicted; Based on the cluster feature data, a system performance prediction model trained by any of the above-mentioned system performance prediction model training methods is used to predict the system performance of the computing power cluster to be predicted, so as to obtain system performance prediction data.

[0011] The present application also provides a system performance prediction model training device, including: A sample data acquisition module, used to acquire sample feature data for training a system performance prediction model, wherein the sample feature data includes cluster feature data of a known computing power cluster and system performance data obtained by benchmarking the known computing power cluster; A system performance prediction module, used for inputting the cluster feature data into the system performance prediction model to obtain output system performance prediction data, wherein the model structure of the system performance prediction model has a residual block stacking layer, and the residual block stacking layer includes residual blocks; A convergence judgment module, used to determine whether the current model training meets the convergence condition based on the system performance prediction data and the corresponding system performance data; The model training module is used to determine that the training of the system performance prediction model is completed if the convergence condition is met, and if the convergence condition is not met, adjust the model parameters of the system performance prediction model and perform the next model training.

[0012] Furthermore, the cluster feature data includes: cluster quantitative feature data and cluster qualitative feature data; The residual block stacking layer includes a plurality of residual blocks connected in series; Each of the residual blocks has two inputs and one output; The inputs of the plurality of residual blocks each include a qualitative feature vector representing the qualitative feature data of the cluster; Another input of the first residual block is a quantitative feature vector representing the quantitative feature data of the cluster, another input of the residual blocks other than the first one is the output of the connected previous residual block, and the output of the last residual block is used as the output of the residual block stacking layer.

[0013] Furthermore, the operations performed in the residual block include the following operations: Multiplying the qualitative feature vector by the correlation matrix to obtain a correlation vector; Adding the association vector to the quantitative feature vector or the output of the previous residual block to obtain a merged feature vector; Multiplying the combined eigenvector by the residual matrix to obtain a residual vector; Adding the residual vector to the quantitative feature vector or the output of the previous residual block to obtain a skip connection feature vector; Normalizing the skip connection feature vector to obtain the output of the residual block; The correlation matrix and the residual matrix are used as model parameters of the system performance prediction model.

[0014] Furthermore, the model structure of the system performance prediction model has an input layer and a feature preprocessing layer; The input layer is used to receive the cluster quantitative feature data and the cluster qualitative feature data; The feature preprocessing layer is used to preprocess the cluster quantitative feature data through a multi-layer perceptron MLP network to obtain a quantitative feature vector, and to generate a qualitative feature vector corresponding to the cluster qualitative feature data by looking up a label code.

[0015] Furthermore, the model structure of the system performance prediction model has a summary layer and an output layer; The summary layer is used to process the output of the residual block stacking layer through the MLP network to obtain the system performance prediction data; The output layer is used to output the system performance prediction data.

[0016] The present application also provides a computing power cluster system performance prediction device, including: The cluster data acquisition module is used to obtain the cluster feature data of the computing power cluster to be predicted; The system performance prediction module is used to predict the system performance of the computing power cluster to be predicted based on the cluster feature data and the system performance prediction model trained by the system performance prediction model training device to obtain system performance prediction data.

[0017] An embodiment of the present application also provides an electronic device, including a processor and a machine-readable storage medium, wherein the machine-readable storage medium stores machine-executable instructions that can be executed by the processor, and the processor is prompted by the machine-executable instructions to: implement any of the above-mentioned system performance prediction model training methods, or implement a computing power cluster system performance prediction method.

[0018] An embodiment of the present application also provides a computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, it implements any of the above-mentioned system performance prediction model training methods, or implements a computing power cluster system performance prediction method.

[0019] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any of the above-mentioned system performance prediction model training methods, or execute a computing power cluster system performance prediction method.

[0020] The beneficial effects of this application include: In the method provided in the embodiment of the present application, cluster feature data of a known computing power cluster is used as the input of a system performance prediction model, and the system performance prediction data output by the system performance prediction model is compared with the system performance data obtained by benchmarking the known computing power cluster to determine whether the current model training meets the convergence conditions. The trained system performance prediction model is obtained by repeated iterative training until the convergence conditions are met. In addition, the model structure of the system performance prediction model has a residual block stacking layer, and the residual block stacking layer includes residual blocks, so that the system performance prediction model can be used to accurately predict the system performance of the computing power cluster to be predicted based on the cluster feature data of the computing power cluster to be predicted.

[0021] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings are used to provide a further understanding of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings: Figure 1 A flowchart of a system performance prediction model training method provided in an embodiment of the present application; Figure 2 A flowchart of a computing power cluster system performance prediction method provided in an embodiment of the present application; Figure 3 This is a schematic diagram of the structure of the system performance prediction model in the embodiment of the present application; Figure 4 Schematic diagram of the structure of the residual block stacking layer of the system performance prediction model in the embodiment of the present application; Figure 5 This is a schematic diagram of the structure of a residual block of a residual block stacking layer in an embodiment of the present application; Figure 6 A schematic diagram of the structure of a system performance prediction model training device provided in an embodiment of the present application; Figure 7 A schematic diagram of the structure of a computing power cluster system performance prediction device provided in an embodiment of the present application; Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] In order to provide an implementation scheme for accurately predicting the system performance of a computing power cluster, the embodiments of the present application provide a system performance prediction model training method, a system performance prediction method and a device. The preferred embodiments of the present application are described below in conjunction with the drawings of the specification. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present application, and are not used to limit the present application. In addition, the embodiments in the present application and the features in the embodiments can be combined with each other if there is no conflict.

[0024] The present application embodiment provides a system performance prediction model training method, such as Figure 1 As shown, including: Step 11: Obtain sample feature data for training a system performance prediction model, where the sample feature data includes cluster feature data of a known computing power cluster and system performance data obtained by benchmarking the known computing power cluster; Step 12: input the cluster feature data into the system performance prediction model to obtain output system performance prediction data, wherein the model structure of the system performance prediction model has a residual block stacking layer, and the residual block stacking layer includes residual blocks; Step 13: Based on the system performance prediction data and the corresponding system performance data, determine whether the current model training meets the convergence condition; Step 14: If the convergence condition is met, determine that the training of the system performance prediction model is completed; if the convergence condition is not met, adjust the model parameters of the system performance prediction model and perform the next model training.

[0025] Accordingly, the present application also provides a computing power cluster system performance prediction method, such as Figure 2 As shown, including: 21. Obtain cluster feature data of the computing power cluster to be predicted; 22. Based on the cluster feature data, the system performance prediction model trained by the above-mentioned system performance prediction model training method is used to predict the system performance of the computing power cluster to be predicted, and obtain system performance prediction data.

[0026] The above method provided in the embodiment of the present application is adopted, and the cluster feature data of a known computing power cluster is used as the input of the system performance prediction model, and the system performance prediction data output by the system performance prediction model is compared with the system performance data obtained by benchmarking the known computing power cluster to determine whether the current model training meets the convergence conditions. Through repeated iterative training until the convergence conditions are met, a trained system performance prediction model is obtained. In addition, the model structure of the system performance prediction model has a residual block stacking layer, and the residual block stacking layer includes residual blocks, so that based on the cluster feature data of the computing power cluster to be predicted, the system performance prediction model can be used to accurately predict the system performance of the computing power cluster to be predicted.

[0027] The method and device provided by the present application are described in detail below with reference to the accompanying drawings using specific embodiments.

[0028] In the embodiment of the present application, the model structure of the system performance prediction model has a residual block stacking layer, such as Figure 3 As shown, there can also be an input layer, a feature preprocessing layer, a summary layer, and an output layer. The connection relationship between the layers is as follows Figure 3 As shown, the input layer, feature preprocessing layer, residual block stacking layer, summary layer and output layer are connected in sequence.

[0029] In the embodiment of the present application, the cluster feature data of the computing power cluster used as the model input may include cluster quantitative feature data and cluster qualitative feature data; The cluster quantitative feature data may specifically include: the number of processors, the number of accelerator cards, the memory size, the main frequency, etc., which are generally numerical data; Cluster qualitative feature data is feature data that cannot be quantified numerically, and may include: processor model, accelerator card model, chip architecture, process technology, instruction set type, etc., which are generally enumerated types.

[0030] In one embodiment of the present application, the input layer is used to receive cluster quantitative feature data and cluster qualitative feature data; The feature preprocessing layer is used to preprocess the cluster quantitative feature data output by the input layer through the MLP network to obtain a quantitative feature vector. Specifically, all cluster quantitative feature data can be merged into an initial numerical vector, the vector length of which is determined by the number of quantitative indicators actually selected, and then the numerical vector is preprocessed through the MLP network to obtain a 1*n quantitative feature vector; The feature preprocessing layer is also used to generate a qualitative feature vector corresponding to the cluster qualitative feature data by looking up the label code. Specifically, the label code is looked up to directly assign a corresponding value to the type represented by each cluster qualitative feature data to obtain a 1*n label vector. It can be randomly assigned at the beginning, as long as the subsequent assigned values ​​for the same type remain consistent. The label vector is the qualitative feature vector.

[0031] Through the input layer and the feature preprocessing layer, the input of the residual block stacking layer, namely the cluster quantitative feature vector and the cluster qualitative feature vector, is obtained.

[0032] In one embodiment of the present application, the residual block stacking layer may include a residual block, such as Figure 4As shown, the residual block stacking layer may also include multiple residual blocks connected in series, and each residual block has two inputs and one output, the inputs of the multiple residual blocks include a qualitative feature vector representing qualitative feature data of the cluster, another input of the first residual block is a quantitative feature vector representing quantitative feature data of the cluster, another input of other residual blocks except the first one is the output of the previous residual block connected, and the output of the last residual block is used as the output of the residual block stacking layer.

[0033] Further, such as Figure 5 As shown, the operations performed in the residual block include the following operations: Multiplying the qualitative feature vector by the correlation matrix to obtain a correlation vector, wherein the correlation matrix is ​​an n*n matrix and the obtained correlation vector is a 1*n vector; Add the associated vector to the quantitative feature vector or the output of the previous residual block to obtain a merged feature vector. In this operation, if the residual block is the first residual block, it is added to the quantitative feature vector. If it is a residual block other than the first residual block, it is added to the output of the previous residual block. The resulting merged feature vector is a 1*n vector, thereby realizing the merging of quantitative features and qualitative features. Multiply the merged eigenvector with the residual matrix to obtain a residual vector, where the residual matrix is ​​an n*n matrix and the obtained residual vector is a 1*n vector; The residual vector is added to the quantitative feature vector or the output of the previous residual block to obtain a skip connection feature vector. In this operation, if the residual block is the first residual block, it is added to the quantitative feature vector. If it is a residual block other than the first residual block, it is added to the output of the previous residual block. The obtained skip connection feature vector is a 1*n vector, thereby realizing a skip connection between the vector residual vector and the quantitative feature vector or the output of the previous residual block; Normalize the skip connection feature vector to obtain the output of the residual block; Among them, the correlation matrix and the residual matrix are the model parameters of the system performance prediction model, which will be adjusted through continuous iterations during the model training process.

[0034] In one embodiment of the present application, Figure 3 As shown, the model structure of the system performance prediction model has a summary layer and an output layer; The summary layer is used to process the output of the residual block stacking layer through the MLP network to obtain system performance prediction data. Specifically, the n-dimensional feature vector can be processed into an m-dimensional performance indicator vector, where m represents the number of system performance indicators. The performance indicators can be temperature, power consumption, throughput, inference latency, inference accuracy, etc. The output layer is used to output system performance prediction data. The output layer can be one or more neurons, corresponding to each system performance indicator that needs to be output.

[0035] In the embodiment of the present application, during the model training process, after obtaining the output system performance prediction data, it is determined whether the current model training meets the convergence condition based on the system performance prediction data and the corresponding system performance data obtained by the benchmark test; In one embodiment of the present application, specifically, the mean square error (MSE) can be used as the loss function to train the model, that is, to determine whether the current model training has converged, and the formula is as follows: L=1 / N*Σ(Y_pred - Y_true)^2, where Y_pred is the system performance prediction data output by the model, Y_true is the actual system performance data obtained by the benchmark test, and N is the number of samples; Accordingly, if the convergence condition is met, it is determined that the training of the system performance prediction model is completed; if the convergence condition is not met, the model parameters of the system performance prediction model are adjusted, and the next model training is performed; Specifically, gradient descent or its variants (such as Adam optimizer) can be used to minimize the loss function and update the model parameters, mainly including the parameters of the MLP network of the feature preprocessing layer, the residual matrix and correlation matrix of the residual block stacking layer, and the parameters of the MLP network of the summary layer.

[0036] Based on the same inventive concept, according to the system performance prediction model training method provided in the above embodiment of the present application, correspondingly, another embodiment of the present application also provides a system performance prediction model training device, whose structural schematic diagram is shown in FIG. Figure 6 As shown, specifically including: A sample data acquisition module 61 is used to acquire sample feature data for training a system performance prediction model, wherein the sample feature data includes cluster feature data of a known computing power cluster and system performance data obtained by benchmarking the known computing power cluster; A system performance prediction module 62, configured to input the cluster feature data into the system performance prediction model to obtain output system performance prediction data, wherein the model structure of the system performance prediction model has a residual block stacking layer, and the residual block stacking layer includes residual blocks; A convergence judgment module 63 is used to determine whether the current model training meets the convergence condition based on the system performance prediction data and the corresponding system performance data; The model training module 64 is used to determine that the training of the system performance prediction model is completed if the convergence condition is met, and to adjust the model parameters of the system performance prediction model and perform the next model training if the convergence condition is not met.

[0037] Furthermore, the cluster feature data includes: cluster quantitative feature data and cluster qualitative feature data; The residual block stacking layer includes a plurality of residual blocks connected in series; Each of the residual blocks has two inputs and one output; The inputs of the plurality of residual blocks each include a qualitative feature vector representing the qualitative feature data of the cluster; Another input of the first residual block is a quantitative feature vector representing the quantitative feature data of the cluster, another input of the residual blocks other than the first one is the output of the connected previous residual block, and the output of the last residual block is used as the output of the residual block stacking layer.

[0038] Furthermore, the operations performed in the residual block include the following operations: Multiplying the qualitative feature vector by the correlation matrix to obtain a correlation vector; Adding the association vector to the quantitative feature vector or the output of the previous residual block to obtain a merged feature vector; Multiplying the combined eigenvector by the residual matrix to obtain a residual vector; Adding the residual vector to the quantitative feature vector or the output of the previous residual block to obtain a skip connection feature vector; Normalizing the skip connection feature vector to obtain the output of the residual block; The correlation matrix and the residual matrix are used as model parameters of the system performance prediction model.

[0039] Furthermore, the model structure of the system performance prediction model has an input layer and a feature preprocessing layer; The input layer is used to receive the cluster quantitative feature data and the cluster qualitative feature data; The feature preprocessing layer is used to preprocess the cluster quantitative feature data through a multi-layer perceptron MLP network to obtain a quantitative feature vector, and to generate a qualitative feature vector corresponding to the cluster qualitative feature data by looking up a label code.

[0040] Furthermore, the model structure of the system performance prediction model has a summary layer and an output layer; The summary layer is used to process the output of the residual block stacking layer through the MLP network to obtain the system performance prediction data; The output layer is used to output the system performance prediction data.

[0041] Based on the same inventive concept, according to the computing power cluster system performance prediction method provided in the above embodiment of the present application, correspondingly, another embodiment of the present application also provides a computing power cluster system performance prediction device, whose structural schematic diagram is shown as follows: Figure 7 As shown, specifically including: The cluster data acquisition module 71 is used to acquire cluster characteristic data of the computing power cluster to be predicted; The system performance prediction module 72 is used to predict the system performance of the computing power cluster to be predicted based on the cluster feature data and the system performance prediction model trained by the system performance prediction model training device to obtain system performance prediction data.

[0042] The functions of the above modules can correspond to Figure 1 and Figure 2 The corresponding processing steps in the shown process will not be repeated here.

[0043] The system performance prediction model training device and computing power cluster system performance prediction device provided in the embodiments of the present application can be implemented by a computer program. Those skilled in the art should be able to understand that the above-mentioned module division method is only one of many module division methods. If it is divided into other modules or not divided into modules, as long as the system performance prediction model training device and computing power cluster system performance prediction device have the above-mentioned functions, they should be within the protection scope of the present application.

[0044] The present application also provides an electronic device, such as Figure 8 As shown, it includes a processor 81 and a machine-readable storage medium 82, and the machine-readable storage medium 82 stores machine-executable instructions that can be executed by the processor 81. The processor 81 is prompted by the machine-executable instructions to: implement any of the above-mentioned system performance prediction model training methods, or implement a computing power cluster system performance prediction method.

[0045] An embodiment of the present application also provides a computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, it implements any of the above-mentioned system performance prediction model training methods, or implements a computing power cluster system performance prediction method.

[0046] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any of the above-mentioned system performance prediction model training methods, or execute a computing power cluster system performance prediction method.

[0047] The machine-readable storage medium in the electronic device may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the processor.

[0048] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0049] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device, electronic device, computer-readable storage medium, and computer program product embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0050] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0051] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0052] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0053] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0054] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A system performance prediction model training method, characterized in that: include: Acquire sample feature data for training a system performance prediction model, the sample feature data including cluster feature data of a known computing power cluster and system performance data obtained by benchmarking the known computing power cluster; Inputting the cluster feature data into the system performance prediction model to obtain output system performance prediction data, wherein the model structure of the system performance prediction model has a residual block stacking layer, and the residual block stacking layer includes residual blocks; Based on the system performance prediction data and the corresponding system performance data, determining whether this model training meets the convergence condition; If the convergence condition is met, it is determined that the training of the system performance prediction model is completed; if the convergence condition is not met, the model parameters of the system performance prediction model are adjusted and the next model training is performed.

2. The method according to claim 1, characterized in that The cluster feature data includes: cluster quantitative feature data and cluster qualitative feature data; The residual block stacking layer includes a plurality of residual blocks connected in series; Each of the residual blocks has two inputs and one output; The inputs of the plurality of residual blocks each include a qualitative feature vector representing the qualitative feature data of the cluster; Another input of the first residual block is a quantitative feature vector representing the quantitative feature data of the cluster, another input of the residual blocks other than the first one is the output of the connected previous residual block, and the output of the last residual block is used as the output of the residual block stacking layer.

3. The method according to claim 2, characterized in that The operations performed in the residual block include the following operations: Multiplying the qualitative feature vector by the correlation matrix to obtain a correlation vector; Adding the association vector to the quantitative feature vector or the output of the previous residual block to obtain a merged feature vector; Multiplying the combined eigenvector by the residual matrix to obtain a residual vector; Adding the residual vector to the quantitative feature vector or the output of the previous residual block to obtain a skip connection feature vector; Normalizing the skip connection feature vector to obtain the output of the residual block; The correlation matrix and the residual matrix are used as model parameters of the system performance prediction model.

4. The method according to claim 2, characterized in that The model structure of the system performance prediction model comprises an input layer and a feature preprocessing layer; The input layer is used to receive the cluster quantitative feature data and the cluster qualitative feature data; The feature preprocessing layer is used to preprocess the cluster quantitative feature data through a multi-layer perceptron MLP network to obtain a quantitative feature vector, and to generate a qualitative feature vector corresponding to the cluster qualitative feature data by looking up a label code.

5. The method according to claim 2, characterized in that The model structure of the system performance prediction model has a summary layer and an output layer; The summary layer is used to process the output of the residual block stacking layer through the MLP network to obtain the system performance prediction data; The output layer is used to output the system performance prediction data.

6. A computing power cluster system performance prediction method, characterized in that: include: Obtain cluster feature data of the computing power cluster to be predicted; Based on the cluster feature data, a system performance prediction model trained by the method described in any one of claims 1 to 5 is used to predict the system performance of the computing power cluster to be predicted, thereby obtaining system performance prediction data.

7. A system performance prediction model training device, characterized in that: include: A sample data acquisition module, used to acquire sample feature data for training a system performance prediction model, wherein the sample feature data includes cluster feature data of a known computing power cluster and system performance data obtained by benchmarking the known computing power cluster; A system performance prediction module, used for inputting the cluster feature data into the system performance prediction model to obtain output system performance prediction data, wherein the model structure of the system performance prediction model has a residual block stacking layer, and the residual block stacking layer includes residual blocks; A convergence judgment module, used to determine whether the current model training meets the convergence condition based on the system performance prediction data and the corresponding system performance data; The model training module is used to determine that the training of the system performance prediction model is completed if the convergence condition is met, and if the convergence condition is not met, adjust the model parameters of the system performance prediction model and perform the next model training.

8. A computing power cluster system performance prediction device, characterized in that: include: The cluster data acquisition module is used to obtain the cluster feature data of the computing power cluster to be predicted; A system performance prediction module is used to predict the system performance of the computing power cluster to be predicted based on the cluster feature data and the system performance prediction model trained by the device described in claim 7 to obtain system performance prediction data.

9. An electronic device, characterized in that: The invention comprises a processor and a machine-readable storage medium, wherein the machine-readable storage medium stores machine-executable instructions that can be executed by the processor, and the processor is prompted by the machine-executable instructions to implement any one of the methods described in claims 1-5, or to implement the method described in claim 6.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of claims 1 to 5 is implemented, or the method described in claim 6 is implemented.

Images