Cloud service quality evaluation method and device, electronic equipment and storage medium

By obtaining and filtering cloud service provider data, building a dynamic cloud service quality model, combining weighted average and digital twin technology to evaluate cloud service quality, the cloud service quality evaluation problem is solved in different application scenarios, and the accuracy of cloud service quality evaluation is achieved. Authenticity.

CN119026976APending Publication Date: 2024-11-26CHINA TELECOM CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410985599.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-22
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

It is difficult for the existing technology to effectively screen and evaluate cloud service quality data, especially when cloud service characteristics and service quality requirements are different in different application scenarios, resulting in increasing difficulty in assessing cloud service quality.

Method used

By obtaining the data set of all cloud service providers, determining the high-quality probability value of cloud service based on the preset high-quality score line, selecting the target cloud service provider, and training the cloud service quality data based on the preset service quality model to build a dynamic cloud Service quality model, conduct cloud service quality evaluation. This method combines weighted average and digital twin technology to evaluate the quality of the simulation data, and uses indicators such as model accuracy, root mean square error, variance interpretation rate and Pearson correlation coefficient to evaluate the accuracy of the model.

Benefits of technology

It realizes dynamic adjustment of evaluation indicators based on specific cloud service application scenarios and user preferences, and accurately conducts cloud service quality evaluation, improves the accuracy and authenticity of cloud service quality evaluation, and overcomes the problem of differentiation between simulated data and real data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119026976A_ABST
    Figure CN119026976A_ABST
Patent Text Reader

Abstract

The invention discloses a cloud service quality evaluation method and apparatus, an electronic device and a storage medium. The method comprises the steps of obtaining a data set of all cloud service providers; the data set comprises cloud service provider data of each cloud service provider; based on the cloud service provider data, determining a cloud service high-quality probability value of each cloud service provider through a preset high-quality score line; taking the cloud service provider with the highest cloud service high-quality probability value as a target cloud service provider; obtaining cloud service quality data in the target application scene from the cloud service provider data of the target cloud service provider; based on a preset service quality model, training the service quality model according to the index data of the cloud service quality data under the target quality dimension, and completing training to obtain a cloud service quality model; and performing cloud service quality evaluation on the to-be-evaluated cloud service through the cloud service quality model to obtain a cloud service quality evaluation result. The method can accurately evaluate the cloud service quality, and can be widely applied to the technical field of data processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a cloud service quality evaluation method, device, electronic device and storage medium. Background Art

[0002] Since some QoS (Quality of Service) data of cloud services involve the commercial secrets and interests of various cloud service providers, and some qualitative QoS indicator data depends on the overall evaluation of a large number of cloud users, which is difficult to obtain in real time, many scholars at home and abroad use MATLAB to input, trim, process and simulate service QoS data when verifying Web services and cloud service QoS models. The simulation experiment results show that the QoS data simulated in the MATLAB environment can effectively verify the established QoS model. However, the characteristics of cloud services in different application scenarios are different, and the corresponding requirements for cloud services in various quality dimensions are also different. Therefore, how to screen service quality data to assist cloud service quality evaluation is an urgent problem to be solved. Summary of the invention

[0003] The present invention provides a cloud service quality evaluation method, device, electronic device and storage medium, aiming to solve one of the technical problems in the related art at least to a certain extent.

[0004] On the one hand, an embodiment of the present invention provides a cloud service quality evaluation method, including:

[0005] Obtain a data set of all cloud service providers; the data set includes cloud service provider data of each cloud service provider;

[0006] Based on the cloud service provider data, the cloud service high quality probability value of each cloud service provider is determined through the preset high quality score line; the cloud service provider with the highest cloud service high quality probability value is selected as the target cloud service provider;

[0007] Obtain cloud service quality data for the target application scenario from the cloud service provider data of the target cloud service provider;

[0008] Based on the preset service quality model, the service quality model is trained according to the indicator data of the cloud service quality data under the target quality dimension, and the cloud service quality model is obtained after the training is completed;

[0009] The cloud service quality model is used to evaluate the cloud service quality of the cloud service to be evaluated, and the cloud service quality evaluation result is obtained.

[0010] Optionally, the method further comprises the following steps:

[0011] Based on the cloud service provider data of each cloud service provider and combined with the preset weight for each cloud service provider, a weighted average is performed, and the result of the weighted average is set as the high quality score line.

[0012] Optionally, the cloud service provider data includes all service quality scores of the cloud service providers; based on the cloud service provider data, determining the cloud service high quality probability value of each cloud service provider through a preset high quality score line includes the following steps:

[0013] A service quality score set is obtained by sorting the service quality scores in the cloud service provider data;

[0014] Determine, based on the high quality score line, the number of high-quality service quality scores in the service quality score set that are greater than the high quality score line;

[0015] The ratio of the number of high-quality scores to the total number of service quality scores in the service quality score set is taken as the high-quality probability value of the cloud service of the cloud service provider.

[0016] Optionally, obtaining a service quality score set according to the service quality scores in the cloud service provider data includes the following steps:

[0017] A preset number of service quality scores generated recently are obtained from the cloud service provider data, and the service quality score set is obtained by sorting them.

[0018] Optionally, the method further comprises the following steps:

[0019] Based on the preset candidate cloud services, the target quality dimension is obtained by screening the cloud service quality data among all candidate cloud services according to the service quality attribute priority and / or indicator relevance;

[0020] Among them, the target quality dimensions include security, service performance, service characteristics and commerciality.

[0021] Optionally, the cloud service provider data is simulation data; the method further comprises the following steps:

[0022] Based on the performance monitoring data of the cloud service provider in each cloud service application scenario, the simulation data of the cloud service provider is obtained through simulation software.

[0023] Optionally, the cloud service provider data is simulation data; the method further comprises the following steps:

[0024] Use digital twin technology to evaluate the quality of training results of cloud service quality models based on simulation data;

[0025] Among them, the evaluation indicators of quality assessment include model accuracy, root mean square error, variance explanation rate and Pearson correlation coefficient.

[0026] On the other hand, an embodiment of the present invention provides a cloud service quality evaluation device, including:

[0027] The first module is used to obtain a data set of all cloud service providers; the data set includes cloud service provider data of each cloud service provider;

[0028] The second module is used to determine the cloud service high quality probability value of each cloud service provider based on the cloud service provider data and through a preset high quality score line; the cloud service provider with the highest cloud service high quality probability value is selected as the target cloud service provider;

[0029] The third module is used to obtain cloud service quality data under the target application scenario from the cloud service provider data of the target cloud service provider;

[0030] The fourth module is used to train the service quality model based on the preset service quality model according to the indicator data of the cloud service quality data under the target quality dimension, and obtain the cloud service quality model after completing the training;

[0031] The fifth module is used to evaluate the cloud service quality of the cloud service to be evaluated through the cloud service quality model to obtain the cloud service quality evaluation result.

[0032] Optionally, the device further comprises:

[0033] The sixth module is used to perform weighted averaging based on the cloud service provider data of each cloud service provider in combination with the preset weight for each cloud service provider, and set the result of the weighted averaging as the high-quality score line.

[0034] Optionally, the device further comprises:

[0035] The seventh module is used to obtain a target quality dimension based on the preset candidate cloud services and the service quality attribute priorities and / or indicator relevance of all candidate cloud services according to the cloud service quality data;

[0036] Among them, the target quality dimensions include security, service performance, service characteristics and commerciality.

[0037] Optionally, the cloud service provider data is simulation data; the device further includes:

[0038] The eighth module is used to obtain the simulation data of the cloud service provider through simulation software based on the performance monitoring data of the cloud service provider in each cloud service application scenario.

[0039] Optionally, the cloud service provider data is simulation data; the device further includes:

[0040] The ninth module is used to evaluate the quality of the training results of the cloud service quality model obtained based on simulation data through digital twin technology;

[0041] Among them, the evaluation indicators of quality assessment include model accuracy, root mean square error, variance explanation rate and Pearson correlation coefficient.

[0042] On the other hand, an embodiment of the present invention provides an electronic device, including: a processor and a memory; the memory is used to store programs; the processor executes the program to implement the above-mentioned cloud service quality evaluation method.

[0043] On the other hand, an embodiment of the present invention provides a computer storage medium, in which a program executable by a processor is stored. When the program executable by the processor is executed by the processor, it is used to implement the above-mentioned cloud service quality evaluation method.

[0044] The embodiment of the present invention obtains a data set of all cloud service providers; the data set includes cloud service provider data of each cloud service provider; based on the cloud service provider data, the cloud service high quality probability value of each cloud service provider is determined by a preset high quality score line; the cloud service provider with the highest cloud service high quality probability value is used as the target cloud service provider; the cloud service quality data under the target application scenario is obtained from the cloud service provider data of the target cloud service provider; based on the preset service quality model, the service quality model is trained according to the indicator data of the cloud service quality data under the target quality dimension, and the cloud service quality model is obtained after the training is completed; the cloud service quality is evaluated for the cloud service to be evaluated through the cloud service quality model, and the cloud service quality evaluation result is obtained. According to the different characteristics of cloud services in different application scenarios, the corresponding requirements for cloud services in various quality dimensions are also different. The embodiment of the present invention selects evaluation indicators based on the high quality score line to construct a cloud service quality model, so that the evaluation indicators retained under each quality dimension change accordingly according to the service characteristics and user preferences in the specific cloud service application scenario. The present invention can accurately evaluate the quality of cloud services. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings are used to provide a further understanding of the technical solution of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the technical solution of the present invention and do not constitute a limitation on the technical solution of the present invention.

[0046] Figure 1 A schematic diagram of an implementation environment for cloud service quality evaluation provided by an embodiment of the present invention;

[0047] Figure 2 A flowchart of a cloud service quality evaluation method provided by an embodiment of the present invention;

[0048] Figure 3 A flowchart of an extended example 1 of the cloud service quality evaluation method provided in an embodiment of the present invention;

[0049] Figure 4A schematic diagram of an expanded process of calculating a high quality probability value of a cloud service provided by an embodiment of the present invention;

[0050] Figure 5 A flowchart of an extended example 2 of the cloud service quality evaluation method provided in an embodiment of the present invention;

[0051] Figure 6 A schematic diagram of the CSERVQUAL model establishment process provided by an embodiment of the present invention;

[0052] Figure 7 A schematic diagram of the conceptual structure of the quality dimension of the CSERVQUAL model provided in an embodiment of the present invention;

[0053] Figure 8 A flowchart of an extended example 3 of the cloud service quality evaluation method provided in an embodiment of the present invention;

[0054] Fig. 9 A schematic diagram of the structure of a cloud service quality evaluation device provided by an embodiment of the present invention;

[0055] Fig.10 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0057] It should be noted that, although the functional modules are divided in the system schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the system or the order in the flowchart. The terms "first / S100", "second / S200", etc. in the specification, claims and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0058] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0059] It is understandable that the cloud service quality evaluation method provided in the embodiment of the present invention can be applied to any computer device with data processing and computing capabilities, and this computer device can be various terminals or servers. When the computer device in the embodiment is a server, the server is an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Optionally, the terminal is a smart phone, tablet computer, laptop computer, desktop computer, etc., but is not limited to this.

[0060] To facilitate the understanding of the technical solution of the present invention, the technical feature terms that may appear in the embodiments of the present invention are first explained:

[0061] QoS (Quality of Service) is the quality of service. Under limited bandwidth resources, QoS allocates bandwidth to various services and provides end-to-end service quality assurance for the services. For example, voice, video and important data applications can be given priority in network devices by configuring QoS.

[0062] Cloud service refers to the Internet service provided to users by large-scale server clusters (cloud) using cloud computing technology, which does not require downloading or installation, can be used online, is easy to operate, has rich functions, and is low-cost.

[0063] Digital twins make full use of physical models, sensor updates, operation history and other data, integrate multi-disciplinary, multi-physical quantity, multi-scale, and multi-probability simulation processes, complete mapping in virtual space, and thus reflect the entire life cycle of the corresponding physical equipment.

[0064] like Figure 1 FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present invention. Figure 1 The implementation environment includes at least one terminal 102 and a server 101. The terminal 102 and the server 101 can be connected to a network wirelessly or wired to complete data transmission and exchange.

[0065] Server 101 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.

[0066] In addition, the server 101 can also be a node server in the blockchain network. Blockchain is a new application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, and encryption algorithm.

[0067] The terminal 102 may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto. The terminal 102 and the server 101 may be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiment of the present invention.

[0068] Based on the example Figure 1 In the implementation environment shown, an embodiment of the present invention provides a cloud service quality evaluation method. The following is explained using the cloud service quality evaluation method applied to the terminal 102 as an example. It can be understood that the cloud service quality evaluation method can also be applied to the server 101.

[0069] Reference Figure 2 , Figure 2 The flowchart of the cloud service quality evaluation method applied to a terminal (for example, the terminal may be a DPU) provided in an embodiment of the present invention, the execution subject of the cloud service quality evaluation method may be any of the aforementioned computer devices (including a server or a terminal). Figure 2 , the method comprises the following steps:

[0070] S100, obtaining data sets of all cloud service providers;

[0071] Wherein, the data set includes cloud service provider data of each cloud service provider;

[0072] For example, in some specific implementations, first, the cloud service provider data set can be extracted from the log. When the cloud service provider data adopts simulation data, the relevant data set can be extracted from the log list of the simulation result.

[0073] S200, based on the cloud service provider data, determine the cloud service high quality probability value of each cloud service provider through a preset high quality score line; and select the cloud service provider with the highest cloud service high quality probability value as the target cloud service provider;

[0074] Among them, in some embodiments, such as Figure 3 As shown, the method may further include the following steps: S600, performing weighted averaging based on the cloud service provider data of each cloud service provider in combination with a preset weight for each cloud service provider, and setting the result of the weighted averaging as a high quality score line.

[0075] For example, in some specific implementations, the preset weights can be adaptively adjusted according to the importance of each cloud service provider in the actual application scenario. For example, if two cloud service providers are used, for example, the cloud services provided by cloud service provider A cover 70% of the cloud service application scenarios, and the cloud services provided by cloud service provider B cover the other 30% of the cloud service application scenarios, then the preset weight of cloud service provider A can be set to 0.7, and the preset weight of cloud service provider B can be set to 0.3. The weighted average processing is specifically for the service quality score in the cloud service provider data.

[0076] It should be noted that the cloud service provider data includes all service quality scores of the cloud service provider; in some embodiments, such as Figure 4 As shown, based on the cloud service provider data, the high quality probability value of the cloud service of each cloud service provider is determined by a preset high quality score line, which can include the following steps: S201, obtaining a service quality score set according to the service quality scores in the cloud service provider data; S202, determining the number of high-quality service quality scores in the service quality score set that are greater than the high quality score line based on the high quality score line; S203, taking the ratio of the high-quality number to the total number of service quality scores in the service quality score set as the cloud service high quality probability value of the cloud service provider.

[0077] In some embodiments, obtaining a service quality score set based on the service quality scores in the cloud service provider data may include the following steps: obtaining a preset number of service quality scores generated recently from the cloud service provider data, and obtaining a service quality score set.

[0078] Exemplarily, in some specific implementations, the data of the ten most recent cloud service providers can be obtained, and the high quality above the high quality score line is increased by 1, and vice versa. Then, the high quality ratio of the ten most recent cloud services is determined as the high quality probability value of the next cloud service, and finally the cloud service provider with the highest cloud service high quality probability value is determined to give priority to CSERVQUAL model (i.e., cloud service quality model) training.

[0079] S300, obtaining cloud service quality data in a target application scenario from cloud service provider data of a target cloud service provider;

[0080] Exemplarily, in some specific implementations, corresponding cloud service provider data can be extracted from the target cloud service provider based on a determined cloud service application scenario (as a target application scenario); wherein, when the cloud service application scenario sends a change, the corresponding cloud service provider data is extracted from the target cloud service provider again based on the determined target application scenario.

[0081] S400, based on a preset service quality model, the service quality model is trained according to the indicator data of the cloud service quality data under the target quality dimension, and the cloud service quality model is obtained after the training is completed;

[0082] Among them, in some embodiments, such as Figure 5 As shown, the method may also include the following steps: S700, based on the preset candidate cloud services, filter the target quality dimensions according to the service quality attribute priorities and / or indicator correlations of all candidate cloud services according to the cloud service quality data; wherein the target quality dimensions include security, service performance, service characteristics and commerciality.

[0083] For example, in some specific implementations, the CSERVQUAL model (i.e., cloud service quality model) establishment process is as follows: Figure 6 As shown, specifically, SERVQUAL is the abbreviation of "Service Quality" in English. The SERVQUAL model is a tool for measuring service quality, and its five scales are tangibility, reliability, responsiveness, trust, and empathy. The CSERVQUAL model established in the embodiment of the present invention can be specifically defined based on the SERVQUAL model based on the selected evaluation indicators, and then established through training.

[0084] Specifically, the screening evaluation indicators are based on the predetermined candidate cloud services by calculating the QoS attribute priorities and the correlation analysis of the evaluation indicators, and then a comprehensive judgment is made based on the calculated / analyzed ranking results (for example, each candidate cloud service is weightedly integrated in the two sequence results, and the four with the highest scores are used as the target quality dimensions) to determine the evaluation indicators corresponding to the target quality dimensions.

[0085] Finally, we get Figure 7 The 4-dimensional CSERVQUAL model shown in the figure takes cloud service security, service performance, service characteristics, and commerciality as quality dimensions. a, b, c, and d are the number of indicators selected from the corresponding four quality attributes. The established cloud service Qos evaluation indicator system and dynamic parameters show that a+b+c+d=10. Among them, Q s Q stands for cloud service security. P represents cloud service performance, Q F Represents cloud service characteristics, Q B Represents the commercial nature of cloud services.

[0086] In some embodiments, the cloud service provider data is simulation data; the method may further include the following steps: based on the performance monitoring data of the cloud service provider in each cloud service application scenario, the simulation data of the cloud service provider is obtained by simulation software.

[0087] For example, in some specific implementations, the simulation software is a publicly recognized criterion calculation software. Since some QoS data of cloud services involve the commercial secrets and interests of various cloud service providers, and some qualitative QoS indicator data depends on the overall evaluation of a large number of cloud users after use, which is difficult to obtain in real time, many scholars at home and abroad use MATLAB to input, trim, process and simulate service QoS data when verifying Web services and cloud service QoS models. The simulation experiment results show that the QoS data simulated in the MATLAB environment can effectively verify the established QoS model.

[0088] In some embodiments, the cloud service provider data is simulation data; Figure 8 As shown, the method may also include the following steps: S800, performing a quality assessment on the training results of the cloud service quality model obtained based on the simulation data through digital twin technology; wherein the evaluation indicators of the quality assessment include model accuracy, root mean square error, variance explanation rate and Pearson correlation coefficient.

[0089] For example, in some specific implementations, the cloud service provider simulation data currently generated by simulation software is still quite different from the real cloud service provider cloud service data, resulting in the cloud service QoS evaluation of the CSERVQUAL model training data calculation results not being able to truly reflect the service quality of the cloud service provider. The embodiment of the present invention innovatively uses digital twin technology to obtain four indicators of model accuracy ratio (MAR), root mean square error (RMSE), variance interpretation rate (VIR) and PPMCC (Pearson correlation coefficient) for the cloud service provider simulation data to comprehensively evaluate whether the quality of the simulation data participating in the CSERVQUAL model training results is close to the real cloud service provider data results.

[0090] In order to evaluate the convergence speed of each evaluation index under different algorithms and observe the convergence process, the fitting error can be used, as shown in formula (1). The true value and absolute value of FE are displayed by the curve to compare the efficiency of different algorithms. y1 is the true value of the training data group, is the predicted value. The smaller the absolute value of FE is, the better.

[0091]

[0092] Specifically, the digital twin model is trained with different machine training data sets. The data set that is not used for training is called the validation set. Through the validation set and reasonable validation indicators, the quality of different models can be compared and the optimal model can be found. That is, the digital twin model for production control. The digital twin model will be combined with real-time lloT data for simulation and optimization, and an optimization plan will be proposed for production line control.

[0093] In order to comprehensively evaluate the quality of the digital production model, the following four evaluation criteria are used for a comprehensive evaluation in multiple dimensions, including model accuracy ratio (MAR), root mean square error (RMSE), variance interpretation rate (VIR) and PPMCC. The calculation of the indicators is shown in formulas (2) to (4). For example, the output of a specified product, x is the predicted label (independent variable). y1 is the true value of the validation data set, is the average value, is the predicted value calculated by the trained model.

[0094]

[0095] (Formula 2) is the calculation formula of MAR, which is the difference between 1 and the first-order deviation rate. MAR can reflect the deviation between the predicted result and the actual value. The larger the MAR, the better, and the maximum value is 1.

[0096]

[0097] (Equation 3) is the calculation formula of RMSE. RMSE is based on the quadratic distance between the actual value and the predicted value and is used to evaluate the performance of the regression model. The smaller the RMSE, the better, and the minimum value is 0.

[0098]

[0099] (Formula 4) is the calculation formula of VIR, which is transformed by the coefficient of determination. In the manufacturing industry, the target prediction value usually fluctuates within a range much smaller than its absolute value. In this case, even a random prediction with an average historical value will appear to have a "very good" MAR accuracy level. Therefore, the VIR index is used to evaluate the degree to which the model prediction is better than the random prediction. When the value is greater than 0, the model prediction is better than the random prediction. The larger the VIR, the better, and the maximum value is 1.

[0100] Among them, in statistics, the Pearson correlation coefficient, also known as the Pearson product-moment correlation coefficient (PPMCC or PCCs for short), is used to measure the correlation (linear correlation) between two variables X and Y, and its value is between -1 and 1. Specifically, the Pearson correlation coefficient between two variables is defined as the quotient of the covariance and standard deviation between the two variables.

[0101] S500: Perform cloud service quality evaluation on the cloud service to be evaluated by using a cloud service quality model to obtain a cloud service quality evaluation result.

[0102] In order to explain the principle of the technical solution of the present invention in detail, the overall process of the present invention is described below in combination with some specific embodiments. It is easy to understand that the following is an explanation of the technical principle of the present invention and cannot be regarded as a limitation of the present invention.

[0103] First of all, it should be noted that the simulation data is used to simulate the real cloud service, but both the simulation data and the model are still different from the real cloud service, which affects the accuracy of the cloud service quality evaluation. Innovative First, according to the different characteristics of cloud services in different application scenarios, the corresponding requirements for cloud services in various quality dimensions are also different, so a dynamic cloud service Qos evaluation CSERVQUAL model is established. Based on the dynamic screening evaluation indicators, the cloud service Q0os model (Cloud Service Quality Model, CSERVQUAL) is constructed. The evaluation indicators retained under each quality dimension change dynamically according to the service characteristics and user preferences in the specific cloud service application scenario. And simulation software is used to simulate the production of simulation data. Finally, the current cloud service provider simulation data generated by the simulation software is still very different from the real cloud service provider cloud service data, which causes the cloud service Qos evaluation of the CSERVQUAL model training data calculation results to not truly reflect the service quality of the cloud service provider. Innovatively adopt digital twin technology to evaluate the quality of the simulation data of cloud service providers through model accuracy ratio (MAR), root mean square error (RMSE), variance interpretation rate (VIR) and PPMCC to obtain four indicators to comprehensively evaluate whether the quality of the simulation data participating in the CSERVQUAL model training results is close to the real cloud service provider data results. The overall process is as follows:

[0104] Step 1: According to the different characteristics of cloud services in different application scenarios, the corresponding requirements for cloud services in various quality dimensions are also different, so a dynamic cloud service QoS evaluation CSERVQUAL model is established. The cloud service QoS model (Cloud Service Quality Model, CSERVQUAL) is constructed based on dynamic screening evaluation indicators. The evaluation indicators retained under each quality dimension change dynamically according to the service characteristics and user preferences in the specific cloud service application scenario. Simulation software is used to simulate the production simulation data.

[0105] Step 2: Currently, the cloud service provider simulation data generated by simulation software is still quite different from the real cloud service provider cloud service data, which results in the cloud service QoS evaluation of the CSERVQUAL model training data calculation results not being able to truly reflect the service quality of cloud service providers. The digital twin technology is innovatively used to comprehensively evaluate whether the quality of the simulation data participating in the CSERVQUAL model training results is close to the real cloud service provider data results by obtaining four indicators: model accuracy ratio (MAR), root mean square error (RMSE), variance interpretation rate (VIR) and PPMCC.

[0106] Specifically, the technical innovation of step one is: in order to improve computing efficiency and save model computing resources, the high-quality probability prediction method of cloud service providers is used to give priority to CSERVQUAL model training for high-quality cloud service providers.

[0107] The implementation process of the cloud service provider's high-quality probability prediction method is as follows:

[0108] S1. First, extract the cloud service provider data set from the log and take weighted average to obtain a high-quality score.

[0109] S2. Secondly, obtain the data of the most recent ten cloud service providers. If the quality score is above the high quality score line, add 1; otherwise, add 1 if the quality is low.

[0110] S3. The high-quality ratio of the last ten cloud services is used as the probability value of the next cloud service being of high quality.

[0111] S4. Cloud service providers with the highest probability of high quality of cloud services are given priority for CSERVQUAL model training.

[0112] Finally get Figure 7The four-dimensional CSERVQUAL model with cloud service security, service performance, service characteristics, and commerciality as quality dimensions is shown. a, b, c, and d are the number of measured indicators selected from the corresponding four quality attributes. The established cloud service QoS evaluation indicator system and dynamic parameters show that a+b+c+d=10.

[0113] Among them, simulation software is a criterion calculation software recognized by the public. Since some QoS data of cloud services involve the commercial secrets and interests of various cloud service providers, and some qualitative QoS indicator data depends on the overall evaluation of a large number of cloud users after use, it is difficult to obtain in real time. Therefore, many scholars at home and abroad use MATLAB to input, trim, process and simulate service QoS data when verifying Web services and cloud service QoS models. The simulation experiment results show that the QoS data simulated in the MATLAB environment can effectively verify the established QoS model.

[0114] For example, in some specific implementations, based on the research on cloud service quality evaluation and combined with the service characteristics of each cloud service scenario, referring to the performance monitoring data of CloudHarmony (a website tracking company under Gartner, which tracks and records the cloud service operation of 86 cloud service providers at home and abroad, thereby providing objective, fair and reliable cloud service quality analysis) on well-known cloud service providers at home and abroad, a group of service quality data of suppliers providing similar cloud service products are simulated in the MATLAB environment. Simulation experiment hardware environment: CPU15-3230M dual-core processor, 4GBDDR3 memory, 500GB hard disk. Simulation experiment software environment: MATLAB 2016a, Windows7. The 6 simulated cloud service providers are: CSP1, CSP2, CSP3, CSP4, CSP5, CSP6. An example of a quality data set for cloud services is shown in Table 1.

[0115] Table 1

[0116]

[0117] Among them, the meanings of each indicator in Table 1 are as follows: Q SL , confirm receipt; Q DM stands for "Quality Assurance, Documentation and Maintenance"; Q VS , customer satisfaction; Q CA , supplier system audit; Q Rell Quality Reliability: This usually refers to the stability of the service quality provided by the cloud service provider. RUQuality Urgency: This metric may measure the cloud service provider's ability to handle unexpected problems or urgent requests. Aval Quality Availability: Quality availability. This refers to the continuity and accessibility of services provided by cloud service providers. RT Quality Response Time: This metric measures the speed at which cloud service providers respond to user requests. Cust , customer question;Q Inter , internal issues; Q Expa , extended question; Q Elas , electronic lasers; "Q Sca "refers to "Quarterly Scale" or a company's specific product or service code; "Q Price " refers to "Quarterly Price" (quarterly price); "Q Rep " is the abbreviation of "Quarterly Report"; Pena " refers to "Quarterly Penalty" or other penalty-related fees. Specific indicator parameters can be adaptively adjusted according to actual application scenarios. The above parameters are only examples of some implementation methods.

[0118] Specifically, the technical innovation of step two is: using digital twin technology to obtain four indicators of model accuracy ratio (MAR), root mean square error (RMSE), variance interpretation rate (VIR) and PPMCC for the cloud service provider's simulation data to comprehensively evaluate whether the quality of the simulation data participating in the CSERVQUAL model training results is close to the real cloud service provider data results.

[0119] In order to evaluate the convergence speed of each evaluation index under different algorithms and observe the convergence process, the fitting error can be used, as shown in formula (1). The true value and absolute value of FE are displayed by the curve to compare the efficiency of different algorithms. y1 is the true value of the training data group, is the predicted value. The smaller the absolute value of FE is, the better.

[0120]

[0121] Specifically, the digital twin model is trained with different machine training data sets. The data set that is not used for training is called the validation set. Through the validation set and reasonable validation indicators, the quality of different models can be compared and the optimal model can be found. That is, the digital twin model for production control. The digital twin model will be combined with real-time lloT data for simulation and optimization, and an optimization plan will be proposed for production line control.

[0122] In order to comprehensively evaluate the quality of the digital production model, the following four evaluation criteria are used for a comprehensive evaluation in multiple dimensions, including model accuracy ratio (MAR), root mean square error (RMSE), variance interpretation rate (VIR) and PPMCC. The calculation of the indicators is shown in formulas (2) to (4). For example, the output of a specified product, x is the predicted label (independent variable). y1 is the true value of the validation data set, is the average value, is the predicted value calculated by the trained model.

[0123]

[0124] (Formula 2) is the calculation formula of MAR, which is the difference between 1 and the first-order deviation rate. MAR can reflect the deviation between the predicted result and the actual value. The larger the MAR, the better, and the maximum value is 1.

[0125]

[0126] (Equation 3) is the calculation formula of RMSE. RMSE is based on the quadratic distance between the actual value and the predicted value and is used to evaluate the performance of the regression model. The smaller the RMSE, the better, and the minimum value is 0.

[0127]

[0128] (Formula 4) is the calculation formula of VIR, which is transformed by the coefficient of determination. In the manufacturing industry, the target prediction value usually fluctuates within a range much smaller than its absolute value. In this case, even a random prediction with an average historical value will appear to have a "very good" MAR accuracy level. Therefore, the VIR index is used to evaluate the degree to which the model prediction is better than the random prediction. When the value is greater than 0, the model prediction is better than the random prediction. The larger the VIR, the better, and the maximum value is 1.

[0129] Among them, in statistics, the Pearson correlation coefficient, also known as the Pearson product-moment correlation coefficient (PPMCC or PCCs for short), is used to measure the correlation (linear correlation) between two variables X and Y, and its value is between -1 and 1. Specifically, the Pearson correlation coefficient between two variables is defined as the quotient of the covariance and standard deviation between the two variables.

[0130] In summary, the present invention belongs to the field of cloud computing. The simulation data is used to simulate the real cloud service, but both the simulation data and the model are still different from the real cloud service, which affects the accuracy of the cloud service quality evaluation. Innovatively, according to the different characteristics of cloud services in different application scenarios, the corresponding requirements for cloud services in various quality dimensions are also different, so a dynamic cloud service Qos evaluation CSERVQUAL model is established. The cloud service Qos model (Cloud Service Quality Model, CSERVQUAL) is constructed based on dynamic screening evaluation indicators. The evaluation indicators retained under each quality dimension change dynamically according to the service characteristics and user preferences in the specific cloud service application scenario. And simulation software is used to simulate the production of simulation data. Finally, the difference between the simulation data of cloud service providers currently generated by simulation software and the cloud service data of real cloud service providers is still large, resulting in the cloud service Qos evaluation of the CSERVQUAL model training data calculation results cannot truly reflect the service quality of cloud service providers. The innovative use of digital twin technology to evaluate the quality of the CSERVQUAL model training results of the simulated data of cloud service providers through four indicators: model accuracy ratio (MAR), root mean square error (RMSE), variance interpretation rate (VIR) and PPMCC. Compared with the existing technology, it has at least the following beneficial effects:

[0131] 1. According to the different characteristics of cloud services in different application scenarios, the corresponding requirements for cloud services in various quality dimensions are also different, so a dynamic cloud service QoS evaluation CSERVQUAL model is established. The cloud service QoS model (Cloud Service Quality Model, CSERVQUAL) is constructed based on dynamic screening evaluation indicators. The evaluation indicators retained under each quality dimension change dynamically according to the service characteristics and user preferences in the specific cloud service application scenario. Simulation software is used to simulate production simulation data.

[0132] 2. Currently, the cloud service provider simulation data generated by simulation software is still quite different from the real cloud service provider cloud service data, which results in the cloud service QoS evaluation of the CSERVQUAL model training data calculation results not being able to truly reflect the service quality of cloud service providers. The innovative use of digital twin technology to comprehensively evaluate whether the quality of the simulation data participating in the CSERVQUAL model training results is close to the real cloud service provider data results by obtaining four indicators: model accuracy ratio (MAR), root mean square error (RMSE), variance interpretation rate (VIR) and PPMCC.

[0133] On the other hand, Fig. 9 As shown, an embodiment of the present invention provides a cloud service quality evaluation device 900, including:

[0134] The first module 910 is used to obtain a data set of all cloud service providers; the data set includes cloud service provider data of each cloud service provider;

[0135] The second module 920 is used to determine the cloud service high quality probability value of each cloud service provider based on the cloud service provider data and through a preset high quality score line; and the cloud service provider with the highest cloud service high quality probability value is used as the target cloud service provider;

[0136] The third module 930 is used to obtain cloud service quality data in a target application scenario from cloud service provider data of a target cloud service provider;

[0137] The fourth module 940 is used to train the service quality model based on the preset service quality model according to the indicator data of the cloud service quality data under the target quality dimension, and obtain the cloud service quality model after completing the training;

[0138] The fifth module 950 is used to evaluate the cloud service quality of the cloud service to be evaluated by using the cloud service quality model to obtain the cloud service quality evaluation result.

[0139] In some embodiments, the apparatus may further include:

[0140] The sixth module is used to perform weighted averaging based on the cloud service provider data of each cloud service provider in combination with the preset weight for each cloud service provider, and set the result of the weighted averaging as the high-quality score line.

[0141] In some embodiments, the apparatus may further include:

[0142] The seventh module is used to obtain a target quality dimension based on the preset candidate cloud services and the service quality attribute priorities and / or indicator relevance of all candidate cloud services according to the cloud service quality data;

[0143] Among them, the target quality dimensions include security, service performance, service characteristics and commerciality.

[0144] In some embodiments, the cloud service provider data is simulation data; the apparatus may further include:

[0145] The eighth module is used to obtain the simulation data of the cloud service provider through simulation software based on the performance monitoring data of the cloud service provider in each cloud service application scenario.

[0146] In some embodiments, the cloud service provider data is simulation data; the apparatus may further include:

[0147] The ninth module is used to evaluate the quality of the training results of the cloud service quality model obtained based on simulation data through digital twin technology;

[0148] Among them, the evaluation indicators of quality assessment include model accuracy, root mean square error, variance explanation rate and Pearson correlation coefficient.

[0149] The contents of the method embodiments of the present invention are all applicable to the device embodiments. The functions specifically implemented by the device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0150] On the other hand, an embodiment of the present invention further provides an electronic device, the electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the above sensitive information method when executing the computer program. The electronic device can be any intelligent terminal including a tablet computer, a car computer, etc.

[0151] It can be understood that the contents of the above method embodiments are all applicable to the present device embodiments, the functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0152] like Fig.10 As shown, Fig.10 A specific example of the hardware structure of an electronic device according to an embodiment is shown, and the electronic device includes:

[0153] The processor 1001 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present invention.

[0154] The memory 1002 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 1002 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 1002, and the processor 1001 calls and executes the network node population optimization method of the embodiment of the present invention;

[0155] Input / output interface 1003, used to implement information input and output;

[0156] The communication interface 1004 is used to realize the communication interaction between the device and other devices. The communication can be realized through a wired manner (such as USB, network cable, etc.) or a wireless manner (such as mobile network, WIFI, Bluetooth, etc.);

[0157] A bus 1005 , which transmits information between various components of the device (e.g., the processor 1001 , the memory 1002 , the input / output interface 1003 , and the communication interface 1004 );

[0158] The processor 1001 , the memory 1002 , the input / output interface 1003 and the communication interface 1004 are connected to each other in communication within the device via the bus 1005 .

[0159] The electronic device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0160] The contents of the method embodiments of the present invention are all applicable to the electronic device embodiments. The functions specifically implemented by the electronic device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0161] Another aspect of an embodiment of the present invention further provides a computer-readable storage medium, wherein the storage medium stores a program, and the program is executed by a processor to implement the above method.

[0162] It should be noted that the computer-readable medium shown in the embodiment of the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (Compact Disc Read to Only Memory, CD to ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0163] The contents of the method embodiments of the present invention are all applicable to the computer-readable storage medium embodiments. The functions specifically implemented by the computer-readable storage medium embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0164] The embodiment of the present invention also discloses a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device can read the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the above method.

[0165] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0166] It should be noted that, although several modules of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0167] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD to ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation of the present invention.

[0168] In some selectable embodiments, the function / operation mentioned in the block diagram may not occur in the order mentioned in the operation diagram. For example, depending on the function / operation involved, the two boxes shown in succession can actually be executed substantially simultaneously or the boxes can sometimes be executed in reverse order. In addition, the embodiment presented and described in the flow chart of the present invention is provided by way of example, for the purpose of providing a more comprehensive understanding of technology. The disclosed method is not limited to the operation and logic flow presented herein. Selectable embodiments are expected, wherein the order of various operations is changed and the sub-operation of a part for which is described as a larger operation is performed independently.

[0169] In addition, although the present invention is described in the context of functional modules, it should be understood that, unless otherwise specified, one or more of the functions and / or features can be integrated into a single physical device and / or software module, or one or more functions and / or features can be implemented in a separate physical device or software module. It is also understood that a detailed discussion of the actual implementation of each module is unnecessary for understanding the present invention. More specifically, in view of the properties, functions and internal relationships of the various functional modules in the device disclosed herein, the actual implementation of the module will be understood within the conventional skills of the engineer. Therefore, those skilled in the art can implement the present invention set forth in the claims without excessive experimentation using ordinary techniques. It is also understood that the specific concepts disclosed are merely illustrative and are not intended to limit the scope of the present invention, which is determined by the full scope of the appended claims and their equivalents.

[0170] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0171] The logic and / or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer-readable medium for use by an instruction execution device, apparatus or device (such as a computer-based device, a device including a processor, or other device that can fetch instructions from an instruction execution device, apparatus or device and execute the instructions), or in conjunction with such instruction execution device, apparatus or device. For purposes of this specification, "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution device, apparatus or device, or in conjunction with such instruction execution device, apparatus or device.

[0172] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a computer memory.

[0173] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution device. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0174] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0175] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

[0176] The above is a specific description of the preferred implementation of the present invention, but the present invention is not limited to the embodiments. Those skilled in the art can make various equivalent modifications or substitutions without violating the spirit of the present invention. These equivalent modifications or substitutions are all included in the scope defined by the claims of the present invention.

Claims

1. A cloud service quality evaluation method, characterized in that: The following steps are involved: Obtaining a data set of all cloud service providers; the data set includes cloud service provider data of each of the cloud service providers; Based on the cloud service provider data, determine the cloud service high quality probability value of each cloud service provider through a preset high quality score line; and select the cloud service provider with the highest cloud service high quality probability value as the target cloud service provider; Acquire cloud service quality data in a target application scenario from the cloud service provider data of the target cloud service provider; Based on a preset service quality model, the service quality model is trained according to the indicator data of the cloud service quality data under the target quality dimension, and the cloud service quality model is obtained after the training is completed; The cloud service quality model is used to evaluate the cloud service quality of the cloud service to be evaluated, and a cloud service quality evaluation result is obtained.

2. The cloud service quality evaluation method according to claim 1, characterized in that: The method further comprises the following steps: Based on the cloud service provider data of each of the cloud service providers, a weighted average is performed in combination with a preset weight for each of the cloud service providers, and a result of the weighted average is set as the high quality score line.

3. The cloud service quality evaluation method according to claim 1, characterized in that: The cloud service provider data includes all service quality scores of the cloud service providers; the method of determining the cloud service high quality probability value of each cloud service provider based on the cloud service provider data through a preset high quality score line includes the following steps: Obtaining a service quality score set according to the service quality scores in the cloud service provider data; Determine, based on the high quality score line, a high quality number of the service quality scores in the service quality score set that are greater than the high quality score line; The ratio of the high-quality number to the total number of the service quality scores in the service quality score set is used as the cloud service high-quality probability value of the cloud service provider.

4. The cloud service quality evaluation method according to claim 3, characterized in that: The step of arranging the service quality scores in the cloud service provider data to obtain a service quality score set includes the following steps: A preset number of the service quality scores generated most recently are obtained from the cloud service provider data, and are sorted to obtain a service quality score set.

5. The cloud service quality evaluation method according to claim 1, characterized in that: The method further comprises the following steps: Based on the preset candidate cloud services, the target quality dimension is obtained by screening the cloud service quality data among the service quality attribute priorities and / or indicator correlations of all the candidate cloud services; Among them, the target quality dimensions include security, service performance, service characteristics and commerciality.

6. The cloud service quality evaluation method according to claim 1, characterized in that: The cloud service provider data is simulation data; the method further comprises the following steps: Based on the performance monitoring data of the cloud service provider in each cloud service application scenario, the simulation data of the cloud service provider is obtained through simulation software.

7. The cloud service quality evaluation method according to claim 1, characterized in that: The cloud service provider data is simulation data; the method further comprises the following steps: Performing a quality assessment of training results of the cloud service quality model obtained based on the simulation data by using digital twin technology; The quality assessment indicators include model accuracy, root mean square error, variance explanation rate and Pearson correlation coefficient.

8. A cloud service quality evaluation device, characterized in that: include: The first module is used to obtain the data set of all cloud service providers; The data set includes cloud service provider data of each of the cloud service providers; The second module is used to determine the cloud service high quality probability value of each cloud service provider through a preset high quality score line based on the cloud service provider data; The cloud service provider with the highest cloud service high quality probability value is selected as the target cloud service provider; A third module is used to obtain cloud service quality data under a target application scenario from the cloud service provider data of the target cloud service provider; A fourth module is used to train the service quality model based on a preset service quality model according to the indicator data of the cloud service quality data under the target quality dimension, and obtain the cloud service quality model after completing the training; The fifth module is used to evaluate the cloud service quality of the cloud service to be evaluated by using the cloud service quality model to obtain the cloud service quality evaluation result.

9. An electronic device, characterized in that: including a processor and a memory; The memory is used to store programs; The processor executes the program to implement the method according to any one of claims 1 to 7.

10. A computer storage medium storing a program executable by a processor, characterized in that: The program executable by the processor is used to implement the method according to any one of claims 1 to 7 when executed by the processor.