Service quality evaluation method, device, computer equipment and storage medium

Abstract

The present application relates to a service quality evaluation method, device, computer equipment and storage medium. The method includes: determining at least one system link in the target system; each system link is determined according to the connection relationship between each service node in the target system; for each system link, obtaining the first request received by the external interface of the system link; performing performance evaluation on the system link according to the response of each service node in the system link to the first request, and obtaining the performance evaluation result corresponding to the system link; performing quality evaluation on the target system according to the performance evaluation result corresponding to at least one system link, and obtaining the service quality evaluation result. The use of this method can improve the accuracy of service quality evaluation.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a service quality evaluation method, apparatus, computer equipment and storage medium. Background Art

[0002] With the development of computer technology, various service systems have emerged, and these systems play an important role in daily life and work. For example, online service systems use computer technology to provide online shopping, online education, online medical services, etc., bringing more convenience to daily life.

[0003] In traditional technology, the quality of system services is evaluated by evaluating the quality of the system's functional modules. However, simply evaluating the functional modules cannot fully understand the quality of system services and cannot avoid the problem of low accuracy in service quality evaluation. Summary of the invention

[0004] Based on this, it is necessary to provide a service quality evaluation method, device, computer equipment, computer-readable storage medium and computer program product that can improve accuracy in response to the above technical problems.

[0005] In a first aspect, the present application provides a method for evaluating service quality, comprising:

[0006] Determine at least one system link in the target system; each system link is determined according to a connection relationship between each service node in the target system;

[0007] For each system link, obtaining a first request received by an external interface of the system link;

[0008] According to the response of each service node in the system link to the first request, the system link is subjected to performance evaluation to obtain a performance evaluation result corresponding to the system link;

[0009] The quality of the target system is evaluated according to the performance evaluation results respectively corresponding to at least one system link to obtain a service quality evaluation result.

[0010] In a second aspect, the present application also provides a service quality evaluation device, including:

[0011] A determination module, used to determine at least one system link in the target system; each system link is determined according to the connection relationship between each service node in the target system;

[0012] An acquisition module, used for acquiring, for each system link, a first request received by an external interface of the system link;

[0013] A performance evaluation module, used to perform performance evaluation on the system link according to the response of each service node in the system link to the first request, and obtain a performance evaluation result corresponding to the system link;

[0014] The quality evaluation module is used to perform quality evaluation on the target system according to the performance evaluation results respectively corresponding to at least one system link to obtain a service quality evaluation result.

[0015] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps in the above method when executing the computer program.

[0016] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, which implements the steps in the above method when the computer program is executed by a processor.

[0017] In a fifth aspect, the present application also provides a computer program product, including a computer program, which implements the steps in the above method when executed by a processor.

[0018] The above-mentioned service quality evaluation method, device, computer equipment, storage medium and computer program product, the target system can often realize different functions, and the realization of each function is inseparable from the communication of each service node in the target system, and these service nodes constitute a complete system link. By determining at least one system link in the target system; each system link is determined according to the connection relationship between each service node in the target system; for each system link, the first request received by the external interface of the system link is obtained; according to the response of each service node in the system link to the first request, the system link is evaluated for performance, and the performance evaluation result corresponding to the system link is obtained, which can perform a preliminary performance evaluation at the level of the entire system link according to the response of the service node to the first request; and then at the level of the entire target system, the overall service quality evaluation is performed according to the performance evaluation results corresponding to at least one system link, and a more comprehensive service quality evaluation result is obtained, thereby improving the accuracy of the service quality evaluation. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0020] Figure 1 An application environment diagram of a service quality evaluation method provided in an embodiment of the present application;

[0021] Figure 2 A flowchart of a service quality evaluation method provided in an embodiment of the present application;

[0022] Figure 3 A schematic diagram of a system link provided in an embodiment of the present application;

[0023] Figure 4 A structural block diagram of a service quality evaluation device provided in an embodiment of the present application;

[0024] Figure 5 An internal structure diagram of a computer device provided in an embodiment of the present application;

[0025] Figure 6 This is an internal structure diagram of another computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0027] The service quality evaluation method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the terminal 102 communicates with the server 104 through the network. The data storage system can store the data that the server 104 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other network servers. The server 104 can determine at least one system link in the target system; for each system link, obtain the first request received by the external interface of the system link; according to the response of each service node in the system link to the first request, perform a performance evaluation on the system link to obtain a performance evaluation result corresponding to the system link; perform a quality evaluation on the target system according to the performance evaluation result corresponding to at least one system link, and obtain a service quality evaluation result. The server 104 can send the service quality evaluation result to the terminal 102 for display.

[0028] The terminal 102 may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, IoT devices, and portable wearable devices. The IoT devices may be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. The portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. The server 104 may be implemented as an independent server or a server cluster consisting of multiple servers.

[0029] In some embodiments, Figure 2 As shown, a method for evaluating quality of service is provided, and the method is described by taking the method applied to a computer device as an example. The computer device may include at least one of a terminal or a server, and includes the following steps 202 to 208. Among them:

[0030] Step 202, determining at least one system link in the target system; each system link is determined according to the connection relationship between each service node in the target system.

[0031] Among them, the target system includes at least two service nodes. The service node may include at least one of a client node, a gateway node, a server node or a third-party system node. The connection relationship between the service nodes constitutes the service architecture of the target system. It can be understood that each system link is used to implement different specific functions, and different system links involve different connection relationships. The connection relationship between the service nodes is used to realize data exchange. This data exchange can include various forms, such as at least one of state sharing, event transmission or request response.

[0032] Exemplarily, the computer device may determine at least one system link according to the connection relationship between each service node in the target system. It is understandable that in the data exchange process, the connection relationship determines the path of data transmission. For example, the computer device may use the data exchange path formed from the request receiving node to the end node as a system link. The request receiving node may be, but is not limited to, a client node. The end node may be, but is not limited to, a service end node or a third-party system node.

[0033] In some embodiments, each system link includes a client node, a gateway node and a server node. It is understandable that data will pass through at least one gateway node from the client node to the server node, and at least one gateway node can be connected in series between the client node and the server node. A system link may include at least one server node. At least one gateway node in the system link constitutes a gateway layer, and at least one server node constitutes a system service layer. Among them, the client node is user-oriented and is responsible for receiving user input, such as obtaining requests for external interfaces. The gateway layer mainly plays the role of data transmission and is responsible for forwarding requests and responses. The system service layer is the core business processing layer of the target system, which includes various services and components for processing the system business logic. The system service layer receives requests from the gateway layer, processes them according to the business logic, and returns responses to the gateway layer. The system service layer usually includes various business services, data access services, message services and other components for processing various business needs of the target system.

[0034] Step 204: For each system link, obtain a first request received by an external interface of the system link.

[0035] Exemplarily, the target system may provide at least two external interfaces. The external interfaces of each system link are different. The computer device may determine each external interface of each system link, and obtain the first request received by the external interface for each external interface of each system link. It can be understood that the first request refers to the request received by the external interface.

[0036] In some embodiments, the external interface may include a communication interface, such as a Hypertext Transfer Protocol (HTTP) interface.

[0037] Step 206: Perform performance evaluation on the system link according to the response of each service node in the system link to the first request, and obtain a performance evaluation result corresponding to the system link.

[0038] The performance evaluation result is used to characterize the performance of the system link at the interface level. It can be understood that the better the performance of each service node on the system link at the interface level, the shorter the response time of each service node to the first request and the higher the number of successful processing.

[0039] Exemplarily, the first request received by the external interface will pass through at least one service node in the system link. For example, the first request can penetrate the client node, the gateway layer and the system service layer. It can be understood that the user can access the external interface through the client node, so the client node can obtain the first request initiated for the external interface, and the first request is transmitted to the system service layer through the forwarding of the gateway layer. The computer device can determine whether the external interface receiving the first request meets the standards at each service node in the system link according to the response of the service node to the first request.

[0040] In some embodiments, the system link may include a third-party system node. The target system interacts with the third-party system node through a third-party interface provided by the third-party system node. For example, the response process of the third-party system to the first request may include: the target system initiates a second request to the third-party interface in response to the first request, and the third-party system node responds to the received second request. The second request may be the first request forwarded by the target system to the third-party system node, or it may be a new request initiated by the target system.

[0041] Step 208: Perform quality evaluation on the target system according to the performance evaluation result corresponding to at least one system link to obtain a service quality evaluation result.

[0042] Among them, the service quality evaluation results are used to characterize the service quality of the target system at the interface level.

[0043] Exemplarily, the computer device may perform a data statistical operation on the performance evaluation results corresponding to each system link to obtain a service quality evaluation result. The data statistical operation may include at least one of constructing an orthogonal table or performing an average calculation.

[0044] In some embodiments, the interface performance evaluation result may include an average response time and a processing success rate corresponding to the external interface. The computer device may perform a quality evaluation on the target system by comparing the performance evaluation results corresponding to each system link.

[0045] For example, suppose an e-commerce system has three main system links: user registration, product search, and order payment. The interface performance evaluation results for the user registration system link are: the average response time is 2 seconds; the registration success rate is 90%. The interface performance evaluation results for the product search system link are: the average response time is 500 milliseconds; the search success rate is 95%. The interface performance evaluation results for the order payment system link are: the average response time is 2 seconds; the payment success rate is 97%. Based on the above data, the service quality of the target system can be comprehensively evaluated: the response time of the user registration system link is fast, but the registration success rate is low, and the user registration process may need to be further optimized to improve the registration success rate. The performance of the product search system link is good, the interface response time is short, and the search success rate is high, which meets the user's expectations. The response time of the order payment system link is long, but the payment success rate is high, and the performance of the payment interface may need to be optimized to improve the response speed.

[0046] In some embodiments, the performance evaluation result may include the number of qualified interfaces, that is, the number of qualified external interfaces among the external interfaces of the system link. The computer device performs a quality evaluation on the target system by comparing the total number of external interfaces corresponding to each system link and the number of qualified interfaces to obtain a service quality evaluation result. It can be understood that the more the total number of external interfaces corresponding to a system link and the fewer the number of qualified interfaces, the worse the performance of the system link.

[0047] In some embodiments, the performance evaluation result may include the number of qualified interfaces corresponding to each service node in the system link. It is understood that for each service node in a system link, the more the total number of external interfaces corresponding to the system link and the fewer the number of qualified interfaces corresponding to the service node, the worse the interface service quality on the service node.

[0048] In some embodiments, each system link includes different service nodes. These service nodes constitute the client layer, the gateway layer and the system service layer respectively. The computer device can determine the first quality evaluation result according to the compliance of the external interface from the client layer to each service node in the system service layer. The second quality evaluation result is determined according to the compliance of the external interface from the gateway layer to each service node in the system service layer. The third quality evaluation result is determined according to the compliance of the external interface on each service node in the system service layer. The performance evaluation result corresponding to the system link is determined according to the first quality evaluation result, the second quality evaluation result and the third quality evaluation result.

[0049] In some embodiments, Figure 3 As shown, a schematic diagram of the system link is provided. The system link includes a client node, a gateway node 1, a gateway node N, a server node 1, a server node N and a third-party system node. Each gateway node constitutes the gateway layer in the system link. After the gateway layer is the system service layer composed of the server node and the third-party system node. The compliance interface of each service node in the entire system link from the client node to the system service layer determines the user-oriented service quality. The compliance interface from the gateway layer to the service node in the system service layer determines the business-oriented service quality. The compliance node of each service node in the system service layer determines the system development quality. By combining the user-oriented service quality, business-oriented service quality and system development quality of each system link, a more comprehensive service quality evaluation result can be obtained.

[0050] In the above service quality evaluation method, the target system can often realize different functions, and the realization of each function is inseparable from the communication of each service node in the target system, and these service nodes constitute a complete system link. By determining at least one system link in the target system; each system link is determined according to the connection relationship between each service node in the target system; for each system link, the first request received by the external interface of the system link is obtained; according to the response of each service node in the system link to the first request, the system link is evaluated for performance, and the performance evaluation result corresponding to the system link is obtained, which can perform a preliminary performance evaluation at the level of the entire system link according to the response of the service node to the first request; and then at the level of the entire target system, the overall service quality evaluation is performed according to the performance evaluation results corresponding to at least one system link, so as to obtain a more comprehensive service quality evaluation result and improve the accuracy of the service quality evaluation.

[0051] In some embodiments, determining at least one system link in a target system includes: determining at least one application product of the target system; wherein each application product is implemented through a system link composed of at least one service node in the target system; and determining a system link corresponding to each application product from the target system.

[0052] It can be understood that the target system is a whole, consisting of the client, gateway layer and system service layer. The target system provides an infrastructure and platform to support the implementation and operation of a variety of application products. The target system is responsible for processing the core functions of application products such as requests, logic and data processing.

[0053] For example, the target system can support multiple application products, each of which has different functions, so each of which corresponds to a different system link. The computer device can divide the system link corresponding to each application product from the target system.

[0054] In some embodiments, the target system may be, but is not limited to, a production environment system. In the field of self-developed software systems, a production environment system refers to an environment for deploying and running software products. It includes all hardware devices and software platforms used to run software, as well as all middleware and infrastructure used to support software operation. The roles of the above-mentioned hardware devices, software platforms, and middleware in the system can be at least one of a client node, a gateway node, a server node, or a third-party system node, and can be used to form at least one system link.

[0055] In this embodiment, at least one application product of the target system is determined; the system link corresponding to each application product is determined from the target system, and then an evaluation is performed at the application product level to obtain a performance evaluation result, and then based on the performance evaluation result, an evaluation is performed at the target system level to obtain a more comprehensive service quality evaluation result, thereby improving the accuracy of the service quality evaluation.

[0056] In some embodiments, for each system link, a first request received by an external interface of the system link is obtained, including: for each external interface in each system link, each first request received by the external interface is obtained; based on the response of each service node in the system link to the first request, a performance evaluation is performed on the system link to obtain a performance evaluation result corresponding to the system link, including: for each service node in the system link, based on preset interface performance indicators and the response of the service node to each first request, determining whether the external interface meets the standards at the service node; determining the qualified interface at the service node from each external interface of the system link; and determining the performance evaluation result corresponding to the system link based on the qualified interface at each service node.

[0057] The preset interface performance index refers to a standard for evaluating the performance of an external interface at a service node. Different service nodes have different corresponding preset interface performance indexes.

[0058] Exemplarily, each system link may have multiple external interfaces. Each external interface may receive multiple first requests. The computer device may obtain each first request received by the external interface for each external interface in each system link. At least one service node in the system link will respond to the first request received by the external interface. For each service node, determine whether the external interface meets the standard at the service node based on the preset interface performance indicator corresponding to the service node and the response of the service node to each first request. If the external interface meets the standard at the service node, the external interface is the standard interface of the service node. It can be understood that not every service node will respond to the same first request, so the standard interface of each service node may be different. The computer device can determine the performance evaluation result corresponding to the system link by comparing the external interface of the system link and the standard interface of each service node in the system link.

[0059] In this embodiment, each first request received by each external interface in each system link is obtained; based on the preset interface performance indicators and the response of each service node in the system link to each first request, it is determined whether the external interface meets the standards at the service node; the qualified interface at the service node is determined from each external interface; and the performance evaluation result corresponding to the system link is determined based on the qualified interface at each service node, so that the interface performance can be accurately evaluated at the system link level.

[0060] In some embodiments, the preset interface performance indicator includes a first indicator value under the availability indicator item and a second indicator value under the response time indicator item; for each service node in the system link, based on the preset interface performance indicator and the response of the service node to each first request, determine whether the external interface meets the standard at the service node, including: for each service node in the system link, determine the first quantitative value under the availability indicator item according to the number of first requests successfully processed by the service node; determine the second quantitative value under the response time indicator item according to the response time of the service node to each first request; when the first quantitative value reaches the first indicator value and the second quantitative value reaches the second indicator value, it is determined that the external interface meets the standard at the service node.

[0061] Exemplarily, the availability index may be, but is not limited to, the ratio of the number of first requests to the total number of first requests. For each first request received by an external interface, the number of first requests refers to the number of first requests successfully processed by the service node, and the total number of first requests refers to the total number of first requests responded to by the service node. It can be understood that the number of first requests and the total number of first requests for different external interfaces on different service nodes may be different. For each service node in the system link, the computer device can obtain the response status code of the service node for each first request. The response status code is used to indicate whether the first request is successfully processed. The number of first requests is counted according to the response status code for each request, and the ratio of the number of first requests to the total number of first requests is used as the first quantitative value.

[0062] The response time indicator may be, but is not limited to, the response time of the first request of a preset proportion. For each service node in the system link, the computer device may determine the response time of the service node for each first request, calculate the maximum response time among the response times of the first requests of the preset proportion, and use the maximum response time as the second quantized value. When the first quantized value reaches the first indicator value and the second quantized value reaches the second indicator value, it is determined that the external interface is a qualified interface at the service node.

[0063] In some embodiments, the external interface may include a hypertext transfer protocol interface. The response status code may include a 200 status code. For the performance evaluation of the external interface at a service node, the calculation method of the availability index item may be: the number of 200 status code requests / the total number of requests on the day.

[0064] The preset ratio may be, but is not limited to, 90%. For the performance evaluation of the external interface at a service node, the response time index item may be calculated as: max (response time of 90% of the requests).

[0065] Each service node has different preset interface performance indicators. For example:

[0066] The first gateway node is set as follows: first indicator value: 99%; second indicator value: 500ms.

[0067] The Nth gateway node is set as: first indicator value: 99%; second indicator value: 500ms.

[0068] The settings on the client node are: first indicator value: 90%; second indicator value: 3000ms.

[0069] The server node is set as follows: first indicator value: 99.9%; second indicator value: 300ms.

[0070] The third-party system node is set as follows: first indicator value: 99%; second indicator value: 1000ms.

[0071] In some embodiments, the first quantization value reaches the first index value means that the first quantization value is not less than the first index value. The second quantization value reaches the second index value means that the second quantization value is less than the second index value.

[0072] In this embodiment, for each service node in the system link, a first quantitative value under the availability index item is determined according to the number of first requests successfully processed by the service node; a second quantitative value under the response time index item is determined according to the response time of the service node to each first request; and when the first quantitative value reaches the first index value and the second quantitative value reaches the second index value, it is determined that the external interface meets the standards at the service node, so that the performance of the external interface on the service node of the system link can be accurately evaluated.

[0073] In some embodiments, the performance evaluation result corresponding to each system link includes the number of qualified interfaces; the number of qualified interfaces is used to characterize the number of external interfaces that meet the preset interface performance indicators; the target system is quality evaluated according to the performance evaluation results corresponding to at least one system link to obtain a service quality evaluation result, including: constructing an orthogonal table according to the number of qualified interfaces corresponding to each system link; and the target system is quality evaluated according to the orthogonal table to obtain a service quality evaluation result.

[0074] Exemplarily, the computer device may construct an orthogonal table according to the total number of external interfaces of each system link and the corresponding number of qualified interfaces. The computer device may analyze the data in the orthogonal table using a statistical analysis method, which may include at least one of variance analysis, regression analysis, or chi-square test, to analyze the degree and manner of influence of each service node in each system link on the target system service quality, and obtain a service quality evaluation result.

[0075] In some embodiments, the computer device can output and display an orthogonal table, and a quality assessor can manually perform a quality assessment on the target system according to the orthogonal table and input the service quality assessment result into the computer device, so that the computer device can obtain the service quality assessment result.

[0076] In this embodiment, an orthogonal table is constructed according to the number of qualified interfaces corresponding to each system link; quality evaluation is performed on the target system according to the orthogonal table to obtain a service quality evaluation result, which can effectively improve the efficiency of quality evaluation.

[0077] In some embodiments, the number of qualified interfaces corresponding to the system link includes the number of qualified interfaces in each service node in the system link; an orthogonal table is constructed according to the number of qualified interfaces corresponding to each system link, including: constructing an orthogonal table according to the number of external interfaces corresponding to each system link and the number of qualified interfaces in each service node in each system link.

[0078] Exemplarily, the computer device can use each service node in the target system as a column factor, and determine the number of levels of each column factor according to the number of qualified interfaces on the service node in the system link corresponding to each application product, so as to construct an orthogonal table. It can be understood that the total number of external interfaces can also be used as a column factor, and the corresponding number of levels is the number of external interfaces of each system link.

[0079] In some embodiments, the service node includes a third-party system node and a non-third-party system node. The computer device may use the number of qualified interfaces on the non-third-party system node in the system link corresponding to each application product as the level number of the corresponding column factor. The computer device may determine the total number of third-party interfaces of the third-party system node in each system link, and use the ratio between the total number of third-party interfaces and the number of qualified third-party interfaces on the third-party system node in the system link as the level number of the corresponding column factor.

[0080] In some embodiments, Table 1 is an orthogonal table.

[0081]

[0082] The number before the horizontal number “ / ” under the third-party system node represents the number of third-party interfaces that meet the standards, and the number after the “ / ” represents the total number of third-party interfaces.

[0083] In this embodiment, an orthogonal table is constructed according to the number of external interfaces corresponding to each system link and the number of qualified interfaces in each system link at each service node, and quality assessment is performed based on the orthogonal table to improve the efficiency of quality assessment.

[0084] In some embodiments, the service nodes in the system link include third-party system nodes and non-third-party system nodes; the non-third-party system node initiates a second request to the third-party interface of the third-party system node in response to the first request; and the performance evaluation result corresponding to the system link includes the compliance status of the third-party interface in the system link. According to the response of each service node in the system link to the first request, the system link is performance evaluated to obtain the performance evaluation result corresponding to the system link, including: determining the compliance status of the third-party interface in the system link according to the response of the third-party system node in the system link to the second request.

[0085] It can be understood that when a non-third-party system node responds to the first request, it may need to initiate a second request to the third-party interface. Since the third-party system node and the target system belong to two systems, it is necessary to count the response of the third-party system node to the second request. The generation of the second request is essentially the response of the non-third-party system node to the first request, and the third-party system node actually responds to the second request to achieve the response of the system link to the first request. Therefore, the response of the third-party system node to the first request actually includes the response of the third-party system node to the second request. Non-third-party system nodes refer to service nodes other than third-party system nodes. Computer equipment can count the number of external interfaces that meet the standards on non-third-party system nodes, while for third-party system nodes, it is necessary to count the number of third-party interfaces that meet the standards on third-party system nodes.

[0086] Exemplarily, the computer device can obtain the request received by each third-party interface of the third-party system node in the system link, and determine whether the third-party interface meets the standard at the third-party system node according to the preset interface performance index corresponding to the third-party system node and the response of the third-party system node to the second request. It can be understood that the step of determining whether the third-party interface meets the standard at the third-party system node is consistent with the step of determining whether the external interface meets the standard at the non-third-party system node, and both determine whether the interface meets the standard at the node by comparing the first quantitative value and the second quantitative value of the interface at the node to see whether they meet the first index value and the second index value respectively.

[0087] In this embodiment, by determining the compliance status of the third-party interface in the system link according to the response of the third-party system node in the system link to the second request, the performance of the third-party interface of the third-party system node can be evaluated in a targeted manner, thereby improving the accuracy of service quality evaluation.

[0088] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0089] Based on the same inventive concept, the embodiment of the present application also provides a service quality assessment device for implementing the service quality assessment method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more service quality assessment device embodiments provided below can refer to the limitations of the service quality assessment method above, and will not be repeated here.

[0090] In an exemplary embodiment, Figure 4 As shown, a service quality evaluation device 400 is provided, comprising: a determination module 402, an acquisition module 404, a performance evaluation module 406 and a quality evaluation module 408, wherein:

[0091] The determination module 402 is used to determine at least one system link in the target system; each system link is determined according to the connection relationship between each service node in the target system;

[0092] An acquisition module 404 is used to acquire, for each system link, a first request received by an external interface of the system link;

[0093] The performance evaluation module 406 is used to perform a performance evaluation on the system link according to the response of each service node in the system link to the first request, and obtain a performance evaluation result corresponding to the system link;

[0094] The quality evaluation module 408 is used to perform quality evaluation on the target system according to the performance evaluation results respectively corresponding to at least one system link to obtain a service quality evaluation result.

[0095] In some embodiments, in terms of determining at least one system link in the target system, the determination module 402 is specifically used to: determine at least one application product of the target system; wherein each application product is implemented through a system link composed of at least one service node in the target system; and determine the system link corresponding to each application product from the target system.

[0096] In some embodiments, in terms of obtaining, for each system link, the first request received by the external interface of the system link, the acquisition module 404 is specifically used to: obtain, for each external interface in each system link, each first request received by the external interface; in terms of performing a performance evaluation on the system link according to the response of each service node in the system link to the first request, and obtaining a performance evaluation result corresponding to the system link, the performance evaluation module 406 is specifically used to: for each service node in the system link, determine whether the external interface meets the standards at the service node according to preset interface performance indicators and the response of the service node to each first request; determine the qualified interface at the service node from each external interface of the system link; and determine the performance evaluation result corresponding to the system link according to the qualified interface at each service node.

[0097] In some embodiments, the preset interface performance indicator includes a first indicator value under the availability indicator item and a second indicator value under the response time indicator item; for each service node in the system link, according to the preset interface performance indicator and the response of the service node to each first request, determining whether the external interface meets the standard at the service node, the performance evaluation module 406 is specifically used to: for each service node in the system link, determine the first quantitative value under the availability indicator item according to the number of first requests successfully processed by the service node; determine the second quantitative value under the response time indicator item according to the response time of the service node to each first request; when the first quantitative value reaches the first indicator value and the second quantitative value reaches the second indicator value, determine that the external interface meets the standard at the service node.

[0098] In some embodiments, the performance evaluation results corresponding to each system link include the number of qualified interfaces; the number of qualified interfaces is used to characterize the number of external interfaces that meet the preset interface performance indicators; in terms of performing quality evaluation on the target system according to the performance evaluation results corresponding to at least one system link to obtain the service quality evaluation result, the quality evaluation module 408 is specifically used to: construct an orthogonal table according to the number of qualified interfaces corresponding to each system link; perform quality evaluation on the target system according to the orthogonal table to obtain the service quality evaluation result.

[0099] In some embodiments, the number of qualified interfaces corresponding to the system link includes the number of qualified interfaces in each service node in the system link; in terms of constructing an orthogonal table based on the number of qualified interfaces corresponding to each system link, the quality assessment module 408 is specifically used to: construct an orthogonal table based on the number of external interfaces corresponding to each system link and the number of qualified interfaces in each service node in each system link.

[0100] In some embodiments, the service nodes in the system link include third-party system nodes and non-third-party system nodes; the number of third-party interfaces of the third-party system nodes is inconsistent with the number of external interfaces of the system link; in terms of performing performance evaluation on the system link according to the response of each service node in the system link to the first request, and obtaining a performance evaluation result corresponding to the system link, the performance evaluation module 406 is specifically used to: perform performance evaluation on the system link according to the response of each non-third-party system node in the system link to the first request, and the response of the third-party system node in the system link to the second request, and obtain a performance evaluation result corresponding to the system link; the second request refers to a request received by the third-party interface of the third-party system node.

[0101] In some embodiments, the service nodes in the system link include third-party system nodes and non-third-party system nodes; the non-third-party system node initiates a second request to the third-party interface of the third-party system node in response to the first request; the performance evaluation result corresponding to the system link includes the compliance status of the third-party interface in the system link; in terms of performing performance evaluation on the system link according to the response of each service node in the system link to the first request, and obtaining the performance evaluation result corresponding to the system link, the performance evaluation module 406 is specifically used to: determine the compliance status of the third-party interface in the system link according to the response of the third-party system node in the system link to the second request.

[0102] Each module in the above-mentioned service quality evaluation device can be implemented in whole or in part by software, hardware and their combination. Each module can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to each module above.

[0103] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 5As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store the connection relationship between each service node. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a service quality evaluation method is implemented.

[0104] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 6 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a service quality evaluation method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0105] Those skilled in the art will understand that Figure 5 or Figure 6The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0106] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

[0107] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0108] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0109] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0110] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited thereto. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited thereto.

[0111] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0112] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for evaluating service quality, It is characterized in that The method comprises: Determine at least one system link in the target system; each system link is determined according to a connection relationship between each service node in the target system; For each external interface in each system link, obtaining each first request received by the external interface; For each service node in the system link, determine whether the external interface in the service node meets the standard according to the preset interface performance index and the response of the service node to each first request; determine the standard interface in the service node from each external interface of the system link; determine the performance evaluation result corresponding to the system link according to the standard interface in each service node; The target system is subjected to quality evaluation according to the performance evaluation results respectively corresponding to the at least one system link to obtain a service quality evaluation result.

2. The method according to claim 1, It is characterized in that The determining at least one system link in the target system includes: Determine at least one application product of the target system; wherein each application product is implemented through a system link composed of at least one service node in the target system; A system link corresponding to each application product is determined from the target system.

3. The method according to claim 1, It is characterized in that The preset interface performance index includes a first index value under the availability index item and a second index value under the response time index item; The determining, for each service node in the system link, whether the external interface meets the standard at the service node according to a preset interface performance indicator and a response of the service node to each first request, includes: For each service node in the system link, determining a first quantitative value under the availability indicator item according to the number of first requests successfully processed by the service node; Determine a second quantized value under the response time indicator item according to the response time of the service node to each first request; When the first quantization value reaches a first indicator value and the second quantization value reaches a second indicator value, it is determined that the external interface meets the standard at the service node.

4. The method according to claim 3, It is characterized in that The determining that the external interface meets the standard at the service node when the first quantization value reaches a first indicator value and the second quantization value reaches a second indicator value includes: When the first quantization value is not less than the first index value and the second quantization value is less than the second index value, it is determined that the external interface meets the standard at the service node.

5. The method according to claim 1, It is characterized in that The performance evaluation result corresponding to each system link includes the number of qualified interfaces; the number of qualified interfaces is used to represent the number of external interfaces that meet the preset interface performance indicators; The performing quality evaluation on the target system according to the performance evaluation results respectively corresponding to the at least one system link to obtain a service quality evaluation result includes: An orthogonal table is constructed according to the number of qualified interfaces corresponding to each system link; The target system is subjected to quality evaluation according to the orthogonal table to obtain a service quality evaluation result.

6. The method according to claim 5, It is characterized in that The number of standard-compliant interfaces corresponding to the system link includes the number of standard-compliant interfaces in each service node in the system link; The constructing of an orthogonal table according to the number of qualified interfaces corresponding to each system link includes: An orthogonal table is constructed according to the number of external interfaces corresponding to each system link and the number of qualified interfaces in each service node in each system link.

7. The method according to any one of claims 1 to 6, It is characterized in that The service nodes in the system link include a third-party system node and a non-third-party system node; the non-third-party system node initiates a second request to a third-party interface of the third-party system node in response to the first request; The performance evaluation result corresponding to the system link includes the compliance status of the third-party interface in the system link; The method further comprises: The compliance status of the third-party interface in the system link is determined according to the response status of the third-party system node in the system link to the second request.

8. A service quality evaluation device, It is characterized in that The device comprises: A determination module, used to determine at least one system link in the target system; each system link is determined according to the connection relationship between each service node in the target system; An acquisition module, configured to acquire, for each external interface in each system link, each first request received by the external interface; A performance evaluation module is used to determine, for each service node in the system link, whether the external interface meets the standard at the service node according to a preset interface performance indicator and the response of the service node to each first request; determine the interface that meets the standard at the service node from each external interface of the system link; and determine the performance evaluation result corresponding to the system link according to the interface that meets the standard at each service node; The quality evaluation module is used to perform quality evaluation on the target system according to the performance evaluation results respectively corresponding to the at least one system link to obtain a service quality evaluation result.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program. It is characterized in that When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images