Business quality assessment methods, devices, electronic equipment and storage media

Abstract

This application discloses a service quality assessment method, apparatus, electronic device, and storage medium. The method includes: determining a first score for each type of service in a first cell by each terminal in at least one terminal; determining a second score for each type of service in the first cell based on the first scores for each type of service in the first cell by all terminals in the at least one terminal; the second score characterizing the service quality of the corresponding service; and determining a third score for the first cell based on the second score for each type of service in the first cell; the third score characterizing the service quality of the first cell.

Description

Technical Field

[0001] This application relates to the field of wireless technology, and in particular to a service quality assessment method, apparatus, electronic device, and storage medium. Background Technology

[0002] In the realm of service level agreements (SLAs) for business assurance, B2B (to-Business) enterprises exhibit diverse industry types and business scenarios, with varying business characteristics and significantly different key factors influencing user experience across different business segments. However, existing quality assessment mechanisms fail to cater to the diverse industry types and business scenarios within the B2B sector, resulting in inaccurate and unrefined quality assessments. Summary of the Invention

[0003] To address the related technical issues, embodiments of this application provide a service quality assessment method, apparatus, electronic device, and storage medium.

[0004] The technical solution of this application embodiment is implemented as follows:

[0005] This application provides a service quality assessment method, including:

[0006] Determine the first score for each type of service in the first cell for each terminal in at least one terminal;

[0007] Based on the first score of each type of service in the first cell by all terminals in the at least one terminal, a second score of each type of service in the first cell is determined; the second score characterizes the service quality of the corresponding service.

[0008] A third score is determined for the first cell based on a second score for each type of service in the first cell; the third score characterizes the service quality of the first cell.

[0009] In the above scheme, determining the first score of each terminal for each type of service in the first cell for at least one terminal includes:

[0010] Based on the first ratio of the terminal's performance on each set indicator for the corresponding service within a set time period, a first score is determined for each of the at least one terminal for each type of service in the first cell; wherein,

[0011] The first ratio represents the percentage of the terminal's satisfaction with the corresponding service based on the SLA requirements of the corresponding service, as determined by the terminal's performance against the corresponding set indicators.

[0012] In the above scheme, the set indicators include at least one of the following:

[0013] User transmission rate / service experience rate;

[0014] End-to-end delay;

[0015] Network packet loss rate / Internet Protocol (IP) packet loss rate;

[0016] End-to-end latency jitter.

[0017] In the above scheme, when determining the first score of each terminal for each type of service in the first cell based on the first ratio of the terminal for the corresponding service on each set indicator within a set time period, the method includes:

[0018] Based on the first ratio of the first terminal to the first service on a first set indicator within a set time period, and based on a first penalty factor, a first score of the first terminal for the first service on the first set indicator is determined; wherein,

[0019] The first penalty factor is determined based on the number of times the first terminal fails to meet the first service on the first set indicator within the set time period, the number of consecutive failures, and / or the importance of the first set indicator.

[0020] In the above scheme, determining the first score of each terminal for each type of service in the first cell based on the first ratio of the terminal to the corresponding service on each set indicator within a set time period includes:

[0021] Based on the first ratio of the terminal to the corresponding service on each set indicator within a set time period, and based on the corresponding weight of each service on each set indicator, the first score of each terminal in at least one terminal for each service in the first cell is determined.

[0022] In the above scheme, when determining the second score for each type of service in the first cell based on the first score of each terminal in the at least one terminal for each type of service in the first cell, the method includes:

[0023] Calculate the average of the first scores of all terminals in the at least one terminal for the first service to obtain the second score of the first service.

[0024] In the above scheme, determining the third score of the first cell based on the second score for each type of service in the first cell includes:

[0025] Based on the second score for each type of service in the first cell and the first factor corresponding to each type of service, a third score for the first cell is determined; wherein,

[0026] The first factor represents the weight of the corresponding service among all services in the first cell.

[0027] In the above scheme, the first factor is determined based on the number of terminals accessing the corresponding service in the first cell and the total number of terminals accessing the first cell.

[0028] The method in the above scheme further includes:

[0029] If any terminal scores a first rating for a type of service in the first cell lower than a first preset score, or if a second rating for a type of service in the first cell lower than a second preset score, or if a third rating for the first cell lower than a third preset score, a corresponding alarm message shall be issued.

[0030] This application embodiment also provides a business quality assessment device, including:

[0031] The first evaluation unit is used to determine the first score of each terminal in at least one terminal for each type of service in the first cell;

[0032] The first evaluation unit is used to determine a second score for each type of service in the first cell based on a first score given by all terminals in the at least one terminal to each type of service in the first cell; the second score represents the service quality of the corresponding service.

[0033] The third evaluation unit is used to determine a third score for the first cell based on a second score for each type of service in the first cell; the third score characterizes the service quality of the first cell.

[0034] This application also provides an electronic device, including: a first processor and a first communication interface; wherein,

[0035] The first processor is configured to determine a first score for each type of service in the first cell by each terminal in at least one terminal; determine a second score for each type of service in the first cell based on the first scores for each type of service in the first cell by all terminals in the at least one terminal; the second score characterizes the service quality of the corresponding service; and determine a third score for the first cell based on the second score for each type of service in the first cell; the third score characterizes the service quality of the first cell.

[0036] This application also provides a first network node, including: a first processor and a first memory for storing a computer program capable of running on the processor.

[0037] Wherein, when the first processor is used to run the computer program, it executes the steps of any of the above methods.

[0038] This application also provides a storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of any of the above methods.

[0039] In this embodiment, a first score is determined for each terminal in at least one terminal for each type of service in the first cell; then, based on the first scores for each type of service in the first cell from all terminals in the at least one terminal, a second score is determined for each type of service in the first cell; the second score characterizes the service quality of the corresponding service; finally, based on the second score for each type of service in the first cell, a third score is determined for the first cell; the third score characterizes the service quality of the first cell. This solution provides a three-level SLA service quality assessment system, supporting SLA service quality assessments at the cell level, service level, and terminal level in the network, thereby enabling more refined service quality assessments. Attached Figure Description

[0040] Figure 1 This is a schematic diagram illustrating the implementation process of the service quality assessment method in an embodiment of this application;

[0041] Figure 2 This is a schematic diagram illustrating the implementation process of the service quality assessment method in an application embodiment of this application;

[0042] Figure 3 This is a schematic diagram of the business quality assessment device according to an embodiment of this application;

[0043] Figure 4 This is a schematic diagram of the electronic device structure according to an embodiment of this application. Detailed Implementation

[0044] Currently, wireless communication networks employ the Mean Opinion Score (MOS) scoring mechanism for 4G voice services, primarily used to evaluate the voice quality of communication systems. This includes both subjective and objective scoring. Subjective scoring is based on the subjective perceptions of a large number of listeners regarding voice quality and the required level of attention. Scoring results vary from person to person and are easily influenced by uncertain factors such as the surrounding environment and the content of the test materials. Furthermore, it is time-consuming and costly. Objective scoring primarily utilizes methods such as Perceptual Evaluation of Speech Quality (PESQ) and E-Model evaluation. PESQ compares the source signal and the degraded signal to provide a MOS score similar to a human hearing assessment test. It focuses on different causes of signal degradation, such as encoding / decoding distortion, packet errors, packet loss, latency, jitter, and filtering, providing test results. E-Model evaluation comprehensively considers the impact of network operational factors such as latency, noise, echo, encoder performance, packet loss, and jitter on voice quality.

[0045] In the field of SLA service assurance for industry sectors, B2B industries and business scenarios are diverse, with differentiated business characteristics and varying key factors affecting user experience. However, the MOS scoring mechanism's evaluation benchmark is strongly correlated with voice service characteristics and fails to cater to the different B2B industry types and business scenarios. In other words, there is no universal network performance evaluation mechanism for B2B scenarios in the relevant technologies.

[0046] Based on this, in various embodiments of this application, a first score is determined for each type of service in the first cell by each terminal in at least one terminal; then, based on the first scores for each type of service in the first cell by all terminals in the at least one terminal, a second score is determined for each type of service in the first cell; the second score characterizes the service quality of the corresponding service; finally, based on the second score for each type of service in the first cell, a third score is determined for the first cell; the third score characterizes the service quality of the first cell. The above scheme provides a three-level SLA service quality assessment system, supporting SLA service quality assessments at the cell level, service level, and terminal level in the network, thereby enabling more refined service quality assessments.

[0047] The present application will now be described in further detail with reference to the accompanying drawings and embodiments.

[0048] Figure 1 The implementation flow of the service quality assessment method according to an embodiment of this application is shown, with reference to Figure 1 The method includes:

[0049] Step 101: Determine the first score for each type of service in the first cell for each terminal in at least one terminal.

[0050] In one embodiment, determining the first score for each type of service in the first cell for each of at least one terminal includes:

[0051] Based on the first ratio of the terminal to the corresponding service on each set indicator within a set time period, the first score of each terminal in the at least one terminal for each type of service in the first cell is determined.

[0052] The first ratio represents the percentage of the terminal's satisfaction with the corresponding service based on the SLA requirements of the corresponding service, as determined by the terminal's performance against the corresponding set indicators.

[0053] Here, the defined indicators are key indicator factors characterizing network performance and network health, including at least one of the following:

[0054] User transmission rate / Service experience rate V;

[0055] End-to-end delay T;

[0056] Network packet loss rate / IP packet loss rate L;

[0057] End-to-end delay jitter J.

[0058] In practical applications, it is necessary to determine the baseline threshold or baseline range for each set indicator for each business based on the SLA requirements of the corresponding business. For example, the baseline threshold or baseline range set for the above-mentioned set indicators is as follows:

[0059] V≥V0 or V∈[V] low V high ]

[0060] T≤T0 or T∈[T] low T high ]

[0061] L≤L0 or V∈[L] low L high ]

[0062] J≤J0 or J∈[J] low J high ]

[0063] Here, the choice between setting a baseline threshold or a baseline range is mainly based on the actual business SLA requirements. For example, if the business SLA requirements want to control the upper limit of end-to-end latency and control the network transmission rate within a certain range, then a corresponding baseline threshold is set for end-to-end latency and a corresponding baseline range is set for network transmission rate.

[0064] After setting the baseline threshold or baseline range for each set indicator, the set indicators can be measured and statistically analyzed using the Cumulative Distribution Function (CDF) within a set time period (e.g., within 1 minute) to determine the first ratio of each terminal to the corresponding service for each set indicator within the set time period. In other words, based on the SLA requirements of the corresponding service for each set indicator, the satisfaction ratio of each terminal to the corresponding service for each set indicator within the set time period can be determined.

[0065] For example, it is determined that:

[0066] P(V≥V0 or V∈[V]) low V high ])

[0067] P(T≤T0 or T∈[T]) low T high ])

[0068] P(L≤L0 or V∈[L]) low L high ])

[0069] P(J≤J0 or J∈[J]) low J high ])

[0070] Where P represents the corresponding first ratio, and its value ranges from [0, 1].

[0071] It is understandable that in practical applications, the first score of a terminal for a given service can be calculated by summing, averaging, or weighted summing the first ratio of the terminal's performance on each set indicator within a set time period. Furthermore, based on the service SLA requirements of industry customers, there are outlier alarm penalties in most service scenarios. For example, Power Line Communication (PLC) is required to not experience T consecutive packet losses, otherwise downtime will occur, affecting production. Therefore, in one embodiment, when determining the first score of each terminal for each type of service in the first cell based on the first ratio of the terminal's performance on each set indicator within a set time period, the method includes:

[0072] Based on the first ratio of the first terminal to the first service on the first set indicator within a set time period, and based on the first penalty factor, the first score of the first terminal to the first service on the first set indicator is determined.

[0073] The first penalty factor is determined based on the number of times the first terminal fails to meet the first service requirement on the first set indicator within the set time period, the number of consecutive failures, and / or the importance of the first set indicator.

[0074] Here, taking network transmission packet loss rate / IP packet loss rate as an example, a corresponding penalty factor can be defined. Here, 'a' represents the importance of the corresponding set indicator; the more important the set indicator, the larger the value of 'a'. 'X' represents the number of consecutive packet losses; 'T' represents that T consecutive packet losses are not allowed. It can be seen that the more packet losses, or the more important the set indicator, the larger the corresponding penalty factor value. Based on this penalty factor setting, the first terminal's first score for the first service on the first set indicator can be calculated using λ0 = P0 × R0, where λ0 represents the first terminal's first score for the first service on the first set indicator, P0 represents the first ratio of the first terminal's first service on the first set indicator, and R0 represents the penalty factor corresponding to the first set indicator for the first service.

[0075] Because different business scenarios within vertical industries have varying requirements for performance metrics such as speed and latency, for example, enhanced mobile broadband (eMBB) services like machine vision have higher requirements for user transmission rate / service experience rate. Therefore, when calculating the first score, a higher weight can be assigned to the user transmission rate / service experience rate as a key performance indicator. Similarly, ultra-reliable and low-latency communications (uRLLC) services like remote PLC control have strict latency requirements; therefore, when calculating the first score, a higher weight can be assigned to the end-to-end latency as a key performance indicator. Based on this, in one embodiment,

[0076] The step of determining the first score for each type of service in the first cell for each terminal among at least one terminal, based on the first ratio of the terminal's corresponding service on each set indicator within a set time period, includes:

[0077] Based on the first ratio of the terminal to the corresponding service on each set indicator within a set time period, and based on the corresponding weight of each service on each set indicator, the first score of each terminal in the at least one terminal for each service of the first cell is determined.

[0078] Specifically, the first score of a single terminal for a certain type of service in a certain cell can be calculated using the following formula:

[0079]

[0080] Among them, WV The weighting factor W is set for the user transmission rate / service experience rate metric. T W represents the weighting factor set for the end-to-end latency metric. L W is a weighting factor set for the specified index of network transmission packet loss rate / IP packet loss rate. J The weighting factor is set as a target metric for end-to-end latency jitter, and W is... V +W T +W L +W J =1. λ V0 , λ T0 , λ L0 and λ J0 These are the terminal's first scores for the corresponding service in the corresponding cell on user transmission rate / service experience rate, end-to-end latency T, network transmission packet loss rate / IP packet loss rate L, and end-to-end latency jitter J.

[0081] Step 102: Based on the first score of each type of service in the first cell by all terminals in the at least one terminal, determine the second score of each type of service in the first cell; the second score characterizes the service quality of the corresponding service.

[0082] In one embodiment, when determining a second score for each type of service in the first cell based on a first score for each type of service in the first cell from all terminals in the at least one terminal, the method includes:

[0083] Calculate the average of the first scores of all terminals in the at least one terminal for the first service to obtain the second score of the first service.

[0084] Specifically, based on step 101, a first score for each type of service in the first cell is calculated for each terminal among at least one terminal accessing the first cell, and a second score for each type of service in the first cell is calculated:

[0085]

[0086] Where, λ B The second score represents a certain type of service in the first cell, where I represents the number of terminals accessing the first cell and participating in the scoring, and λ represents the number of terminals. UEi The first score given by the i-th terminal among the I terminals participating in the scoring for this type of service.

[0087] Step 103: Based on the second score of each type of service in the first cell, determine the third score of the first cell; the third score characterizes the service quality of the first cell.

[0088] In one embodiment, determining the third score of the first cell based on the second score for each type of service in the first cell includes:

[0089] Based on the second score for each type of service in the first cell and the first factor corresponding to each type of service, a third score for the first cell is determined; wherein,

[0090] The first factor represents the weight of the corresponding service among all services in the first cell.

[0091] Here, assuming the first cell provides N services to the terminal, then:

[0092]

[0093] Where, ε n ε represents the ratio of the number of terminals serving the nth type of service in N types of services to the total number of terminals accessing the cell. n It can represent the business preference factor of the nth type of business, and also characterize the influence weight of the nth type of business in the overall cell business.

[0094] Therefore, λ C This is the final community-level SLA service quality score.

[0095] In one embodiment, the method further includes:

[0096] If any terminal scores a first rating for a type of service in the first cell lower than a first preset score, or if a second rating for a type of service in the first cell lower than a second preset score, or if a third rating for the first cell lower than a third preset score, a corresponding alarm message shall be issued.

[0097] In practical applications, based on expert or testing experience and combined with user-side requirements for specific business scenarios, corresponding score alarm thresholds can be set for the terminal-level score (step 101), the service-level score (step 102), and the cell-level score (step 103). When the score for the corresponding level falls below the corresponding score alarm threshold, it indicates a risk to the current network quality, thus providing early warning. Furthermore, statistical intervals can be defined for the terminal-level, service-level, and cell-level scores, and service quality assessment results can be given based on the statistical intervals and real-time scores.

[0098] For example, setting λ C The corresponding statistical interval is [0, λ1, λ2, 1]. The corresponding business quality assessment results are as follows:

[0099] λ C∈[0, λ1]: The network quality is poor and can no longer meet the requirements of business production. Timely alarms are required to protect production safety.

[0100] λ C ∈[λ1, λ2]: The network quality is at a medium level, but there is a certain risk to the quality of service. Network health warnings can be issued to industry customers in advance.

[0101] λ C ∈[λ2, 1]: The network quality is good, meets the requirements of business production, and can maintain the current network quality for normal production.

[0102] Specifically, λ1 = 40, λ2 = 80, when λ C A business security risk warning will be issued when the score is ≤80. C A score of ≤40 indicates poor network quality, which has already affected business operations or production efficiency, and a fault alarm will be issued.

[0103] In practical applications, different rating levels provide varying reference value to the network under early warning and alarm states. Furthermore, the three-tiered network parameter architecture—user-level, service-level, and cell-level—allows for rapid source tracing and adjustment. For example, if alarms occur at the cell-level, service-level, and user-level evaluation parameters, it indicates that the overall network performance of the cell cannot meet service requirements and needs reconfiguration. When cell-level parameters are good but low-latency services trigger alarms, it's likely that the latency configuration level is too low, requiring the activation of pre-scheduling functions. When there are no obvious problems with cell-level and service-level parameters, but terminal parameter alarms occur, it may indicate a connection failure or malfunction at the terminal itself, requiring access checks or repairs.

[0104] This solution defines an SLA network quality assurance assessment method for different B2B business scenarios. Its core technology lies in statistically analyzing key indicators representing network performance and health to derive a single-indicator evaluation metric. By adding characteristic parameters and attenuation parameters of terminal connection services to the metric, the SLA network quality score for each terminal is obtained. The average score of different terminals providing the same service within a cell is calculated to obtain the cell-level service quality score. By adding the service percentage to the service score and summing the results, a cell-level SLA network service quality score is obtained. This three-tiered network quality score system provides notification, warnings, and alarms for different scores, achieving real-time monitoring of network and service quality at the application site and real-time tracing of network problems from different dimensions.

[0105] The above solution provides a method for evaluating SLA network quality assurance in different B2B business scenarios. Figure 2 The actual process of the application embodiment of this application is shown, with reference to Figure 2First, by statistically analyzing key indicators representing network performance and health, a single-indicator evaluation metric is derived. Then, by adding characteristic parameters of terminal connection services (satisfaction rate) and attenuation parameters (penalty factor) to the metric, the SLA satisfaction score of the terminal is obtained. The service-level SLA satisfaction score within the cell is obtained by calculating the average score of different terminals providing the same service within the cell. Finally, the cell-level SLA satisfaction score is obtained by adding the service percentage to the service score and summing the results. Furthermore, during the quality assessment process, a three-tiered network quality score is used for classification, and different scores are reported, warned, and alerted, achieving the goal of real-time monitoring of network and service quality at the application site and real-time tracing of network problems from different dimensions.

[0106] Furthermore, since the scores determined in the above scheme are based on real-time statistics of actual business operation data, rather than test value samples, and are calculated based on real-time network operation data, and according to different business logics and needs, they truly reflect the network health level. This results in a more accurate and agile response to network quality and service assurance levels, meeting industry needs and providing the foundation for SLA services. Moreover, the above quality assessment method is more universal, possessing objective value for various production scenarios such as AGVs, remote control, and machine vision inspection in B2B scenarios, and is not limited to a specific type of call traffic like voice. Its wider applicability helps to form industry standards and consensus. Real-time linkage with alarms from different dimensions can assist in tracing the source of network problems from different dimensions, helping to quickly define and troubleshoot network issues, improving fault operation and maintenance efficiency, and is of great value in solving operators' fault recovery and maintenance services.

[0107] To implement the method of the embodiments of this application, the embodiments of this application also provide a service quality assessment device, such as... Figure 3 As shown, the device includes:

[0108] The first evaluation unit 301 is used to determine the first score of each terminal in at least one terminal for each type of service in the first cell;

[0109] The second evaluation unit 302 is used to determine a second score for each type of service in the first cell based on a first score given by all terminals in the at least one terminal to each type of service in the first cell; the second score represents the service quality of the corresponding service.

[0110] The third evaluation unit 303 is used to determine a third score for the first cell based on a second score for each type of service in the first cell; the third score characterizes the service quality of the first cell.

[0111] In one embodiment, the first evaluation unit 301 is configured to:

[0112] Based on the first ratio of the terminal's performance on each set indicator for the corresponding service within a set time period, a first score is determined for each of the at least one terminal for each type of service in the first cell; wherein,

[0113] The first ratio represents the percentage of the terminal's satisfaction with the corresponding service based on the SLA requirements of the corresponding service, as determined by the terminal's performance against the corresponding set indicators.

[0114] In one embodiment, the set index includes at least one of the following:

[0115] User transmission rate / service experience rate;

[0116] End-to-end delay;

[0117] Network packet loss rate / IP packet loss rate;

[0118] End-to-end latency jitter.

[0119] In one embodiment, the first evaluation unit 301 is configured to:

[0120] Based on the first ratio of the first terminal to the first service on a first set indicator within a set time period, and based on a first penalty factor, a first score of the first terminal for the first service on the first set indicator is determined; wherein,

[0121] The first penalty factor is determined based on the number of times the first terminal fails to meet the first service on the first set indicator within the set time period, the number of consecutive failures, and / or the importance of the first set indicator.

[0122] In one embodiment, the first evaluation unit 301 is configured to:

[0123] Based on the first ratio of the terminal to the corresponding service on each set indicator within a set time period, and based on the corresponding weight of each service on each set indicator, the first score of each terminal in at least one terminal for each service in the first cell is determined.

[0124] In one embodiment, the first evaluation unit 302 is configured to:

[0125] Calculate the average of the first scores of all terminals in the at least one terminal for the first service to obtain the second score of the first service.

[0126] In one embodiment, the third evaluation unit 303 is used for:

[0127] Based on the second score for each type of service in the first cell and the first factor corresponding to each type of service, a third score for the first cell is determined; wherein,

[0128] The first factor represents the weight of the corresponding service among all services in the first cell.

[0129] In one embodiment, the first factor is determined based on the number of terminals accessing the corresponding service within the first cell and the total number of terminals accessing the service within the first cell.

[0130] In one embodiment, the device further includes:

[0131] The alarm unit is used to issue corresponding alarm information when any terminal's first score for a type of service in the first cell is lower than a first preset score, or when the second score for a type of service in the first cell is lower than a second preset score, or when the third score for the first cell is lower than a third preset score.

[0132] In practical applications, the first evaluation unit 301, the second evaluation unit 302, the third evaluation unit 303, and the alarm unit can be implemented by the processor in the service quality evaluation device.

[0133] It should be noted that the business quality assessment device provided in the above embodiments is only illustrated by the division of the above-described program modules when performing business quality assessments. In actual applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the device can be divided into different program modules to complete all or part of the processing described above. In addition, the business quality assessment device and the business quality assessment method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0134] Based on the hardware implementation of the above program modules, and in order to implement the method on the electronic device side of the embodiments of this application, the embodiments of this application also provide an electronic device, such as... Figure 4 As shown, the electronic device 400 includes:

[0135] The first communication interface 401 is capable of exchanging information with other network nodes;

[0136] The first processor 402 is connected to the first communication interface 401 to enable information interaction with other network nodes and to execute the methods provided by one or more technical solutions on the electronic device side when running a computer program. The computer program is stored in the first memory 403.

[0137] Specifically, the first processor 402 is used for:

[0138] Determine the first score for each type of service in the first cell for each terminal in at least one terminal;

[0139] Based on the first score of each type of service in the first cell by all terminals in the at least one terminal, a second score of each type of service in the first cell is determined; the second score characterizes the service quality of the corresponding service.

[0140] A third score is determined for the first cell based on a second score for each type of service in the first cell; the third score characterizes the service quality of the first cell.

[0141] In one embodiment, the first processor 402 is configured to:

[0142] Based on the first ratio of the terminal's performance on each set indicator for the corresponding service within a set time period, a first score is determined for each of the at least one terminal for each type of service in the first cell; wherein,

[0143] The first ratio represents the percentage of the terminal's satisfaction with the corresponding service based on the SLA requirements of the corresponding service, as determined by the terminal's performance against the corresponding set indicators.

[0144] In one embodiment, the set index includes at least one of the following:

[0145] User transmission rate / service experience rate;

[0146] End-to-end delay;

[0147] Network packet loss rate / IP packet loss rate;

[0148] End-to-end latency jitter.

[0149] In one embodiment, the first processor 402 is configured to:

[0150] Based on the first ratio of the first terminal to the first service on a first set indicator within a set time period, and based on a first penalty factor, a first score of the first terminal for the first service on the first set indicator is determined; wherein,

[0151] The first penalty factor is determined based on the number of times the first terminal fails to meet the first service on the first set indicator within the set time period, the number of consecutive failures, and / or the importance of the first set indicator.

[0152] In one embodiment, the first processor 402 is configured to:

[0153] Based on the first ratio of the terminal to the corresponding service on each set indicator within a set time period, and based on the corresponding weight of each service on each set indicator, the first score of each terminal in at least one terminal for each service in the first cell is determined.

[0154] In one embodiment, the first processor 402 is configured to:

[0155] Calculate the average of the first scores of all terminals in the at least one terminal for the first service to obtain the second score of the first service.

[0156] In one embodiment, the first processor 402 is configured to:

[0157] Based on the second score for each type of service in the first cell and the first factor corresponding to each type of service, a third score for the first cell is determined; wherein,

[0158] The first factor represents the weight of the corresponding service among all services in the first cell.

[0159] In one embodiment, the first factor is determined based on the number of terminals accessing the corresponding service within the first cell and the total number of terminals accessing the service within the first cell.

[0160] In one embodiment, the first processor 402 is further configured to:

[0161] If any terminal scores a first rating for a type of service in the first cell lower than a first preset score, or if a second rating for a type of service in the first cell lower than a second preset score, or if a third rating for the first cell lower than a third preset score, a corresponding alarm message shall be issued.

[0162] It should be noted that the specific processing procedures of the first processor 402 and the first communication interface 401 can be understood by referring to the above method.

[0163] Of course, in practical applications, the various components in electronic device 400 are coupled together through bus system 404. It can be understood that bus system 404 is used to realize the connection and communication between these components. In addition to a data bus, bus system 404 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, in... Figure 4 The general designated all buses as Bus System 404.

[0164] The first memory 403 in this embodiment is used to store various types of data to support the operation of the electronic device 400. Examples of such data include any computer program used to operate on the electronic device 400.

[0165] The methods disclosed in the embodiments of this application can be applied to the first processor 402, or implemented by the first processor 402. The first processor 402 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware or by instructions in the form of software in the first processor 402. The first processor 402 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The first processor 402 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in the embodiments of this application can be directly reflected as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium, which is located in the first memory 403. The first processor 402 reads the information in the first memory 403 and completes the steps of the aforementioned method in combination with its hardware.

[0166] In an exemplary embodiment, the electronic device 400 may be implemented by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components to perform the aforementioned method.

[0167] It is understood that the memories (first memory 403, second memory 1303, and third memory 1403) in the embodiments of this application can be volatile memory or non-volatile memory, or both. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM); magnetic surface memory can be disk storage or magnetic tape storage. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memories described in the embodiments of this application are intended to include, but are not limited to, these and any other suitable types of memories.

[0168] In an exemplary embodiment, this application also provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, such as a first memory 403 storing a computer program, which can be executed by a first processor 402 of an electronic device 400 to complete the steps described in the aforementioned electronic device-side method. The computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disc, or CD-ROM.

[0169] It should be noted that terms such as "first" and "second" are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0170] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0171] Furthermore, the technical solutions described in the embodiments of this application can be combined arbitrarily without conflict.

[0172] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application.

Claims

1. A business quality assessment method, characterized in that, include: A first score is determined for each type of service in the first cell for each terminal in at least one terminal; wherein, the first score for each type of service in the first cell for each terminal in at least one terminal is determined based on a first ratio of the terminal to the corresponding service on each set indicator within a set time period; the first ratio represents the satisfaction ratio of the terminal to the corresponding service on the corresponding set indicator determined based on the service level agreement (SLA) requirements of the corresponding service. Based on the first score of each type of service in the first cell by all terminals in the at least one terminal, a second score of each type of service in the first cell is determined; the second score characterizes the service quality of the corresponding service. A third score is determined for the first cell based on a second score for each type of service in the first cell; the third score characterizes the service quality of the first cell.

2. The method according to claim 1, characterized in that, The set indicators include at least one of the following: User transmission rate / service experience rate; End-to-end delay; Network packet loss rate / Network protocol IP packet loss rate; End-to-end latency jitter.

3. The method according to claim 1 or 2, characterized in that, When determining the first score of each terminal for each type of service in the first cell based on the first ratio of the terminal's corresponding service on each set indicator within a set time period, the method includes: Based on the first ratio of the first terminal to the first service on a first set indicator within a set time period, and based on a first penalty factor, a first score of the first terminal for the first service on the first set indicator is determined; wherein, The first penalty factor is determined based on the number of times the first terminal fails to meet the first service on the first set indicator within the set time period, the number of consecutive failures, and / or the importance of the first set indicator.

4. The method according to claim 1 or 2, characterized in that, The step of determining the first score for each type of service in the first cell for each of the at least one terminals, based on the first ratio of the terminal's corresponding service on each set indicator within a set time period, includes: Based on the first ratio of the terminal to the corresponding service on each set indicator within a set time period, and based on the corresponding weight of each service on each set indicator, the first score of each terminal in at least one terminal for each service in the first cell is determined.

5. The method according to any one of claims 1-4, characterized in that, When determining a second score for each type of service in the first cell based on a first score for each type of service from all terminals in the at least one terminal, the method includes: Calculate the average of the first scores of all terminals in the at least one terminal for the first service to obtain the second score of the first service.

6. The method according to any one of claims 1-4, characterized in that, The determination of the third score for the first cell based on the second score for each type of service in the first cell includes: A third score for the first cell is determined based on the second score for each type of service in the first cell and the first factor corresponding to each type of service; wherein the first factor represents the weight of the corresponding service among all services in the first cell.

7. The method according to claim 6, characterized in that, The first factor is determined based on the number of terminals accessing the corresponding service within the first cell and the total number of terminals accessing the first cell.

8. The method according to any one of claims 1-4, characterized in that, The method further includes: If any terminal scores a first rating for a type of service in the first cell lower than a first preset score, or if a second rating for a type of service in the first cell lower than a second preset score, or if a third rating for the first cell lower than a third preset score, a corresponding alarm message shall be issued.

9. A business quality assessment device, characterized in that, include: A first evaluation unit is configured to determine a first score for each type of service in the first cell for each of at least one terminal; wherein, the first evaluation unit is configured to determine a first score for each type of service in the first cell for each of the at least one terminal based on a first ratio of the terminal to the corresponding service on each set indicator within a set time period; the first ratio represents the satisfaction ratio of the terminal to the corresponding service on the corresponding set indicator determined based on the SLA requirements of the corresponding service. The second evaluation unit is used to determine a second score for each type of service in the first cell based on a first score given by all terminals in the at least one terminal to each type of service in the first cell; the second score represents the service quality of the corresponding service. The third evaluation unit is used to determine a third score for the first cell based on a second score for each type of service in the first cell; the third score characterizes the service quality of the first cell.

10. An electronic device, characterized in that, include: A first processor and a first communication interface; wherein... The first processor is configured to determine a first score for each type of service in the first cell by each terminal in at least one terminal; determine a second score for each type of service in the first cell based on the first scores for each type of service in the first cell by all terminals in the at least one terminal; the second score characterizes the service quality of the corresponding service; and determine a third score for the first cell based on the second score for each type of service in the first cell; the third score characterizes the service quality of the first cell. Wherein, when the first processor determines the first score of each terminal in at least one terminal for each type of service in the first cell, it is used to: determine the first score of each terminal in at least one terminal for each type of service in the first cell based on the first ratio of the terminal for the corresponding service on each set indicator within a set time period; the first ratio represents the satisfaction ratio of the terminal for the corresponding service on the corresponding set indicator determined based on the SLA requirements of the corresponding service.

11. A first network node, characterized in that, include: A first processor and a first memory for storing computer programs capable of running on the processor. Wherein, when the first processor is used to run the computer program, it performs the steps of the method according to any one of claims 1 to 8.

12. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 8.

Images