A method, device, electronic device and storage medium for measuring service quality

Abstract

The present application relates to a service quality measurement method, device, electronic device and storage medium, and belongs to the field of computer technology. The service quality measurement method includes: obtaining the response time of each stage in the process of accessing the service; obtaining the service quality score of each stage based on the response time of each stage and the latest updated preset scoring rules; obtaining the total score that characterizes the overall service quality of the service based on the service quality score of each stage and the preset weight ratio of each stage. The present application provides a unified evaluation standard for service quality measurement. At the same time, the preset scoring rules will be updated according to the response time of each stage in the historical access data of the service, can automatically adapt to different business scenarios, can deeply and accurately express the changes in the service quality status, and make more accurate evaluations for different business scenarios.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and specifically relates to a method, device, electronic device and storage medium for measuring quality of service. Background Art

[0002] Application quality measurement is a hot topic in information construction management. Mail systems, entertainment portals, company portals, database systems, etc. are commonly used application software. In the past, the experience of using application software was either based on people's subjective feelings of use, or some measurement tools (such as curl) were used to count the various stages of application access from the protocol level. For example, a typical HTTP (Hyper Text Transfer Protocol) access can get: DNS (Domain Name System) resolution, SSL (Secure Sockets Layer) establishment, TCP (Transmission Control Protocol) connection establishment, response transmission, data transmission and other stages of time. However, based on this measurement data, users still cannot get an overall experience that indicates excellent, good or poor. Even for a single data, such as DNS resolution time, there is no standard to judge its quality. It can only be judged based on network usage experience. In fact, DNS resolution time is closely related to the usage scenario and network construction plan. This artificially set evaluation standard method cannot adapt to different network scenarios. Summary of the invention

[0003] In view of this, the purpose of this application is to provide a method, device, electronic device and storage medium for measuring service quality, so as to improve the problem that the existing judgment of whether it is good or bad can only be made based on usage experience, resulting in the inability to adapt to different network scenarios.

[0004] The embodiment of the present application is implemented as follows:

[0005] In the first aspect, the embodiment of the present application provides a method for measuring service quality, including: obtaining the response time of each stage in the process of accessing the service; obtaining the service quality score of each stage based on the response time of each stage and the latest updated preset scoring rules, wherein the preset scoring rules will be updated according to the response time of each stage in the historical access data of the service; based on the service quality score of each stage and the preset weight ratio of each stage, a total score representing the overall service quality of accessing the service is obtained. In the embodiment of the present application, by obtaining the response time of each stage in the process of accessing the service, and based on the response time of each stage and the latest updated preset scoring rules, the service quality score of each stage is obtained, and then based on the service quality score of each stage and the preset weight ratio of each stage, the total score representing the overall service quality of the service can be obtained, which provides a unified evaluation standard for service quality measurement. At the same time, the preset scoring rules will be updated according to the response time of each stage in the historical access data of the service, which can automatically adapt to different business scenarios, can deeply and accurately express the changes in the service quality status, and make more accurate evaluations for different business scenarios.

[0006] In combination with a possible implementation of the first aspect, the preset scoring rule includes: if the response time is not less than the upper threshold, the corresponding score is at least the first threshold; if the response time is not greater than the lower threshold, the corresponding score is at most the second threshold; if the response time is between the lower threshold and the upper threshold, the corresponding score is between the first threshold and the second threshold, and the closer to the upper threshold, the smaller the score; accordingly, before obtaining the service quality score of each stage based on the response time of each stage and the latest updated preset scoring rule, the method also includes: updating the upper threshold and the lower threshold in the preset scoring rule according to the response time of each stage in the historical access data of the business. In the embodiment of the present application, by updating the upper threshold and the lower threshold in the preset scoring rule according to the response time of each stage in the historical access data of the business, so as to automatically adapt to different business scenarios, the changes in the service quality status can be expressed in depth and accurately, and more accurate evaluations can be made for different business scenarios, so that it can better adapt to real business scenarios and make more accurate evaluations.

[0007] In combination with a possible implementation manner of the embodiment of the first aspect, the upper threshold and the lower threshold in the preset scoring rule are updated according to the response time of each stage in the historical access data of the business, including: obtaining the response time of each stage of each visit in all historical visits to the business within a preset time period; for each of the stages, sorting multiple response times of the stage within the preset time period to obtain a sorting result; obtaining a first average value of the top N response times with the smallest values ​​in the sorting result, and obtaining a second average value of the top M response times with the largest values ​​in the sorting result, where N and M are both positive integers; based on the first average value and the previous lower threshold in the preset scoring rule corresponding to the stage, the current latest lower threshold is obtained, and based on the second average value and the previous upper threshold in the preset scoring rule corresponding to the stage, the current latest upper threshold is obtained. In an embodiment of the present application, multiple response times of this stage within a preset time period are sorted, and then the top N response times with the smallest values ​​in the sorted results are selected to calculate the average value, and the top M response times with the largest values ​​are selected to calculate the average value, and then the previous lower threshold and the previous upper threshold are combined to obtain the current latest upper threshold and lower threshold. By continuously acquiring actual data in the scene to continuously update the upper threshold and the lower threshold, it can automatically adapt to different business scenarios and can deeply and accurately express changes in service quality status.

[0008] In conjunction with a possible implementation manner of the embodiment of the first aspect, the upper and lower thresholds in the preset scoring rules corresponding to any two stages in the various stages are different. In the embodiment of the present application, the upper and lower thresholds in the preset scoring rules corresponding to the stages are different, which is closer to the actual situation, more adaptable to real business scenarios, and makes more accurate evaluations.

[0009] In combination with a possible implementation manner of the embodiment of the first aspect, the value of N is the value obtained by rounding down or rounding up the product of multiple response times of this stage within the preset time period and the first preset ratio, and the value of M is the value obtained by rounding down or rounding up the product of multiple response times of this stage within the preset time period and the second preset ratio.

[0010] In combination with a possible implementation manner of the first aspect embodiment, the service is an HTTP access service, and the various stages in the access service process include: DNS resolution stage, SSL establishment stage, TCP connection establishment stage, response transmission stage, and data transmission stage.

[0011] In the second aspect, an embodiment of the present application also provides a service quality measurement device, including: an acquisition module and a processing module; the acquisition module is used to obtain the response time of each stage in the process of accessing the service; the processing module is used to obtain the service quality score of each stage based on the response time of each stage and the latest updated preset scoring rules, wherein the preset scoring rules will be updated according to the response time of each stage in the historical access data of the service; and it is also used to obtain a total score characterizing the overall service quality of accessing the service based on the service quality score of each stage and the preset weight ratio of each stage.

[0012] In combination with a possible implementation manner of the embodiment of the second aspect, the preset scoring rule includes: if the response time is not less than an upper threshold, the corresponding score is at least a first threshold; if the response time is not greater than a lower threshold, the corresponding score is at most a second threshold; if the response time is between the lower threshold and the upper threshold, the corresponding score is between the first threshold and the second threshold, and the closer to the upper threshold, the smaller the score; accordingly, the device also includes: an updating module, which is used to update the upper threshold and the lower threshold in the preset scoring rule according to the response time of each stage in the historical access data of the business.

[0013] In a third aspect, an embodiment of the present application further provides an electronic device, comprising: a memory and a processor, the processor being connected to the memory; the memory being used to store programs; the processor being used to call the programs stored in the memory to execute the method provided in the above-mentioned first aspect embodiment and / or any possible implementation method in combination with the first aspect embodiment.

[0014] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method provided by the above-mentioned first aspect embodiment and / or any possible implementation method in combination with the first aspect embodiment is executed.

[0015] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by implementing the embodiments of the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description and the drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings without creative work. As shown in the drawings, the above and other purposes, features and advantages of the present application will be clearer. The same reference numerals indicate the same parts in all the drawings. The drawings are not deliberately scaled to the actual size, and the focus is on showing the main purpose of the present application.

[0017] Figure 1 A flow chart of a method for measuring quality of service provided in an embodiment of the present application is shown.

[0018] Figure 2 A schematic diagram showing the principle of updating an upper threshold and a lower threshold in a preset scoring rule provided in an embodiment of the present application is shown.

[0019] Figure 3 A module schematic diagram of a service quality measurement device provided in an embodiment of the present application is shown.

[0020] Figure 4 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0021] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0022] It should be noted that similar numbers and letters represent similar items in the following drawings, so once an item is defined in one drawing, it is not necessary to further define and explain it in the subsequent drawings. At the same time, in the description of this application, relational terms such as "first", "second", etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the term "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or equipment including a series of elements includes not only those elements, but also includes other elements that are not clearly listed, or also includes elements inherent to such process, method, article or equipment. In the absence of more restrictions, the elements limited by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or equipment including the elements.

[0023] Furthermore, the term "and / or" in this application is merely a term used to describe the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B may represent three situations: A exists alone, A and B exist at the same time, and B exists alone.

[0024] In view of the fact that there is no unified evaluation standard for the existing service quality measurement, whether it is good or bad can only be judged based on network usage experience. However, the current method of manually setting the measurement standards of each dimension of the application based on experience is difficult on the one hand, and on the other hand, it cannot adapt to different business scenarios and cannot express the changes in the service quality status in depth and accurately. Based on this, the embodiment of the present application provides a service quality measurement method, by obtaining the response time of each stage in the process of accessing the service, and based on the response time of each stage and the latest updated preset scoring rules, the service quality score of each stage is obtained, and then based on the service quality score of each stage and the preset weight ratio of each stage, the total score representing the overall service quality of the service can be obtained, which provides a unified evaluation standard for service quality measurement; at the same time, the preset scoring rules will be updated according to the response time of each stage in the historical access data of the service, which can automatically adapt to different business scenarios, can express the changes in the service quality status in depth and accurately, and make more accurate evaluations for different business scenarios.

[0025] The following will be combined Figure 1 , the service quality measurement method provided in the embodiment of the present application is explained.

[0026] S1: Get the response time of each stage in the process of accessing the service.

[0027] Application quality measurement is a hot topic in information construction management. When it is necessary to measure the service quality of an application, the response time of each stage of the application's access to the service is obtained. Taking HTTP (Hyper Text Transfer Protocol) or HTTPS (Hyper Text Transfer Protocol over Secure Socket Layer) access service as an example, the various stages in the access process may include: DNS (Domain Name System) resolution stage, SSL (Secure Sockets Layer) establishment stage, TCP (Transmission Control Protocol) connection establishment stage, response transmission stage, data transmission stage, etc.

[0028] Different access service types may correspond to different stages. For the same type of access service, the objects are different, and the response time of each stage may also be different. For example, for the same HTTP access, the response time of each stage may be different when the access object is Baidu website and when the access object is Taobao website.

[0029] It should be noted that the access service of the service quality measurement method of the embodiment of the present application is not limited to the above-mentioned HTTP or HTTPS access service scenario, which can be a common service scenario, such as a business scenario of sending emails. Different access service types may correspond to different stages, but the principle of measuring service quality is the same. Therefore, the above-mentioned HTTP or HTTPS access service cannot be understood as a limitation of the present application.

[0030] Taking the measurement case of accessing the Baidu website (www.baidu.com) as an example, we can use measurement tools (such as curl, of course, we can also use Python's urllib library to write our own detection tools) to collect statistics on each stage of application access from the protocol level. The data obtained during the access to the Baidu website is as follows:

[0031] [root@bcqf~]#cur1-o / dev / nul1-sw time_namelooKup:″\t″%{time-namelooKup}″\n″time_connect:″\t\t″%

[0032] {time_connect}″\n″time_appconnect:″\t″%{time_appconnect}″\n″time_pretransfer:″\t″%

[0033] {time_pretransfer}″\n″time_starttransfer:″\t″%{time_starttransfer}″\n″time_total:″\t\t″%

[0034] {time_total}″\n″time_redirect:″\t\t″%{time_redirect}″\n″https: / / www.baidu.com

[0035] time_namelookup: 0.004

[0036] time_connect: 0.010

[0037] time_appconnect: 0.068

[0038] time_pretransfer: 0.068

[0039] time_starttransfer: 0.075

[0040] time_total: 0.075

[0041] time_redirect: 0.000

[0042] Among them, -o / dev / null means not to display specific web page information; time_namelookup is the time for DNS to resolve the domain name [www.baidu.com]; time_commect is the time for the client and server to establish a TCP connection; time_appconnect is the time for the SSL upper layer protocol to establish a connection, such as the time for connection (connect) or handshake (handshake); time_pretransfer is the time from the start of the request to the start of the response transmission; time_starttransfer is the time from the client sending the request to the web server responding with the first byte; time_total is the time from the client sending the request to the web server sending back all the corresponding data; time_redirect is the redirection time.

[0043] Not all of the above indicators obtained by the tool are necessarily used, and important indicators can be selected according to business needs.

[0044] : Taking the above example as an example, the response time of the DNS resolution phase is 0.004s; the response time of the TCP connection establishment phase is 0.010-0.004s=0.060s; the response time of the SSL establishment phase is 0.068-0.010=0.058s, which is 58ms. It can be seen that adding an extra layer of SSL is still very time-consuming; the response time of the server response transmission phase is 0.068-0.068=0.000s, which shows that the server processing is very fast. If the server takes a long time, it is necessary to analyze its time consumption: firewall->load balancing->application->cache and DB (Data Base), and it is necessary to deeply analyze which link consumes time; the total response time of the data transmission phase is 0.075s; there is no redirect in the whole process, so the redirection time is 0.

[0045] S2: Based on the response time of each stage and the latest updated preset scoring rules, the service quality score of each stage is obtained.

[0046] After obtaining the response time of each stage, the service quality score of each stage can be obtained based on the response time of each stage and the latest updated preset scoring rules. For example, after obtaining the response time of the above-mentioned six stages, namely, the DNS resolution stage, the SSL establishment stage, the TCP connection establishment stage, the response transmission stage, and the data transmission stage, the service quality score of each stage can be obtained based on the response time of the stage and the corresponding latest updated preset scoring rules. For example, taking the DNS resolution stage as an example, the service quality score of the DNS resolution stage can be obtained based on the response time of the DNS resolution stage and the corresponding latest updated preset scoring rules.

[0047] Among them, the preset scoring rules in the embodiment of the present application will be updated according to the response time of each stage in the historical access data of the business, so that they can automatically adapt to different business scenarios, deeply and accurately express the changes in the service quality status, and make more accurate evaluations for different business scenarios. This can better adapt to real business scenarios and make more accurate evaluations.

[0048] In an optional implementation, the preset scoring rules include: if the response time is not less than the upper threshold, the corresponding score is at least the first threshold; if the response time is not greater than the lower threshold, the corresponding score is at most the second threshold; if the response time is between the lower threshold and the upper threshold, the corresponding score is between the first threshold and the second threshold, and the closer to the upper threshold, the smaller the score.

[0049] For a more intuitive understanding, the above preset scoring rule can be regarded as a piecewise function f(tn), where tn represents the response time of the nth stage, n is a positive integer, A represents the lower threshold, and B represents the upper threshold. Assuming that the first threshold is 0 and the second threshold is 100, we have:

[0050] if (tn<=A) then f(t)=100;

[0051] else if(tn>A&&tn <B)then f(tn)=B-tn;

[0052] else f(tn)=0.

[0053] The upper and lower thresholds in the preset scoring rules corresponding to each stage are different, that is, the upper and lower thresholds in the preset scoring rules corresponding to any two stages in the above stages are different. For example, the upper and lower thresholds in the preset scoring rules corresponding to the DNS resolution stage are different from the upper and lower thresholds in the preset scoring rules corresponding to the SSL establishment stage.

[0054] It should be noted that in the above example, the minimum value, i.e. the first threshold, is 0, and the maximum value, i.e. the second threshold, is 100. If a 10-point system is used, the maximum value, i.e. the second threshold, is 10. Therefore, the above example cannot be understood as a limitation on the present application.

[0055] In an optional implementation, before S2, the service quality measurement method further includes: updating the upper threshold and the lower threshold in the preset scoring rule according to the response time of each stage in the historical access data of the service. It should be noted that the execution subject of updating the preset scoring rule and the execution subject of the service quality measurement method may not be the same, for example, the updating of the preset scoring rule is performed by device A, and the execution of the service quality measurement method is performed by device B, and of course, they may also be the same execution subject.

[0056] In an optional implementation, the process of updating the upper and lower thresholds in the preset scoring rules according to the response time of each stage in the historical access data of the service can be: obtaining the response time of each stage of each access in all the historical access services within a preset time period (such as the past week), sorting the multiple response times of the stage within the preset time period for each stage in each stage to obtain the sorting result, obtaining the first average value of the top N response times with the smallest values ​​in the sorting result, and obtaining the second average value of the top M response times with the largest values ​​in the sorting result, where N and M are both positive integers, obtaining the current latest lower threshold based on the first average value and the previous lower threshold in the preset scoring rule corresponding to the stage, and obtaining the current latest upper threshold based on the second average value and the previous upper threshold in the preset scoring rule corresponding to the stage. The flow chart is as follows Figure 2 shown.

[0057] Among them, preferably, the updating principle of the upper threshold and the lower threshold in the preset scoring rules corresponding to each stage is similar. For better understanding, taking the process of updating the upper threshold and the lower threshold in the preset scoring rules corresponding to the DNS resolution stage as an example, the response time of the DNS resolution stage during each access to all access processes of the service in the past week is obtained. Taking the service access triggered every 5 minutes as an example, 288 sample data can be obtained in one day (each sample data corresponds to a response time), and 2016 sample data can be obtained in one week (7 days). Then sort these 2016 sample data, such as sorting in order from small to large or from large to small, to obtain the sorting result, and then obtain the first N (such as 400) response times with the smallest value in the sorting result, and then calculate the average value of these N response times to obtain the first average value, and obtain the first M (such as 400) response times with the largest value in the sorting result, and then calculate the average value of these M response times to obtain the second average value. Based on the first average value and the previous lower threshold in the preset scoring rule corresponding to this stage, the current latest lower threshold is obtained, such as the current latest lower threshold = (first average value + previous lower threshold) / 2; and based on the second average value and the previous upper threshold in the preset scoring rule corresponding to this stage, the current latest upper threshold is obtained, such as the current latest upper threshold = (second average value + previous lower threshold) / 2.

[0058] If the upper threshold and the lower threshold in the preset scoring rule are updated for the first time, the upper threshold and the lower threshold are preset initial values, which can be set based on experience.

[0059] The following is an explanation of the process of continuously updating the upper and lower thresholds in the preset scoring rules with reference to specific examples. Assuming that the initial lower threshold preset by the user is A0, and the initial upper threshold is B0, and the first average value obtained in the first update is a1, and the second average value is b1, then the lower threshold after the first update is (A0+a1) / 2, and the upper threshold after the first update is (B0+b1) / 2; the first average value obtained in the second update is a2, and the second average value is b2, then the lower threshold after the second update is ((A0+a1) / 2+a2) / 2, and the upper threshold after the second update is ((B0+b1) / 2+b2) / 2, and then the updates are continuously performed according to this rule.

[0060] It should be noted that, when the current latest lower threshold is obtained based on the first average value and the previous lower threshold in the preset scoring rule corresponding to this stage, it is not limited to the above-mentioned method of calculating the average value. For example, the current latest lower threshold can be = the previous lower threshold + 1 / 2 first average value. Therefore, the method of calculating the average value in the above example cannot be understood as a limitation on the present application; similarly, when the current latest upper threshold is obtained based on the second average value and the previous upper threshold in the preset scoring rule corresponding to this stage, it is not limited to the above-mentioned method of calculating the average value.

[0061] The value of N is a value obtained by rounding down or rounding up the product of multiple response times of the stage within the preset time period and the first preset ratio, and the value of M is a value obtained by rounding down or rounding up the product of multiple response times of the stage within the preset time period and the second preset ratio. For example, the first preset ratio is 20%, and the second preset ratio is 20%, and the first preset ratio and the second preset ratio may be different.

[0062] It should be noted that the preset scoring rules shown above only show the case of including 2 thresholds. In addition, more thresholds may be included, such as 10 thresholds, which are threshold 1, threshold 2, threshold 3, threshold 4, threshold 5, threshold 6, threshold 7, threshold 8, threshold 9, and threshold 10, respectively. If the response time tn is not greater than threshold 1, it is 100 points; if it is between (threshold 1, threshold 2], it is 90 points; if it is between (threshold 2, threshold 3], it is 80 points; if it is between (threshold 3, threshold 4], it is 70 points; if it is between (threshold 4, threshold 5], it is 60 points; if it is between (threshold 5, threshold 6], it is 70 points. If the response time tn is between (threshold 6 and threshold 7], it is 50 points; if the response time tn is between (threshold 6 and threshold 7], it is 40 points; if the response time tn is between (threshold 7 and threshold 8], it is 30 points; if the response time tn is between (threshold 8 and threshold 9], it is 20 points; if the response time tn is between (threshold 9 and threshold 10], it is 10 points; if the response time tn is greater than threshold 10, it is 0 points. Alternatively, even fewer thresholds may be included, such as only one threshold, denoted as C. In this case, if the response time tn is greater than threshold C, the corresponding score is the first threshold; if the response time tn is not greater than threshold C, the corresponding score is the second threshold. Therefore, the preset scoring rules of the above examples cannot be understood as limitations on the present application.

[0063] S3: Based on the service quality scores of each stage and the preset weight ratios of each stage, a total score representing the overall service quality of accessing the service is obtained.

[0064] After obtaining the service quality scores of each stage, based on the service quality scores of each stage and the preset weight ratios of each stage, the total score representing the overall service quality of the access service can be obtained, for example, expressed by the function y=f(t1)p1+f(t2)p2+…+f(tn)Pn. Among them, y is the total score, f(tn) is the service quality score of the nth stage, pn is the preset weight ratio of the nth stage, and n is a positive integer.

[0065] Based on the same inventive concept, the embodiment of the present application also provides a service quality measurement device 100, such as Figure 3 The service quality measurement device 100 includes: an acquisition module 110 and a processing module 120;

[0066] The acquisition module 110 is used to acquire the response time of each stage in the process of accessing the service.

[0067] The processing module 120 is used to obtain the service quality score of each stage based on the response time of each stage and the latest updated preset scoring rules, wherein the preset scoring rules will be updated according to the response time of each stage in the historical access data of the business; and is also used to obtain a total score representing the overall service quality of access to the business based on the service quality score of each stage and the preset weight ratio of each stage.

[0068] Optionally, the preset scoring rule includes: if the response time is not less than the upper threshold, the corresponding score is at least the first threshold; if the response time is not greater than the lower threshold, the corresponding score is at most the second threshold; if the response time is between the lower threshold and the upper threshold, the corresponding score is between the first threshold and the second threshold, and the closer to the upper threshold, the smaller the score. Accordingly, the service quality measurement device 100 also includes an updating module, which is used to update the upper threshold and the lower threshold in the preset scoring rule according to the response time of each stage in the historical access data of the service.

[0069] The update module is specifically used to: obtain the response time of each stage of each visit in all historical visits to the business within a preset time period; for each of the stages, sort the multiple response times of the stage within the preset time period to obtain a sorting result; obtain a first average value of the top N response times with the smallest values ​​in the sorting result, and obtain a second average value of the top M response times with the largest values ​​in the sorting result, where N and M are both positive integers; based on the first average value and the previous lower limit threshold in the preset scoring rule corresponding to the stage, obtain the current latest lower limit threshold, and based on the second average value and the previous upper limit threshold in the preset scoring rule corresponding to the stage, obtain the current latest upper limit threshold.

[0070] The service quality measurement device 100 provided in the application embodiment has the same implementation principle and technical effects as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.

[0071] like Figure 4 As shown, Figure 4 The electronic device 200 provided in the embodiment of the present application is shown in the structural block diagram. The electronic device 200 comprises: a transceiver 210, a memory 220, a communication bus 230 and a processor 240.

[0072] The transceiver 210, the memory 220, and the processor 240 are electrically connected to each other directly or indirectly to achieve data transmission or interaction. For example, these components can be electrically connected to each other via one or more communication buses 230 or signal lines. The transceiver 210 is used to send and receive data. The memory 220 is used to store computer programs, such as storing Figure 3 The software function module shown in is the service quality measurement device 100. Among them, the service quality measurement device 100 includes at least one software function module that can be stored in the memory 220 in the form of software or firmware or solidified in the operating system (OS) of the electronic device 200. The processor 240 is used to execute the executable module stored in the memory 220, such as the software function module or computer program included in the service quality measurement device 100. For example, the processor 240 is used to obtain the response time of each stage in the process of accessing the service; based on the response time of each stage and the latest updated preset scoring rules, the service quality score of each stage is obtained, wherein the preset scoring rules will be updated according to the response time of each stage in the historical access data of the service; based on the service quality score of each stage and the preset weight ratio of each stage, a total score representing the overall service quality of accessing the service is obtained.

[0073] Among them, the memory 220 can be, but is not limited to, random access memory (Random Access Memory, RAM), read only memory (Read Only Memory, ROM), programmable read-only memory (Programmable Read-Only Memory, PROM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, EPROM), electrically erasable read-only memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc.

[0074] The processor 240 may be an integrated circuit chip with signal processing capabilities. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The various methods, steps and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. The general-purpose processor may be a microprocessor or the processor 240 may also be any conventional processor, etc.

[0075] The electronic device 200 mentioned above includes but is not limited to a computer, such as a server.

[0076] An embodiment of the present application further provides a non-volatile computer-readable storage medium (hereinafter referred to as storage medium), on which a computer program is stored. When the computer program is run by a computer such as the electronic device 200 described above, the service quality measurement method shown above is executed.

[0077] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0078] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0079] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0080] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a computer-readable storage medium, including several instructions for enabling a computer device (which can be a personal computer, a laptop, a server, or an electronic device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned computer-readable storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0081] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for measuring service quality, characterized in that: include: Get the response time at each stage of the access business process; Based on the response time of each stage and the latest updated preset scoring rules, the service quality score of each stage is obtained, wherein the preset scoring rules are updated according to the response time of each stage in the historical access data of the service, and when updating, the upper threshold and the lower threshold in the preset scoring rules are updated according to the response time of each stage in the historical access data of the service; Based on the service quality scores of each stage and the preset weight ratios of each stage, a total score representing the overall service quality of accessing the service is obtained; The preset scoring rules include: If the response time is not less than the upper threshold, the corresponding minimum score is the first threshold; If the response time is not greater than the lower threshold, the corresponding maximum score is the second threshold; If the response time is between the lower threshold and the upper threshold, the corresponding score is between the first threshold and the second threshold, and the closer the response time is to the upper threshold, the smaller the score; Wherein, updating the upper threshold and the lower threshold in the preset scoring rule according to the response time of each stage in the historical access data of the business includes: Obtaining the response time of each stage of each access in all historical accesses to the service within a preset time period; For each of the stages, sorting multiple response times of the stage within the preset time period to obtain a sorting result; Obtain a first average value of top N response times with the smallest values ​​in the sorted results, and obtain a second average value of top M response times with the largest values ​​in the sorted results, where N and M are both positive integers, and the value of N is a value obtained by rounding down or rounding up the product of multiple response times at this stage in the preset time period and the first preset ratio, and the value of M is a value obtained by rounding down or rounding up the product of multiple response times at this stage in the preset time period and the second preset ratio; Based on the first average value and the last lower threshold value in the preset scoring rule corresponding to this stage, the current latest lower threshold value is obtained; based on the second average value and the last upper threshold value in the preset scoring rule corresponding to this stage, the current latest upper threshold value is obtained.

2. The method according to claim 1, characterized in that The upper threshold and the lower threshold in the preset scoring rule corresponding to any two stages in the various stages are different.

3. The method according to claim 1 or 2, characterized in that: The service is an HTTP or HTTPS access service, and the various stages in the access service process include: DNS resolution stage, SSL establishment stage, TCP connection establishment stage, response transmission stage, and data transmission stage.

4. A device for measuring service quality, characterized in that: include: The acquisition module is used to obtain the response time of each stage in the process of accessing the service; A processing module, configured to obtain a service quality score for each stage based on the response time for each stage and the latest updated preset scoring rules, wherein the preset scoring rules are updated according to the response time for each stage in the historical access data of the service, and when updating, the upper threshold and the lower threshold in the preset scoring rules are updated according to the response time for each stage in the historical access data of the service; and further configured to obtain a total score representing the overall service quality of accessing the service based on the service quality score for each stage and the preset weight ratio of each stage; The preset scoring rules include: If the response time is not less than the upper threshold, the corresponding minimum score is the first threshold; If the response time is not greater than the lower threshold, the corresponding maximum score is the second threshold; If the response time is between the lower threshold and the upper threshold, the corresponding score is between the first threshold and the second threshold, and the closer the response time is to the upper threshold, the smaller the score; Wherein, updating the upper threshold and the lower threshold in the preset scoring rule according to the response time of each stage in the historical access data of the business includes: Obtaining the response time of each stage of each access in all historical accesses to the service within a preset time period; For each of the stages, sorting multiple response times of the stage within the preset time period to obtain a sorting result; Obtain a first average value of top N response times with the smallest values ​​in the sorted results, and obtain a second average value of top M response times with the largest values ​​in the sorted results, where N and M are both positive integers, and the value of N is a value obtained by rounding down or rounding up the product of multiple response times at this stage in the preset time period and the first preset ratio, and the value of M is a value obtained by rounding down or rounding up the product of multiple response times at this stage in the preset time period and the second preset ratio; Based on the first average value and the last lower threshold value in the preset scoring rule corresponding to this stage, the current latest lower threshold value is obtained; based on the second average value and the last upper threshold value in the preset scoring rule corresponding to this stage, the current latest upper threshold value is obtained.

5. The device according to claim 4, characterized in that The device also includes: The updating module is used to update the upper threshold and the lower threshold in the preset scoring rule according to the response time of each stage in the historical access data of the business.

6. An electronic device, characterized in that: include: A memory and a processor, wherein the processor is connected to the memory; The memory is used to store programs; The processor is used to call the program stored in the memory to execute the method according to any one of claims 1 to 3.

7. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the method according to any one of claims 1 to 3 is executed.

Images