Application health status assessment method, system, device and storage medium

Abstract

The present application provides an application health status assessment method, system, device and storage medium, which relates to the field of computer technology. The method includes: determining one or more KPI indicators from the logs generated by the application; obtaining the indicator values ​​of one or more KPI indicators within a preset time period; determining the weight ratio of each KPI indicator in the application according to the business needs of the application; and calculating the total score of the application according to the weight ratio and the indicator value. In this way, the health status of the application can be judged more objectively.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an application health status assessment method, system, device and storage medium. Background Art

[0002] Applications have flooded our work and life, providing great convenience for our work and life. While applications provide us with convenience, we also need to monitor their health status.

[0003] Existing application health status monitoring methods include active detection and passive detection. Active detection usually checks whether there are any abnormalities in the application based on the running log, but there is no specific standard for judging the health status of the application. Summary of the invention

[0004] In order to more objectively judge the health status of an application, the present application provides an application health status assessment method, system, device and storage medium.

[0005] In a first aspect of the present application, a method for evaluating the health status of an application is provided. The method comprises:

[0006] Determine one or more KPIs from the logs generated by the application;

[0007] Obtaining indicator values ​​of one or more of the KPI indicators within a preset time period;

[0008] Determine the weight ratio of each KPI indicator in the application according to the business requirements of the application;

[0009] The total score of the application is calculated according to the weight ratio and the indicator value.

[0010] By adopting the above technical solution, one or more KPI indicators that can judge the health status of the application are found in the operation log, and then according to the actual business needs of the application, each KPI indicator is assigned a weight in the application, and the overall score of the application is determined according to the specific value of the weight and the indicator, so that the actual situation of each application can be taken into account to objectively judge the health status of the application.

[0011] Optionally, determining one or more KPI indicators from the logs generated by the application includes:

[0012] The log is matched with the indicator keywords in the KPI indicator library, and the successfully matched indicator keywords are used as KPI indicators. The indicator keywords at least include the number of response duration timeouts and the number of request status errors.

[0013] Optionally, calculating the total score of the application according to the weight ratio and the indicator value includes:

[0014] Determine the score of the KPI indicator according to the number of response time timeouts and the first scoring rule, the number of request status errors and the second scoring rule;

[0015] The total score of the application is determined according to the weight ratio and the score of the KPI indicator.

[0016] Optionally, determining the total score of the application according to the weight ratio and the score of the KPI indicator includes:

[0017] The overall rating of the application is calculated according to the following formula:

[0018]

[0019] Among them, x i is the weight of the i-th KPI indicator, y i is the score of the i-th KPI indicator, and n is the total number of KPI indicators.

[0020] Optionally, the method also includes: determining one or more associated applications that have a dependency relationship with the application, and determining the degree of dependency between the application and the associated applications; and calculating a comprehensive score of the application based on the total score of the application, the total score of one or more associated applications, and the degree of dependency corresponding to the associated applications.

[0021] Optionally, the comprehensive score is calculated using the following formula:

[0022]

[0023] Among them, D (A) is the comprehensive score of application A, S (A) is the total score of application A. Applications that have dependencies on application A are B1, B2, ... B n , For application B i The total score of , n is the number of applications that have dependencies on application A, For application B i Dependency on application A.

[0024] In a second aspect of the present application, a system for evaluating the health status of an application is provided. The system comprises:

[0025] A first determination module, used to determine one or more KPI indicators from the logs generated by the application;

[0026] An acquisition module is used to acquire indicator values ​​of one or more KPI indicators within a preset time period;

[0027] A second determination module is used to determine the weight ratio of each KPI indicator in the application according to the business requirements of the application;

[0028] A calculation module is used to calculate the total score of the application according to the weight ratio and the indicator value.

[0029] Optionally, the first determination module is specifically used to: match the log with indicator keywords in the KPI indicator library, and use the successfully matched indicator keywords as KPI indicators, and the indicator keywords at least include the number of response duration timeouts and the number of request status errors.

[0030] In a third aspect of the present application, an electronic device is provided, which includes a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the program, the method described above is implemented.

[0031] In a fourth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the method according to the first aspect of the present application is implemented.

[0032] It should be understood that the contents described in the Summary of the Invention are not intended to limit the key or important features of the embodiments of the present application, nor are they intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The above and other features, advantages and aspects of the embodiments of the present application will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0034] Figure 1 is an exemplary system architecture showing an embodiment of an application health status assessment method or an application health status assessment device to which the present application can be applied;

[0035] Figure 2 is a flow chart of a method for evaluating health status applied in an embodiment of the present application;

[0036] Figure 3 is a block diagram of a health status assessment system applied in an embodiment of the present application;

[0037] Figure 4 It is a block diagram of an electronic device in an example of this application. DETAILED DESCRIPTION

[0038] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0039] In the description of the present application, the terms “first”, “second” and “third” are used for descriptive purposes only and should not be understood as indicating or implying relative importance.

[0040] Figure 1 An exemplary system architecture 100 is shown to which an embodiment of the application health status assessment method or application health status assessment device of the present application can be applied.

[0041] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0042] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as model training applications, video recognition applications, web browser applications, social platform software, etc.

[0043] Terminal devices 101, 102, 103 can be hardware or software. When terminal devices 101, 102, 103 are hardware, they can be various electronic devices with display screens, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer 4) players, laptop computers and desktop computers, etc. When terminal devices 101, 102, 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, multiple software or software modules used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0044] When the terminals 101, 102, and 103 are hardware, a video acquisition device may be installed thereon. The video acquisition device may be any device capable of acquiring video, such as a camera, a sensor, etc. A user may use the video acquisition device on the terminals 101, 102, and 103 to acquire video.

[0045] The server 105 may be a server that provides various services, such as a background server that processes data displayed on the terminal devices 101, 102, and 103. The background server may analyze and process the received data, and may feed back the processing results to the terminal device.

[0046] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, multiple software or software modules for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0047] It should be understood that Figure 1 The number of terminal devices, networks and servers in the above is only illustrative. According to the implementation requirements, there may be any number of terminal devices, networks and servers. In particular, when the target data does not need to be acquired remotely, the above system architecture may not include a network, but only include terminal devices or servers.

[0048] Figure 2 FIG. 1 is a flowchart of a method for evaluating health status in an embodiment of the present invention. In some embodiments, the method may be performed by Figure 1 The system architecture shown is implemented. Figure 2 , the method comprises the following steps:

[0049] Step 210: Determine one or more KPI indicators from the logs generated by the application.

[0050] Step 220: Obtain indicator values ​​of one or more KPI indicators within a preset time period.

[0051] Step 230: Determine the weight ratio of each KPI indicator in the application according to the business requirements of the application.

[0052] Step 240: Calculate the total score of the application program according to the weight ratio and the indicator value.

[0053] The above steps are described in detail below.

[0054] In step 210, the application generates various logs, such as application logs, error logs, etc. Among them, the error log records various errors encountered during the operation of the server, as well as some common diagnostic information, such as when the server was started and when it was shut down. In the embodiment of the present application, the application log can be used, or the error log can be used directly.

[0055] Specifically, a request is made to retrieve the application log. It should be noted that the application log is on the server where the application is located. After obtaining the application log, the characteristic indicator is identified in the log.

[0056] In some implementations, step 210 further includes: matching the log with indicator keywords in the KPI indicator library, and using the successfully matched indicator keywords as KPI indicators, where the indicator keywords at least include the number of response duration timeouts and the number of request status errors.

[0057] It should be noted that a KPI indicator library is provided in the embodiment of the present application, and there are many indicator keywords that can be used as KPI indicators in the KPI indicator library. For example, the indicator keywords in the KPI indicator library at least include the number of response time timeouts, the number of request status errors, the request error rate, the startup time, the average response time, the request rate and other indicator keywords that can judge the health status of the application program. The KPI indicator library can add commonly used indicator keywords according to actual applications.

[0058] After obtaining the application log, extract the content in the log and automatically match the content in the log with the indicator keywords in the KPI indicator library, that is, search for indicator keywords in the content of the log. For example, when the words "response timeout" and "request error" appear in the content of the log, the KPI indicators that the application successfully matches are the number of response timeouts and the number of request status errors. It should be noted that the name of the KPI indicator can use the specific name of the indicator keyword.

[0059] In step 220, after determining one or more KPI indicators for evaluating the health status of the application, obtain the specific indicator value of each KPI indicator within the preset time period. It should be noted that the indicator value refers to the specific value of each KPI indicator within the preset time period. For example, when the KPI indicator is the number of response timeouts, its indicator value is the specific number of timeouts within the preset time period. In addition, the specific preset value of the preset time period is not limited here, and the preset time period can be set according to the actual situation, for example, it can be set to 24 hours or one week.

[0060] There are many ways to obtain the indicator value. For example, to count the number of request status errors in the Linux system log, you need to first obtain the word corresponding to the request status error and the log name, and then use the code "perl -e '$ / =undef;$_=<>;printf"$&:%dn",s / $& / / g while / theWord / ;'filename" to count, where "theWord" is replaced with the word corresponding to the request status error, and "filename" is replaced with the corresponding log name, and the number of request status errors in the log can be obtained. The above is one of the multiple acquisition methods, and other acquisition methods are all existing technologies and will not be repeated here.

[0061] In step 230, after determining one or more KPI indicators of the application, since the actual business needs of each application are different, the focus used to evaluate the application is also different. It is necessary to assign a weight ratio in the application to the determined KPI indicator, and then evaluate the health status of the application based on the weight ratio.

[0062] For example, the KPI indicators determined from the log of an application are the number of response time timeouts, the number of request status errors, and the application startup time. Assuming that the business requirements of the application require fast response time, followed by a small number of request status errors, the weight ratios of the three KPI indicators of the application, namely the number of response time timeouts, the number of request status errors, and the application startup time, can be set to 8:7:6 in sequence. By setting the weight ratio to evaluate the health status of the application, the health status of the application can be judged more objectively.

[0063] In some embodiments, step 240 further includes the following steps:

[0064] Step 241: Determine the score of the KPI indicator according to the number of response timeouts and the first scoring rule, the number of request status errors and the second scoring rule;

[0065] Step 242: Determine the total score of the application according to the weight ratio and the score of the KPI indicator.

[0066] It should be noted that step 241 and step 242 are not shown in the figure.

[0067] Specifically, different KPI indicators have different scoring rules. In this embodiment, the first scoring rule corresponding to the number of response timeouts is as follows: assuming that the full score is 100 points, when the number of response timeouts is within the range of 0 to 10 times, the score is 100 points; when the number of response timeouts is within the range of 11 to 40 times, the score is 60 points; when the number of response timeouts is within the range of 41 to 80 times, the score is 20 points; when the number of response timeouts exceeds 80 times, the score is 0 points.

[0068] In this embodiment, the second scoring rule corresponding to the number of request status errors is as follows: assuming the full score is 100 points, when the number of request status errors is in the range of 0 to 10 times, the score is 100 points; when the number of request status errors is in the range of 11 to 50 times, the score is 50 points; when the number of request status errors is in the range of 51 to 100 times, the score is 0 points.

[0069] The above are the scoring rules for two of the KPI indicators. The scoring rules for other KPI indicators can be set according to the historical indicator values ​​of the KPI indicators and the business requirements of the application, and there is no restriction here.

[0070] For example, the KPI indicators of an application are the number of response timeouts and the number of request status errors. The preset time period is set to 24 hours. Within the 24-hour time period, the application's response time timeouts are 18 times and the number of request status errors is 9 times. The application's score for the number of response timeouts is 60 points, and the score for the number of request status errors is 100 points.

[0071] In step 242, after obtaining the weight and score of each KPI indicator of the application, the total score of the application can be calculated. It should be noted that the weight ratio is the ratio of the weight of a KPI indicator to the sum of the weights of all KPI indicators of the application.

[0072] In some embodiments, the overall rating of the application is calculated according to the following formula:

[0073]

[0074] Among them, x i is the weight of the i-th KPI indicator, y i is the score of the i-th KPI indicator, and n is the total number of KPI indicators.

[0075] For example, the KPI indicators of an application are the number of response timeouts and the number of request status errors. The weight ratio of the corresponding KPI indicators is 5:8, and the sum of the weights is 13. According to the above scoring rules, the number of response timeouts is 18 times, and the score corresponding to the number of response timeouts is 60 points; the number of request status errors is 9 times, and the score corresponding to the number of request status errors is 100 points. Substituting the obtained values ​​into the above formula is:

[0076]

[0077] The final total score of the application is about 84.5 points.

[0078] In some embodiments, the comprehensive score of the application can be further determined based on the dependency relationship between the application and its associated applications. Since some applications and their associated applications are mutually dependent, when one of the applications is abnormal, other associated applications that may be abnormal can be found based on the dependency relationship of the abnormal application, thereby avoiding the impact on the accuracy of the application health status evaluation due to the limited KPI indicators that can evaluate the application health status in the logs generated by each application.

[0079] It should be noted that the way to determine the dependency relationship between applications can be to manually associate and assign a dependency between an application and its associated application; or a machine can automatically identify the call chain process in the log generated by the application, automatically associate and assign a dependency. For example, if an application has a similar or identical call chain with another application, it means that the two applications are related to each other, and the dependency can be determined based on the similarity of the call chain.

[0080] After obtaining the dependency relationship and the corresponding dependency degree of the application, the application is comprehensively scored according to the total score and the dependency relationship calculated above.

[0081] The comprehensive score is calculated using the following formula:

[0082]

[0083] Among them, D (A) is the comprehensive score of application A, S (A) is the total score of application A. Applications that have dependencies on application A are B1, B2, ... B n , For application B i The total score of , n is the number of applications that have dependencies on application A, For application B i Dependency on application A.

[0084] For example, there are application A, application B and application C. Application A has a dependency relationship with application B and application C. Assume that the dependency between application A, application B and application C is set manually, and the dependency between application A and application B is set to 8%, and the dependency between application A and application C is set to 5%. The total scores of application A, application B and application C are 80 points, 83 points and 79 points respectively. Substituting the values ​​into the above comprehensive score calculation formula, we get: D (A) =80-83*8%-79*5%, and the final comprehensive score of application A is 69.41 points.

[0085] Figure 3 FIG. 1 shows a block diagram of a health status assessment system used in an embodiment of the present application. Figure 3 The system comprises:

[0086] The first determination module 310 is used to determine one or more KPI indicators from the logs generated by the application.

[0087] The acquisition module 320 is used to obtain indicator values ​​of one or more KPI indicators within a preset time period.

[0088] The second determination module 330 is used to determine the weight ratio of each KPI indicator in the application according to the business requirements of the application.

[0089] The calculation module 340 is used to calculate the total score of the application according to the weight ratio and the indicator value.

[0090] In some implementations, the first determination module 210 is specifically used to: match the log with the indicator keywords in the KPI indicator library, and use the successfully matched indicator keywords as KPI indicators, where the indicator keywords at least include the number of response duration timeouts and the number of request status errors.

[0091] In some embodiments, the calculation module 340 is specifically used to: determine the score of the KPI indicator based on the number of response time timeouts and the first scoring rule, the number of request status errors and the second scoring rule; determine the total score of the application based on the weight ratio and the score of the KPI indicator.

[0092] In some implementations, the calculation module 340 is further specifically configured to calculate the total score of the application according to the following formula:

[0093]

[0094] Among them, x i is the weight of the i-th KPI indicator, y iis the score of the i-th KPI indicator, and n is the total number of KPI indicators.

[0095] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the described module can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0096] An electronic device is provided in an embodiment of the present application, such as Figure 4 As shown, Figure 4 The electronic device 400 shown includes: a processor 401 and a memory 403. The processor 401 and the memory 403 are connected, such as through a bus 402. Optionally, the electronic device 400 may also include a transceiver 404. It should be noted that in actual applications, the transceiver 404 is not limited to one, and the structure of the electronic device 400 does not constitute a limitation on the embodiments of the present application.

[0097] Processor 401 may be a CPU (Central Processing Unit), a general purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. Processor 401 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0098] The bus 402 may include a path to transmit information between the above components. The bus 402 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 402 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0099] The memory 403 can be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compressed optical disk, laser disk, optical disk, digital versatile disk, Blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to these.

[0100] The memory 403 is used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 401. The processor 401 is used to execute the application code stored in the memory 403 to implement the contents shown in the above method embodiment.

[0101] Among them, electronic devices include but are not limited to: mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0102] As another aspect, the present application further provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable storage medium stores one or more programs, and when the above programs are used by one or more processors to execute the application health status assessment method described in the present application.

[0103] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of application involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned application concept. For example, the above features are replaced with (but not limited to) technical features with similar functions applied in the present application.

Claims

1. A method for evaluating the health status of an application, characterized in that: include: Determine one or more KPIs from the logs generated by the application; Obtaining indicator values ​​of one or more of the KPI indicators within a preset time period; Determine the weight ratio of each KPI indicator in the application according to the business requirements of the application; Calculate the total score of the application according to the weight ratio and the indicator value; Determining one or more KPI indicators from the logs generated by the application includes: Match the log with the indicator keywords in the KPI indicator library, and use the successfully matched indicator keywords as KPI indicators, wherein the indicator keywords at least include the number of response timeouts and the number of request status errors; The application health status assessment method also includes: Determine one or more associated applications that have a dependency relationship with the application, and determine the degree of dependency between the application and the associated applications; Calculating a comprehensive score of the application according to the total score of the application, the total scores of one or more associated applications, and the dependencies corresponding to the associated applications; The method for determining the dependency between the applications includes: Automatically identify call chains in logs generated by applications, and if two applications have similar or identical call chains, automatically associate the two applications, and determine the dependency based on the similarity of the call chains; The comprehensive score is calculated using the following formula: Among them, D (A) is the comprehensive score of application A, S (A) is the total score of application A. Applications that have dependencies on application A are B1, B2, ... B n , For application B i The total score of , n is the number of applications that have dependencies on application A, For application B i Dependency on application A.

2. The application health status assessment method according to claim 1, characterized in that: Calculating the total score of the application program according to the weight ratio and the indicator value includes: Determine the score of the KPI indicator according to the number of response time timeouts and the first scoring rule, the number of request status errors and the second scoring rule; The total score of the application is determined according to the weight ratio and the score of the KPI indicator.

3. The application health status assessment method according to claim 2, characterized in that: Determining the total score of the application according to the weight ratio and the score of the KPI indicator includes: The overall rating of the application is calculated according to the following formula: Among them, x i is the weight of the i-th KPI indicator, y i is the score of the i-th KPI indicator, and n is the total number of KPI indicators.

4. An application health status assessment system, used to implement the application health status assessment method according to any one of claims 1 to 3, characterized in that: include: A first determination module, used to determine one or more KPI indicators from the logs generated by the application; An acquisition module is used to acquire indicator values ​​of one or more KPI indicators within a preset time period; A second determination module is used to determine the weight ratio of each KPI indicator in the application according to the business requirements of the application; A calculation module, used for calculating the total score of the application according to the weight ratio and the indicator value; The first determining module is specifically used for: The log is matched with the indicator keywords in the KPI indicator library, and the successfully matched indicator keywords are used as KPI indicators. The indicator keywords at least include the number of response duration timeouts and the number of request status errors.

5. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, wherein: When the processor executes the program, the method according to any one of claims 1 to 3 is implemented.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 3 is implemented.

Images