Business monitoring method and device, equipment, storage medium and program product

Abstract

The invention provides a business monitoring method which can be applied to the technical field of big data and the technical field of financial science and technology. The service monitoring method comprises the following steps: acquiring a target log sequence related to a to-be-monitored service from a log message queue; reading a monitoring index related to the to-be-monitored service from a pre-constructed full-amount service index table; based on the monitoring indexes, reading multiple groups of monitoring index data corresponding to the multiple historical time windows from the target log sequence; based on the multiple groups of monitoring index data, generating a service monitoring result corresponding to the to-be-monitored service; and based on the service monitoring result, generating a target page for displaying the service distribution rule of the multiple groups of monitoring index data in the multiple historical time windows. The invention further provides a service monitoring device, equipment, a storage medium and a program product.

Description

Technical Field

[0001] The present disclosure relates to the fields of big data technology and financial technology, and more specifically to a business monitoring method, device, equipment, storage medium and program product. Background Art

[0002] The method of monitoring the operation of a business is generally to query the business operation data through a query platform or manually query the business operation data from a database. For example, when monitoring the operation of a transaction, you can manually write a database query statement and use the database query statement to obtain the relevant transaction operation data from the database.

[0003] In the process of realizing the concept of the present disclosure, the inventors found that there are at least the following problems in the related technologies: as business scenarios become increasingly complex and changeable, and the amount of data grows day by day, the method of querying business operation data from the database will cause a lot of pressure on the database. In addition, manual number checking will result in slow timeliness and complex operations, and developers and application support personnel will have to do a lot of repetitive work, which is time-consuming and labor-intensive. Summary of the invention

[0004] In view of the above problems, the present disclosure provides a business monitoring method, apparatus, device, medium and program product.

[0005] According to the first aspect of the present disclosure, a business monitoring method is provided, including: obtaining a target log sequence related to the business to be monitored from a log message queue; reading monitoring indicators related to the business to be monitored from a pre-built full business indicator table; based on the monitoring indicators, reading multiple groups of monitoring indicator data corresponding to multiple historical time windows from the target log sequence; based on the multiple groups of monitoring indicator data, generating business monitoring results corresponding to the business to be monitored; based on the business monitoring results, generating a target page for displaying the business distribution rules of the multiple groups of monitoring indicator data in multiple historical time windows.

[0006] According to an embodiment of the present disclosure, based on business monitoring results, a target page is generated for displaying the business distribution patterns of multiple groups of monitoring indicator data within multiple historical time windows, including: obtaining a page display template corresponding to the business to be monitored; rendering the business monitoring results based on the page display template to generate a target page.

[0007] According to an embodiment of the present disclosure, a target page is generated based on rendering business monitoring results based on a page display template, including: binding a predetermined page tag and a business monitoring result in the page display template to obtain multiple groups of page rendering data; generating multiple business monitoring trend charts based on the page rendering data, wherein the multiple business monitoring trend charts are respectively used to characterize the business distribution rules of multiple groups of monitoring indicator data in multiple historical time windows; and performing a first page embedding process on the multiple business monitoring trend charts to obtain a target page.

[0008] According to an embodiment of the present disclosure, rendering business monitoring results based on a page display template to generate a target page also includes: determining the degree of overlap corresponding to the business monitoring trend chart; when the degree of overlap is greater than a preset overlap threshold, performing a chart conversion process on the business monitoring trend chart to obtain a business monitoring trend table; and performing a second page embedding process on the business monitoring trend table to obtain the target page.

[0009] According to an embodiment of the present disclosure, the log message queue includes multiple partitions corresponding to multiple businesses one by one, and the multiple businesses include a business to be monitored; obtaining a target log sequence related to the business to be monitored from the log message queue includes: determining the target partition corresponding to the business to be monitored in the log message queue according to the partition field corresponding to the business to be monitored; and reading the target log sequence from the target partition.

[0010] According to an embodiment of the present disclosure, a target log sequence is read from a target partition, including: obtaining from the target partition a plurality of target logs that are related to the business to be monitored and correspond to a plurality of historical time windows; and sorting the plurality of target logs according to timestamps corresponding to the plurality of target logs to obtain a target log sequence.

[0011] According to an embodiment of the present disclosure, the business monitoring method further includes: adjusting monitoring indicators related to the business to be monitored according to the business monitoring results; and updating the full business indicator table according to the adjusted monitoring indicators.

[0012] The second aspect of the present disclosure provides a business monitoring device, including: an acquisition module, used to acquire a target log sequence related to the business to be monitored from a log message queue; a first reading module, used to read monitoring indicators related to the business to be monitored from a pre-built full business indicator table; a second reading module, used to read multiple groups of monitoring indicator data corresponding to multiple historical time windows from the target log sequence based on the monitoring indicators; a first generation module, used to generate business monitoring results corresponding to the business to be monitored based on the multiple groups of monitoring indicator data; a second generation module, used to generate a target page for displaying the business distribution rules of the multiple groups of monitoring indicator data in multiple historical time windows based on the business monitoring results.

[0013] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0014] The fourth aspect of the present disclosure further provides a computer-readable storage medium having a computer program or instructions stored thereon, which implements the steps of the above method when the above computer program or instructions are executed by a processor.

[0015] The fifth aspect of the present disclosure further provides a computer program product, including a computer program or instructions, which implement the steps of the above method when the above computer program or instructions are executed by a processor.

[0016] According to an embodiment of the present disclosure, by reading multiple groups of monitoring indicator data corresponding to multiple historical time windows from a target log sequence, and based on the multiple groups of monitoring indicator data, generating business monitoring results corresponding to the business to be monitored, without the need to query the relevant transaction information from the database each time, the pressure on the database is reduced. In addition, by reading the monitoring indicator data from the target log sequence and generating the business monitoring results, there is no need to write a database query language, so the manual workload can be reduced. Therefore, it at least partially solves the technical problem that the relevant business monitoring method puts a lot of pressure on the database, and the method of regular reading by the staff is inefficient and has a large workload, thereby achieving the technical effect of reducing the pressure on the database, reducing the workload, and improving the efficiency of business monitoring. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above contents and other purposes, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0018] Figure 1 The application scenario diagram of the service monitoring method, apparatus, device, storage medium and program product according to the embodiments of the present disclosure is schematically shown;

[0019] Figure 2 A flowchart of a service monitoring method according to an embodiment of the present disclosure is schematically shown;

[0020] Figure 3 The following schematically shows an interface diagram of a target page according to an embodiment of the present disclosure;

[0021] Figure 4 The following schematically shows an interface diagram of a target page according to another embodiment of the present disclosure;

[0022] Figure 5 The following schematically shows an interface diagram of a target page according to another embodiment of the present disclosure;

[0023] Figure 6 The following schematically shows an interface diagram of a business monitoring trend chart according to an embodiment of the present disclosure;

[0024] Figure 7 The following schematically shows an interface diagram of a business monitoring trend table in a target page according to an embodiment of the present disclosure;

[0025] Figure 8 A schematic diagram of a structure of a service monitoring device according to an embodiment of the present disclosure is shown; and

[0026] Fig. 9 A block diagram of an electronic device suitable for implementing a service monitoring method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0027] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0028] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0029] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0030] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0031] It should be noted that the business monitoring method and device disclosed herein can be used in the fields of big data technology and financial technology technology, and can also be used in any field outside the fields of big data technology and financial technology technology. The application field of the business monitoring method and device disclosed herein is not limited.

[0032] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0033] In the scenario of using personal information for automated decision-making, the methods, devices, and systems provided by the embodiments of the present disclosure provide users with corresponding operation portals for users to choose to agree or reject the automated decision-making results; if the user chooses to reject, the expert decision-making process will be entered. The expression "automated decision-making" here refers to the activity of automatically analyzing and evaluating a person's behavioral habits, interests and hobbies, or economic, health, credit status, etc. through computer programs, and making decisions. The expression "expert decision-making" here refers to the activity of making decisions by people who specialize in a certain field, have specialized experience, knowledge and skills, and have reached a certain level of professionalism.

[0034] The method of monitoring the operation of relevant businesses is generally to query the business operation data through the counting platform, or to manually query the business operation data from the database. For example, when monitoring the operation of a certain transaction business, you can manually write a database query statement and use the database query statement to obtain the relevant transaction business operation data from the database. For example, to monitor whether the total transaction volume of a certain transaction business in region A and region B is roughly consistent, you can manually query the relevant data from the counting platform, or manually write a database query statement, and use the database query statement to obtain the total transaction volume data of the transaction business in region A and region B from the database corresponding to region A and the database corresponding to region B. Or, for example, to monitor the operation of a certain transaction business in two parks after it is put into production, it is generally necessary to manually write query tool scripts and execute these scripts to obtain the relevant data of the two parks. The relevant data can be presented in a table form, and the operation of the transaction business can be obtained by comparing and analyzing the table data.

[0035] In the process of realizing the concept of the present disclosure, the inventors found that there are at least the following problems in the related technologies. On the one hand, the related methods generally rely on manual counting or manual writing of database query statements, which leads to slow timeliness and complex operation. Developers and application support personnel have to do a lot of repetitive work, which is time-consuming and labor-intensive. On the other hand, as business scenarios become increasingly complex and changeable, and the amount of data grows day by day, it is generally necessary to frequently query relevant data from the database when monitoring the operation of the business, which puts a lot of pressure on the database.

[0036] In view of this, an embodiment of the present disclosure provides a business monitoring method, including: obtaining a target log sequence related to the business to be monitored from a log message queue; reading monitoring indicators related to the business to be monitored from a pre-built full business indicator table; based on the monitoring indicators, reading multiple groups of monitoring indicator data corresponding to multiple historical time windows from the target log sequence; based on the multiple groups of monitoring indicator data, generating business monitoring results corresponding to the business to be monitored; based on the business monitoring results, generating a target page for displaying the business distribution patterns of multiple groups of monitoring indicator data within multiple historical time windows.

[0037] Figure 1 The application scenario diagram of the business monitoring method, apparatus, device, storage medium and program product according to the embodiments of the present disclosure is schematically shown.

[0038] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0039] The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).

[0040] The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0041] The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0042] It should be noted that the service monitoring method provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the service monitoring device provided in the embodiment of the present disclosure can generally be set in the server 105. The service monitoring method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Accordingly, the service monitoring device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105.

[0043] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0044] The following will be based on Figure 1 The scene described by Figure 2~Figure 7 The business monitoring method of the embodiment of the present disclosure is described in detail.

[0045] Figure 2 The flowchart of the service monitoring method according to the embodiment of the present disclosure is schematically shown.

[0046] like Figure 2 As shown, the service monitoring method of this embodiment includes operations S210 to S250.

[0047] In operation S210, a target log sequence related to the service to be monitored is obtained from a log message queue.

[0048] In operation S220, monitoring indicators related to the to-be-monitored business are read from a pre-built full-service indicator table.

[0049] In operation S230 , based on the monitoring indicators, multiple groups of monitoring indicator data corresponding to multiple historical time windows are read from the target log sequence.

[0050] In operation S240, a business monitoring result corresponding to the business to be monitored is generated based on the multiple groups of monitoring indicator data.

[0051] In operation S250, based on the business monitoring result, a target page for displaying business distribution patterns of multiple groups of monitoring indicator data in multiple historical time windows is generated.

[0052] According to an embodiment of the present disclosure, in operation S210, the business execution system may process the business request, execute the business process in response to the business request, and generate business data corresponding to the business request. Moreover, after generating the business data, a business log corresponding to the business request may also be generated, and the business log may include an operation execution result, operation detail data, etc. The operation execution result may characterize whether the business execution result is successful, failed, or timed out, and the operation detail data may characterize the operation execution time, operation type, operation result, etc.

[0053] After the business execution system generates a business log corresponding to each business, the business log can be sent to a pre-configured log message queue. When the business monitoring system executes the business monitoring method, the business monitoring system can directly obtain a target log sequence related to the business to be monitored from the log message queue, wherein the target log sequence can include multiple business logs related to the business to be monitored, for example, multiple business logs related to the business to be monitored that are generated at different times. The generation time of each business log can be determined by the timestamp in the business log.

[0054] For example, the business to be monitored may be a transaction business for a target product. For example, the target product has been traded 5 times in total, so the business execution system may execute 5 transaction businesses and generate 5 business logs corresponding to the above 5 transaction businesses. The 5 business logs may be sent to the log message queue so that the subsequent business monitoring system can directly read the corresponding target log sequence from the log message queue when monitoring the transaction business for the target product. The target log sequence may include the above target log sequence.

[0055] According to an embodiment of the present disclosure, in operation S220, different types of monitoring indicators may be required when monitoring the operation of different types of businesses. For example, when monitoring transaction business, the monitoring indicators may include the total transaction volume, transaction success rate, etc. For example, the operation of microservices may also be monitored, and the monitoring indicators corresponding to the microservices include service response time, CPU usage, and memory usage, but are not limited thereto, and may also include, for example, the number of error requests, request data delay, etc.

[0056] For each type of business, at least one initial monitoring indicator corresponding to each type of business can be preliminarily determined. For example, the initial monitoring indicator can be manually determined based on experience. After determining the initial monitoring indicator, historical business data corresponding to at least one initial monitoring indicator within a predetermined historical period can be obtained, and the historical business data can be clustered to obtain a clustering result. The clustering result can include, for example, multiple clusters. Based on the calculated multiple centroids corresponding to the multiple clusters, multiple centroid features corresponding to the multiple clusters can be obtained. Feature analysis of the above multiple centroid features can obtain at least one monitoring indicator corresponding to each type of business. Furthermore, a full business indicator table can be generated based on at least one monitoring indicator corresponding to each type of business.

[0057] For example, the initial monitoring indicators corresponding to the network service business can be predetermined based on experience, including bandwidth utilization, response time, packet loss rate, and traffic peak. The business data corresponding to the above four initial monitoring indicators in the past month can be obtained, and the above business data can be clustered and analyzed to obtain two clusters. Among them, the centroid characteristics of cluster 1 include high bandwidth utilization, long response time, high packet loss rate, and high traffic peak, and the centroid characteristics of cluster 2 include low bandwidth utilization, short response time, low packet loss rate, and high traffic peak. Comparing the centroid characteristics of cluster 1 and cluster 2, it can be seen that the bandwidth utilization, response time, and packet loss rate of cluster 1 and cluster 2 show obvious differences, while the trends of traffic peak are the same. Therefore, bandwidth utilization, response time, and packet loss rate can be used as monitoring indicators corresponding to network service business, so as to focus on the changing trends of bandwidth utilization, response time, and packet loss rate of network service business, and the monitoring indicators can be stored in the full business indicator table.

[0058] According to an embodiment of the present disclosure, in operation S230, after determining the monitoring indicator related to the business to be monitored, the monitoring indicator data corresponding to the monitoring indicator can be read from the log of the business to be monitored. Since the target log sequence includes multiple business logs generated at different times, the monitoring indicator data corresponding to different times can be obtained by reading each business log in the target log sequence, thereby obtaining multiple groups of monitoring indicator data corresponding to multiple historical time windows.

[0059] According to an embodiment of the present disclosure, in operation S240, since multiple groups of monitoring indicator data correspond to multiple historical time windows, by analyzing the temporal distribution trends of the multiple groups of monitoring indicator data, the business operation trends of the business to be monitored can be obtained to obtain business monitoring results.

[0060] According to an embodiment of the present disclosure, in operation S250, when obtaining the business operation trend of the business to be monitored, in order to monitor the business operation trend in real time, the business monitoring result can be visualized, for example, a target page corresponding to the business monitoring result can be generated. Through the target page, the business distribution rules of multiple groups of monitoring indicator data in multiple historical time windows can be obtained, so that the business operation trend of the business to be monitored can be analyzed.

[0061] Figure 3 The following schematically shows an interface diagram of a target page according to an embodiment of the present disclosure.

[0062] like Figure 3 As shown, the business to be monitored can be a transaction business corresponding to a certain mobile phone. Through the full business indicator table, the monitoring indicators corresponding to the transaction business can be read, including the overall response time of the transaction business, and the transaction volume and business response time of the mobile phone after it is put into production in the two parks A and B. The transaction business logs generated from 05:00 to 10:00 can be read from the target log sequence corresponding to the transaction business, and the monitoring indicator data corresponding to the above monitoring indicators can be read from the transaction business log, for example, including reading the overall response time value, the transaction volume value of the two parks A and B, etc., and the business monitoring results corresponding to the transaction business are generated based on the above monitoring indicator values. A target page corresponding to the business monitoring results can be generated. By analyzing the target page, the business distribution law of the transaction business can be obtained. For example, by analyzing the transaction volume of the A park, it can be known that before 08:00, the transaction volume of the park is 0, and after 08:00, the transaction volume gradually increases.

[0063] Figure 4 A schematic diagram of an interface of a target page according to another embodiment of the present disclosure is schematically shown.

[0064] like Figure 4 As shown, monitoring the operation of the monitored business can also be monitoring the operation of microservices. The monitoring indicators corresponding to the microservices include SQL response time, memory usage, etc. Correspondingly, the generated business monitoring results may include the distribution patterns of SQL response time and memory usage at different times.

[0065] According to the embodiments of the present disclosure, further, the latest target log sequence related to the business to be monitored can be obtained from the log message queue at a regular time, so as to generate the latest business monitoring results at a regular time. And by regularly refreshing the target page, the target page can present the latest business distribution law in real time. Furthermore, different refresh times can be set for different types of businesses to be monitored. The refresh frequencies and monitoring indicators of different types of businesses to be monitored are shown in Table 1.

[0066] Table 1

[0067]

[0068] According to the embodiments of the present disclosure, the method in which staff members periodically read the transaction data at the corresponding moment from the database is slow and complicated to operate, and developers and application support personnel need to write different database query languages ​​for different monitored businesses, resulting in a lot of repetitive work, time-consuming and labor-intensive, and difficult to cope with complex and changing business scenarios and growing amounts of data. However, by reading monitoring indicator data from the target log sequence and generating business monitoring results, there is no need to write database query languages, thus reducing manual workload. In addition, by regularly refreshing the target page, the business operation status can be monitored in real time, improving the timeliness of business monitoring.

[0069] According to the embodiments of the present disclosure, multiple groups of monitoring indicator data corresponding to multiple historical time windows are read from the target log sequence, and based on the multiple groups of monitoring indicator data, business monitoring results corresponding to the business to be monitored are generated, without the need to query the relevant transaction information from the database each time, thereby reducing the pressure on the database. The monitoring indicator data can be read from the target message queue in real time, thereby meeting the needs of real-time monitoring of business operation conditions, and by generating a target page for displaying the business distribution rules of multiple groups of monitoring indicator data in multiple historical time windows, the business distribution rules can be visualized, and the business operation conditions can be intuitively displayed.

[0070] According to an embodiment of the present disclosure, based on business monitoring results, a target page is generated for displaying the business distribution patterns of multiple groups of monitoring indicator data within multiple historical time windows, including: obtaining a page display template corresponding to the business to be monitored; rendering the business monitoring results based on the page display template to generate a target page.

[0071] According to the embodiments of the present disclosure, in order to improve page generation efficiency and reduce page maintenance costs and the possibility of errors, a pre-generated page display template can be obtained, and then the business monitoring results can be rendered based on the page display template to obtain a target page. Specifically, different page display templates can be generated for different types of businesses, or different types of businesses can share the same page display template.

[0072] According to the embodiments of the present disclosure, by rendering the business monitoring results based on the page display template to generate a target page, the business monitoring results can be visualized, and the overall picture of the business operation status can be intuitively displayed, so that problems in the business operation process can be discovered in time, and the intelligence level of business monitoring can be improved, reducing labor costs.

[0073] According to an embodiment of the present disclosure, different monitoring indicator fluctuation ranges can be set for different monitoring indicators. When the monitoring indicator data exceeds the preset monitoring indicator fluctuation range, it indicates that the business operation of the monitored business may be abnormal. Therefore, when the monitoring indicator data exceeds the preset monitoring indicator fluctuation range, the abnormal monitoring indicator data can be determined, and an alarm message can be generated to prompt the user to focus on the abnormal monitoring indicator data. Specifically, the alarm message may include an abnormal level, an alarm notification object, an alarm number, etc. The alarm notification object, for example, includes a specified object for receiving the alarm message. The abnormal level may include, for example, a low level, a medium level, and a high level, and the abnormal level may also be represented by a number. The representation method of the abnormal level is not limited here. It is possible to focus on higher-level alarm information, for example, it is possible to focus on medium-level alarm information and high-level alarm information, so that the alarm information can be efficiently managed. In the case of generating alarm information, the alarm information can also be rendered based on a page display template to generate a target page containing the alarm information.

[0074] Figure 5 A schematic diagram of an interface of a target page according to another embodiment of the present disclosure is schematically shown.

[0075] like Figure 5 As shown, after rendering the alarm information and analysis report based on the page display template, a target page containing the alarm information and analysis report can be generated. The target page can include the abnormality level, the time when the abnormal monitoring indicator data is generated, the business involved in the abnormal monitoring indicator data and the park to which the business belongs, and can also include the number of alarms and the alarm status. For the abnormal monitoring indicator data with an abnormality level of 6, since its abnormality level is high and the number of alarms is large, the abnormal monitoring indicator data can be focused on.

[0076] According to an embodiment of the present disclosure, further, after generating the alarm information, an analysis report corresponding to the alarm information can also be generated, for example, the analysis report can be automatically generated by a preset algorithm. Among them, the analysis report can include analysis data corresponding to the abnormal monitoring indicator data, for example, including the cause of the abnormal monitoring indicator data. Through the alarm information and the analysis report, the abnormal situation can be further analyzed and quickly resolved. In the case of generating the analysis report, the analysis report can also be rendered based on the page display template to generate the target page. The target page can also be displayed through the display screen. When the user views the analysis report through the target page, the display screen can be switched to the visualization interface corresponding to the analysis report, so as to view the detailed information corresponding to the abnormal monitoring indicator data through the visualization interface, for example, the cause of the abnormal monitoring indicator data, the main business involved in the abnormal monitoring indicator data, etc., so as to realize the drill-down analysis of the abnormal monitoring indicator data, so as to quickly find the problem corresponding to the abnormal monitoring data and quickly solve it, thereby improving the efficiency of troubleshooting.

[0077] According to an embodiment of the present disclosure, specifically, rendering business monitoring results based on a page display template to generate a target page includes: binding a predetermined page tag and a business monitoring result in the page display template to obtain multiple groups of page rendering data; generating multiple business monitoring trend charts based on the page rendering data, wherein the multiple business monitoring trend charts are respectively used to characterize the business distribution rules of multiple groups of monitoring indicator data within multiple historical time windows; performing a first page embedding process on the multiple business monitoring trend charts to obtain a target page.

[0078] According to an embodiment of the present disclosure, a page display template may include page tags for identifying information such as page content and structure. By binding a predetermined page tag in the page display template with a business monitoring result, the business monitoring result may be filled into a corresponding position in the page display template to obtain page rendering data, which may include specific business monitoring results and page layout information.

[0079] According to an embodiment of the present disclosure, based on the business monitoring results in the page rendering data, multiple business monitoring trend graphs corresponding to multiple monitoring indicators can be generated. Through the multiple business monitoring trend graphs, the distribution law of multiple monitoring indicator data at different times can be presented, thereby presenting the overall business operation law of the entire business to be monitored. Further, through the first page embedding process, the generated business monitoring trend graph can be embedded into the page display template to obtain the target page.

[0080] According to the embodiments of the present disclosure, by generating a business monitoring trend graph, complex business monitoring indicator data can be intuitively displayed. Users can directly obtain the changing trends of different monitoring indicators in different time windows on the target page without having to view a large amount of original data.

[0081] According to an embodiment of the present disclosure, rendering business monitoring results based on a page display template to generate a target page also includes: determining the degree of overlap corresponding to the business monitoring trend chart; when the degree of overlap is greater than a preset overlap threshold, performing a chart conversion process on the business monitoring trend chart to obtain a business monitoring trend table; and performing a second page embedding process on the business monitoring trend table to obtain the target page.

[0082] According to an embodiment of the present disclosure, when there are multiple data lines in a business monitoring trend graph, the multiple data lines may appear too dense to make it difficult to accurately read the data in each data line.

[0083] Figure 6 The interface diagram of the business monitoring trend chart according to an embodiment of the present disclosure is schematically shown.

[0084] like Figure 6 As shown, the monitoring indicator may include, for example, CPU usage. In a CPU usage graph, there are CPU usage lines corresponding to multiple CPUs. However, Figure 6 The data lines such as CPU usage 1 and CPU usage 2 are too dense, making it difficult to accurately distinguish the usage of each CPU at different times.

[0085] According to an embodiment of the present disclosure, after a business monitoring trend graph is generated, when the business monitoring trend graph includes multiple data lines, the overlap of the multiple data lines can be calculated. When the overlap is greater than a preset overlap threshold, it means that the multiple data lines are too dense, and it may be difficult to accurately distinguish the data in the data lines. Therefore, the business monitoring trend graph can be converted into a chart to obtain a business monitoring trend table, so as to display the business distribution rules of multiple groups of monitoring indicator data in multiple historical time windows through the business monitoring trend table. And the business monitoring trend table can be embedded in a page to obtain a target page.

[0086] Figure 7 The following schematically shows an interface diagram of a business monitoring trend table in a target page according to an embodiment of the present disclosure. Figure 7 As shown, accurate monitoring indicator data can be obtained through the business monitoring trend table, thereby effectively avoiding the problem of difficulty in accurately distinguishing the data in the data line, and facilitating users to accurately obtain business operation status through the target page.

[0087] According to an embodiment of the present disclosure, the log message queue includes multiple partitions corresponding to multiple businesses one by one, and the multiple businesses include a business to be monitored; obtaining a target log sequence related to the business to be monitored from the log message queue includes: determining the target partition corresponding to the business to be monitored in the log message queue according to the partition field corresponding to the business to be monitored; and reading the target log sequence from the target partition.

[0088] According to an embodiment of the present disclosure, related logs may be assigned to the same partition, and the related logs may include, for example, logs corresponding to the same business. Since the log message queue includes multiple partitions corresponding to multiple businesses, and each partition only stores logs corresponding to the same business, when searching for logs related to the business to be monitored, it is only necessary to search in the partition corresponding to the business to be monitored, without searching in the entire log data set.

[0089] Specifically, a partition field can be allocated in advance for the business to be monitored. When it is necessary to obtain logs related to the business to be monitored, the target partition corresponding to the partition field can be directly determined based on the partition field corresponding to the business to be monitored, and then at least one log corresponding to the business to be monitored can be read from the target partition to obtain a target log sequence. The partition field can include pre-generated identification information of the business to be monitored.

[0090] According to the embodiments of the present disclosure, a target log sequence related to the business to be monitored is obtained from a log message queue without querying the relevant transaction information from the database each time, which reduces the pressure on the database and can meet the needs of real-time log analysis and monitoring. By dividing the log message queue into multiple partitions and reading the target log sequence from the target partition through the partition field, the search scope can be narrowed, resource consumption can be reduced, and the data processing speed can be improved.

[0091] According to an embodiment of the present disclosure, specifically, a target log sequence is read from a target partition, including: obtaining from the target partition a plurality of target logs related to the business to be monitored and corresponding to a plurality of historical time windows; and sorting the plurality of target logs according to timestamps corresponding to the plurality of target logs to obtain a target log sequence.

[0092] According to the embodiments of the present disclosure, since it is necessary to analyze the overall business operation of the business to be monitored based on the business operation of the business to be monitored in multiple time periods, multiple target logs corresponding to multiple historical time windows can be obtained, and the multiple target logs can reflect the business operation of the business to be monitored in different time periods. Since the timestamp can represent the generation time of the target log, the target logs can be sorted based on the timestamp so that the target log sequence can reflect the business operation of the business to be monitored in multiple time windows.

[0093] According to an embodiment of the present disclosure, the business monitoring method further includes: adjusting monitoring indicators related to the business to be monitored according to the business monitoring results; and updating the full business indicator table according to the adjusted monitoring indicators.

[0094] According to an embodiment of the present disclosure, after generating a business monitoring result, the user's attention to the monitoring indicator can be determined based on the user's feedback on the business monitoring result, and the monitoring indicator can be adjusted based on the attention to each monitoring indicator, for example, the monitoring indicator whose attention is lower than a preset threshold can be deleted, or the attention of the monitoring indicator can be replaced with other monitoring indicators. After adjusting the monitoring indicator, in order to ensure that more accurate monitoring indicators are stored in the full business indicator table, the full business indicator table can be updated based on the adjusted monitoring indicator, for example, the monitoring indicator whose attention is lower than the preset threshold is deleted accordingly, or the replaced monitoring indicator is added.

[0095] According to the embodiments of the present disclosure, users can also add or delete monitoring indicators on the target page according to actual needs. For example, the monitoring indicators for monitoring transaction business include total transaction volume, transaction success rate, etc. Users can add monitoring indicators according to needs, such as adding daily transaction volume indicators.

[0096] According to an embodiment of the present disclosure, by adjusting the monitoring indicators related to the business to be monitored according to the business monitoring results and updating the full business indicator table, the monitoring indicators in the full business indicator table can more accurately characterize the business operation status and can cover a larger range of business operation scenarios.

[0097] Based on the above service monitoring method, the present disclosure also provides a service monitoring device. Figure 8 The device is described in detail.

[0098] Figure 8 The structure block diagram of the service monitoring device according to the embodiment of the present disclosure is schematically shown.

[0099] like Figure 8 As shown, the service monitoring device 800 of this embodiment includes an acquisition module 810 , a first reading module 820 , a second reading module 830 , a first generating module 840 and a second generating module 850 .

[0100] The acquisition module 810 is used to acquire the target log sequence related to the service to be monitored from the log message queue. In one embodiment, the acquisition module 810 can be used to perform the operation S210 described above, which will not be described in detail here.

[0101] The first reading module 820 is used to read the monitoring indicators related to the to-be-monitored business from the pre-built full-volume business indicator table. In one embodiment, the first reading module 820 can be used to perform the operation S220 described above, which will not be described in detail here.

[0102] The second reading module 830 is used to read multiple groups of monitoring indicator data corresponding to multiple historical time windows from the target log sequence based on the monitoring indicator. In one embodiment, the second reading module 830 can be used to perform the operation S230 described above, which will not be repeated here.

[0103] The first generating module 840 is used to generate a service monitoring result corresponding to the service to be monitored based on multiple sets of monitoring indicator data. In one embodiment, the first generating module 840 can be used to perform the operation S240 described above, which will not be described in detail here.

[0104] The second generation module 850 is used to generate a target page for displaying the business distribution rules of multiple groups of monitoring indicator data in multiple historical time windows based on the business monitoring results. In one embodiment, the second generation module 850 can be used to perform the operation S250 described above, which will not be repeated here.

[0105] According to an embodiment of the present disclosure, the second generating module includes an acquiring submodule and a rendering submodule.

[0106] The acquisition submodule is used to obtain the page display template corresponding to the business to be monitored; the rendering submodule is used to render the business monitoring results based on the page display template to generate the target page.

[0107] According to an embodiment of the present disclosure, the rendering submodule includes a binding unit, a generating unit and a first page embedding unit.

[0108] The binding unit is used to bind the predetermined page tags and business monitoring results in the page display template to obtain multiple groups of page rendering data; the generation unit is used to generate multiple business monitoring trend charts based on the page rendering data, wherein the multiple business monitoring trend charts are respectively used to characterize the business distribution rules of multiple groups of monitoring indicator data in multiple historical time windows; the first page embedding unit is used to perform first page embedding processing on multiple business monitoring trend charts to obtain the target page.

[0109] According to an embodiment of the present disclosure, the rendering submodule further includes a first determining unit, a converting unit and a second page embedding unit.

[0110] The first determination unit is used to determine the overlap corresponding to the business monitoring trend chart; the conversion unit is used to perform chart conversion processing on the business monitoring trend chart to obtain a business monitoring trend table when the overlap is greater than a preset overlap threshold; the second page unit is used to perform a second page embedding processing on the business monitoring trend table to obtain a target page.

[0111] According to an embodiment of the present disclosure, the log message queue includes multiple partitions corresponding to multiple services one by one, and the multiple services include the services to be monitored.

[0112] According to an embodiment of the present disclosure, the acquisition module includes a determination submodule and a reading submodule.

[0113] The determination submodule is used to determine the target partition corresponding to the business to be monitored in the log message queue according to the partition field corresponding to the business to be monitored; the reading submodule is used to read the target log sequence from the target partition.

[0114] According to an embodiment of the present disclosure, the reading submodule includes an acquisition unit and a sorting unit.

[0115] The acquisition unit is used to acquire multiple target logs related to the monitored business and corresponding to multiple historical time windows from the target partition; the sorting unit is used to sort the multiple target logs according to the timestamps corresponding to the multiple target logs to obtain a target log sequence.

[0116] According to an embodiment of the present disclosure, the service monitoring device further includes an adjustment module and an update module.

[0117] The adjustment module is used to adjust the monitoring indicators related to the business to be monitored according to the business monitoring results; the update module is used to update the full business indicator table according to the adjusted monitoring indicators.

[0118] According to an embodiment of the present disclosure, any multiple modules of the acquisition module 810, the first reading module 820, the second reading module 830, the first generating module 840, and the second generating module 850 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the acquisition module 810, the first reading module 820, the second reading module 830, the first generating module 840, and the second generating module 850 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation modes of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, at least one of the acquisition module 810, the first reading module 820, the second reading module 830, the first generating module 840 and the second generating module 850 may be at least partially implemented as a computer program module, which may perform corresponding functions when executed.

[0119] Fig. 9 A block diagram of an electronic device suitable for implementing a service monitoring method according to an embodiment of the present disclosure is schematically shown.

[0120] like Fig. 9 As shown, the electronic device 900 according to an embodiment of the present disclosure includes a processor 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage part 908 to a random access memory (RAM) 903. The processor 901 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 901 may also include an onboard memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0121] In RAM 903, various programs and data required for the operation of electronic device 900 are stored. Processor 901, ROM 902 and RAM 903 are connected to each other via bus 904. Processor 901 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 902 and / or RAM 903. It should be noted that the program can also be stored in one or more memories other than ROM 902 and RAM 903. Processor 901 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in one or more memories.

[0122] According to an embodiment of the present disclosure, the electronic device 900 may further include an input / output (I / O) interface 905, which is also connected to the bus 904. The electronic device 900 may further include one or more of the following components connected to the input / output (I / O) interface 905: an input portion 906 including a keyboard, a mouse, etc.; an output portion 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 908 including a hard disk, etc.; and a communication portion 909 including a network interface card such as a LAN card, a modem, etc. The communication portion 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the input / output (I / O) interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that a computer program read therefrom is installed into the storage portion 908 as needed.

[0123] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0124] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include the ROM 902 and / or RAM 903 described above and / or one or more memories other than ROM 902 and RAM 903.

[0125] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the service monitoring method provided by the embodiment of the present disclosure.

[0126] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 901. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0127] In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of a signal on a network medium, and downloaded and installed through the communication part 909, and / or installed from a removable medium 911. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0128] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the processor 901, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0129] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0130] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0131] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0132] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A business monitoring method, characterized in that: The method comprises: Obtain the target log sequence related to the business to be monitored from the log message queue; Reading monitoring indicators related to the business to be monitored from a pre-built full-volume business indicator table; Based on the monitoring indicators, multiple groups of monitoring indicator data corresponding to multiple historical time windows are read from the target log sequence; Based on the multiple groups of monitoring indicator data, generating a business monitoring result corresponding to the business to be monitored; Based on the business monitoring results, a target page is generated for displaying the business distribution patterns of the multiple groups of monitoring indicator data within the multiple historical time windows.

2. The method according to claim 1, characterized in that The generating, based on the business monitoring result, a target page for displaying the business distribution rules of the multiple groups of monitoring indicator data in the multiple historical time windows includes: Obtaining a page display template corresponding to the business to be monitored; The business monitoring result is rendered based on the page presentation template to generate the target page.

3. The method according to claim 2, characterized in that The rendering of the business monitoring result based on the page display template to generate the target page includes: Binding the predetermined page mark in the page display template and the business monitoring result to obtain multiple groups of page rendering data; Based on the page rendering data, generate multiple business monitoring trend graphs, wherein the multiple business monitoring trend graphs are respectively used to characterize the business distribution rules of the multiple groups of monitoring indicator data in the multiple historical time windows; A first page embedding process is performed on the multiple business monitoring trend graphs to obtain the target page.

4. The method according to claim 3, characterized in that The rendering of the business monitoring result based on the page display template to generate the target page also includes: Determining a degree of overlap corresponding to the business monitoring trend graph; When the overlap is greater than a preset overlap threshold, the business monitoring trend graph is converted into a chart to obtain a business monitoring trend table; The business monitoring trend table is subjected to second page embedding processing to obtain the target page.

5. The method according to claim 1, characterized in that The log message queue includes a plurality of partitions corresponding to a plurality of services one by one, and the plurality of services include the service to be monitored; The step of obtaining a target log sequence related to the business to be monitored from the log message queue includes: Determine, according to the partition field corresponding to the business to be monitored, a target partition in the log message queue corresponding to the business to be monitored; The target log sequence is read from the target partition.

6. The method according to claim 5, characterized in that The reading the target log sequence from the target partition includes: Acquire, from the target partition, a plurality of target logs related to the service to be monitored and corresponding to the plurality of historical time windows; The multiple target logs are sorted according to the timestamps corresponding to the multiple target logs to obtain the target log sequence.

7. The method according to claim 1, characterized in that The method further comprises: According to the business monitoring result, adjusting the monitoring indicators related to the business to be monitored; The full business indicator table is updated according to the adjusted monitoring indicators.

8. A service monitoring device, characterized in that: The device comprises: The acquisition module is used to obtain the target log sequence related to the business to be monitored from the log message queue; A first reading module is used to read the monitoring indicators related to the business to be monitored from a pre-built full business indicator table; A second reading module is used to read multiple groups of monitoring indicator data corresponding to multiple historical time windows from the target log sequence based on the monitoring indicator; A first generating module, configured to generate a business monitoring result corresponding to the business to be monitored based on the multiple groups of monitoring indicator data; The second generating module is used to generate a target page for displaying the business distribution patterns of the multiple groups of monitoring indicator data within the multiple historical time windows based on the business monitoring results.

9. An electronic device, comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

11. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images