An intelligent monitoring operation and maintenance method and system and a storage medium

Abstract

The application provides an intelligent monitoring operation and maintenance method, system and storage medium, and relates to the field of monitoring platforms.The intelligent monitoring operation and maintenance method comprises the following steps: a jar component pushes a message in an asynchronous mode in a business application system embedded with a monitoring service platform, and the message comprises transaction data of the business application system; according to a working principle mechanism of an MQ message queue, the business application system is defined as a message producer, the monitoring service platform is defined as a message consumer, and a message queue name for connecting the producer and the consumer is set; the monitoring service platform executes a business function according to the transaction data of the business application system, analyzes a system operation health status, and pushes monitoring early warning information when the system operation health status is unhealthy.The application can realize effective monitoring of the business application system, thereby ensuring business development and business continuity, reducing manual input cost, and improving user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of monitoring platforms, in particular to an intelligent monitoring and operation method and system and a storage medium. BACKGROUND

[0002] With the advancement of digital transformation in various industries, system monitoring and operation will also be more and more refined. Through the rapid integration of components with various business application systems, data sharing and interaction are realized, thereby building an intelligent monitoring and operation platform for the whole link business process integration, which will also help to promote the pace of bank digital transformation. With the rapid development of banking business and the increasing complexity of system architecture, in order to improve the stability, efficiency and security of the system, an intelligent monitoring and operation platform is built, which can improve the operation efficiency, reduce the failure rate, help customers to reduce cost, improve quality and efficiency, and improve user experience, promote the business development and innovation of customers.

[0003] In the technical architecture of the existing monitoring platform, the alarm information of general indicators such as the transaction volume, transaction success rate, response time statistics, and timeout response success rate of the business application system is monitored centrally. However, with the increasing number of production business activities, the complexity and variability of business rules, and the rapid growth of third-party cooperation institutions for market expansion, the amount of business data is increasing. How to effectively monitor the business application system of the third-party cooperation institution caused by frequent personnel changes, thereby ensuring business development and business continuity, reducing manual labor costs, and improving user experience is a technical problem that needs to be solved in this field. SUMMARY

[0004] The purpose of the present application is to provide an intelligent monitoring and operation method, system and storage medium, which can solve the problem of complex operation of the business application system of the third-party cooperation institution caused by frequent personnel changes, realize effective monitoring of the business application system, thereby ensuring business development and business continuity, reducing manual labor costs, and improving user experience.

[0005] To solve the above technical problems, the technical solution adopted by the present application is:

[0006] An intelligent monitoring and operation method, comprising:

[0007] The jar component pushes the message asynchronously in the business application system embedded in the monitoring service platform, and the message includes the transaction data of the business application system;

[0008] According to the working principle mechanism of the MQ message queue, the business application system is defined as the producer of the message, and the monitoring service platform is defined as the consumer of the message, and the message queue name of the connection between the producer and the consumer is set;

[0009] starting services of the business application system and the monitoring service platform; the monitoring service platform executes a business function according to transaction data of the business application system, analyzes a system running health condition, and pushes a monitoring early warning information when the system running health condition is unhealthy.

[0010] After starting the services of the business application system and the monitoring service platform, the method further includes:

[0011] configuring a plurality of monitoring indexes of the monitoring service platform; the plurality of monitoring indexes include any one or more of monitoring levels, monitoring transaction functions, monitoring frequencies, monitoring times, monitoring thresholds, and monitoring message notification manners.

[0012] The monitoring component asynchronously collects transaction request information and pushes the transaction request information to the monitoring service platform in real time; the monitoring service platform saves the pushed transaction request information to a transaction database, and generates a unique primary key ID and a transaction time;

[0013] The business application system receives the transaction data through a real-time interface called by a channel end; when the transaction of the business application system is completed and the channel end is returned, the monitoring component asynchronously collects transaction return information and pushes the transaction return information to the monitoring service platform in real time; the monitoring service platform updates the pushed transaction return information to the transaction database according to the primary key ID.

[0014] The transaction return information includes any one or more of a transaction service code, a transaction request time, a transaction calling channel, transaction processing server information, a transaction state, a transaction return time, a transaction response code, and a transaction response description.

[0015] The business function includes any one or more of monitoring platform processing task list query, transaction volume statistics, transaction time consumption statistics, transaction success rate, and business failure rate statistics.

[0016] The system running health condition includes any one or more of unhealthy conditions such as a business scenario, a valid time, and a stock check result not passing, and a system exception not being captured.

[0017] The monitoring service platform adopts a springboot technical framework, establishes a connection with a database, integrates a Dubbo open source Java RPC remote calling framework and a VUE+echarts technology, returns monitoring result data queried and counted by a service backend to execute a business function to a front end in an array list, and the front end visually presents the result data in a report+chart manner.

[0018] The system running health condition comprises: statistical analysis of monitoring level, transaction volume and transaction time consumption, and statistical analysis of transaction success rate and business failure rate.

[0019] An intelligent monitoring operation and maintenance system comprises:

[0020] A jar component is used to embed a monitoring service platform to asynchronously push messages of a business application system, and the messages comprise transaction data of the business application system.

[0021] A message queue configuration module is used to define the business application system as a message producer and the monitoring service platform as a message consumer according to a working principle mechanism of an MQ message queue, and set a message queue name for connection between the producer and the consumer.

[0022] A monitoring component is used to start services of the business application system and the monitoring service platform, execute a business function according to the transaction data of the business application system by the monitoring service platform, analyze system running health condition, and push monitoring early warning information when the system running health condition is unhealthy.

[0023] A computer readable storage medium has a computer program stored thereon, and the computer program is executed by a processor to implement the intelligent monitoring operation and maintenance method.

[0024] Compared with the prior art, the present application has at least the following advantages or beneficial effects:

[0025] The present application provides an intelligent monitoring operation and maintenance method, which uses a jar component to embed a monitoring service platform to asynchronously push transaction data of a business application system, defines the business application system as a message producer and the monitoring service platform as a message consumer according to a working principle mechanism of an MQ message queue, sets a message queue name for connection between the producer and the consumer, builds a bridge for asynchronous communication and data transmission between the business application system and the monitoring service platform, starts services of the business application system and the monitoring service platform, executes a business function according to the transaction data of the business application system by the monitoring service platform, analyzes system running health condition, and pushes monitoring early warning information when the system running health condition is unhealthy. BRIEF DESCRIPTION OF DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly introduced as follows. It should be understood that the following drawings only show some of the embodiments of the present application, and therefore should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0027] Figure 1 The flowchart of the intelligent monitoring operation and maintenance method of the embodiments of the present application. DETAILED DESCRIPTION

[0028] In order to make the purposes, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all. The components of the embodiments of the present application described and shown in the drawings herein can be arranged and designed in various different configurations. EMBODIMENT

[0029] Referring to Figure 1 , Figure 1 The flowchart of the intelligent monitoring operation and maintenance method provided by the embodiments of the present application is shown. The intelligent monitoring operation and maintenance method comprises:

[0030] The jar component pushes the message in the business application system embedded with the monitoring service platform asynchronously, and the message includes the transaction data of the above-mentioned business application system;

[0031] According to the working principle mechanism of the MQ message queue, the above-mentioned business application system is defined as the producer of the message, the above-mentioned monitoring service platform is defined as the consumer of the message, and the message queue name of the connection between the producer and the consumer is set;

[0032] The services of the above-mentioned business application system and the above-mentioned monitoring service platform are started; the above-mentioned monitoring service platform executes the business function according to the transaction data of the above-mentioned business application system, analyzes the system running health status, and pushes the monitoring early warning information when the system running health status is not healthy.

[0033] After the services of the above-mentioned business application system and the above-mentioned monitoring service platform are started, the method further comprises:

[0034] The multiple monitoring indexes of the above-mentioned monitoring service platform are configured; the multiple monitoring indexes include any one or more of the following information: monitoring level, monitoring transaction function, monitoring frequency, monitoring time, monitoring threshold and monitoring message notification mode.

[0035] The transaction request information is collected asynchronously by the monitoring component and pushed to the monitoring service platform in real time; the monitoring service platform saves the pushed transaction request information to the transaction database and generates a unique primary key ID and a transaction time;

[0036] The transaction data is received by the business application system through the real-time interface called by the channel end; when the transaction of the business application system is completed and the channel end is returned, the monitoring component collects the transaction return information asynchronously and pushes it to the monitoring service platform in real time; the monitoring service platform updates the pushed transaction return information to the transaction database according to the primary key ID.

[0037] The transaction return information includes any one or more of transaction service code, transaction request time, transaction calling channel, transaction processing server information, transaction status, transaction return time, transaction response code and transaction response description.

[0038] The business functions include any one or more of monitoring platform processing task list query, transaction volume statistics, transaction time consumption statistics, transaction success rate and business failure rate statistics.

[0039] The system running health status includes any one or more of business scenarios, valid time and inventory check result not passed, and system exception not captured.

[0040] The monitoring service platform uses the springboot technology framework, establishes a connection with the database, integrates the open source Java RPC remote calling framework of Dubbo and the VUE+echarts technology, returns the monitoring result data queried and counted by the service backend to execute business functions to the front end in an array list, and the front end presents the result data in a visualized manner in the form of report + chart.

[0041] The analysis of the system running health status includes statistical analysis of monitoring level, transaction volume and transaction time consumption, and statistical analysis of transaction success rate and business failure rate.

[0042] The built monitoring service platform is independent of the business application system, so as to be decoupled from the business application system and avoid affecting the existing business. The specific content of the multiple monitoring indicators configured in the monitoring service platform is as follows: when configuring the monitoring level, the monitoring level is set according to the four-quadrant rule, the level is set to 1 for important + urgent, the level is set to 2 for important but not urgent, the level is set to 3 for urgent but not important, and the level is set to 4 for ordinary monitoring, such as monitoring of key core scene functions. Configure the monitoring transaction function, set each transaction scene function that needs to be monitored, set to online interface, online interface response code, batch task, and accurately monitor each function task involved in the scene, so as to quickly locate the problem cause. By fusing the monitoring level, the monitoring frequency is set, such as the monitoring of key core functions, which can be set to a higher frequency, so as to always pay attention to key alarm problems and avoid missing. According to the specific scene function, the monitoring time is set, such as real-time online interface function, set real-time monitoring alarm, periodic batch task function, set periodic time alarm; so as to classify processing, reduce unnecessary loss of the system, and improve the monitoring processing efficiency. According to the specific scene function, the monitoring threshold parameter is configured. The notification of alarm problems supports the ways of short message, APP message, WeChat, and email; the monitoring message notification way is through mobile notification, which is convenient for holiday on-duty personnel to discover problems in time and reduce the investment of on-site on-duty personnel.

[0043] The business application system receives the transaction information of the real-time interface called by the channel end, the monitoring component asynchronously collects transaction service code, transaction request time, transaction calling channel, transaction processing server information and other transaction request information and synchronously pushes to the monitoring service platform in real time, the monitoring service platform adds and saves the pushed request transaction information to the storage device (this scheme takes the transaction database as an example), and generates a unique primary key ID and transaction time. When the business application system returns to the channel end after processing the business logic, the monitoring component asynchronously collects transaction service code, transaction state, transaction return time, transaction response code, transaction response description and other transaction return information and synchronously pushes to the monitoring service platform in real time, and the monitoring service platform updates the pushed return transaction information to the transaction database according to the unique primary key ID.

[0044] The monitoring platform processes the task list query, queries the parameter rules of the transaction scene monitoring index configuration through a structured SQL query statement, and the query statement is sorted in ascending order by the field of the monitoring level, so as to timely and preferentially process important and urgent monitoring tasks, such as preferentially processing key core transaction functions. Transaction volume statistics: according to the monitoring processing task obtained by querying, the saved business transaction data is matched with the monitoring transaction function, the structured SQL statement is used, and the total transaction volume in the last one hour is statistically grouped according to the transaction time in seconds; at the same time, for the transaction scene with transaction volume exceeding the threshold, the total transaction volume of the last period is synchronously statistically, the total transaction volume of the latest period and the total transaction volume of the last period are compared, and the monitoring early warning information is pushed in real time in the configured monitoring notification mode, such as timely discovery of the problem of shearing sheep hair event. Transaction time consumption statistics: important and urgent transaction volume time consumption is statistically, the structured query SQL statement is used, the transaction time consumption (the difference between the transaction request time and the transaction response time) of each transaction is statistically grouped according to the transaction time in seconds every 10 minutes; and according to the monitoring time parameter, the transaction with time consumption greater than 5 seconds is pushed in real time in the configured monitoring notification mode, so as to timely respond to the problem of system performance caused by sudden increase of transaction concurrency, accurately locate the problem, improve the troubleshooting efficiency, and thus avoid affecting a large number of businesses and guarantee the business continuity. For example, if the transaction time consumption lasts for 30 minutes without being solved, the monitoring early warning information is sent regularly according to the configured monitoring frequency parameter. The statistical data of the health analysis of the business application system is the second-level transaction time consumption statistics, which can effectively analyze the time node of the system bottleneck, quickly locate the system performance problem, and improve the solving efficiency.

[0045] Transaction success rate and business failure rate statistics: according to the collected business transaction information, the monitoring transaction function is taken as an atomic element, that is, the statistical dimension is the smallest business scene statistical dimension in the business application system, so that the latest transaction success rate and business failure rate data of each transaction function per day are statistically every 10 minutes, the calculation method is: the total transaction volume M, the total transaction success volume N of the transaction success response code, and the total transaction failure response code N2, the success rate C=N / M*100%, and the failure rate F=N2 / M*100%.

[0046] The business transaction information, such as transaction information, includes: transaction service code, transaction request time, transaction calling channel, transaction processing server information, transaction state, transaction return time, transaction response code, and transaction response description. The statistical method is: according to the above-mentioned saved business transaction information, the total transaction amount per second is grouped and counted by structured SQL language according to the transaction time of the saved data, and the total transaction success and transaction failure amount per second is grouped and counted according to the transaction response code. For example, the transaction response code 0000 represents transaction success, and the code 0001 represents transaction failure caused by business rule verification failure. The failure reasons may be as follows: 1. Different business scenarios have different business rule parameter configurations, such as the scene should be configured to allow a certain channel end to call a coupon, but the business is not configured to allow, and the system does not pass the existing rule configuration verification, that is, the transaction fails; 2. The third-party activity of the third-party cooperation agency expires, but the business does not update the activity validity period in time, and the system also does not pass the verification, that is, the transaction fails; 3. The inventory of the marketing activity is insufficient, and the business does not maintain the inventory in time, and the system also does not pass the verification, that is, the transaction fails; 4. The system exception is not effectively captured, and the system also returns transaction exception, that is, the transaction fails. For a business application system with complex business rules, this monitoring data display method can reduce the operation and maintenance pressure, reduce the manual troubleshooting cost, and also can discover abnormal problems that are not controlled by the system in advance.

[0047] The monitoring service platform adopts the springboot technical framework, establishes a connection with the database, integrates the high-performance, lightweight open source Java RPC remote calling framework of Dubbo and the VUE+echarts technology, returns the above monitoring result data queried and counted by the service backend to the front end in an array list, and the front end presents the result data in a report+chart manner. At the same time, the chart displays the servers where the failed transactions are distributed, generates report information and charts, and pushes them to the email of the designated contact person, so that the operation and maintenance personnel can quickly check the logs on the designated server to locate the problem; at the same time, if the transaction success rate and the business failure rate exceed the threshold value of the monitoring, the real-time monitoring early warning information is pushed in the configured monitoring notification mode, so as to discover whether there is a system performance problem caused by a sudden increase in transaction volume, or a sudden increase in business failure rate caused by business configuration rule parameter problems, which affects the customer experience.

[0048] Through the data analysis of the monitoring and statistics of the business application system, and through the front-end echarts component method, the data is visualized to facilitate comprehensive analysis and diagnosis of the health status of the system: 1. According to the transaction time consumption statistics, the important and urgent transaction volume and time consumption statistics are obtained, and the transaction time consumption of each transaction is obtained, so that according to the monitoring time parameter, the transactions with time consumption greater than 5 seconds are pushed in real time with the configured monitoring notification mode to push real-time monitoring warning information, so as to timely respond to the system performance problems caused by the sudden increase of transaction concurrency; the statistical analysis of the monitoring level and the transaction volume time consumption, the statistical analysis of the transaction volume time consumption of the high monitoring level: according to the change of the transaction volume, the business system response time is analyzed, so as to deeply analyze the performance bottleneck of the business application system, such as program performance, server performance, database performance, etc., so as to facilitate the development of corresponding solutions, such as program optimization, server resource expansion, CPU, memory, and performance improvement solutions such as database and table splitting, so as to ensure business continuity and reduce the cost of manual solution after the fact; 2. Statistical analysis of transaction success rate and business failure rate: every 10 minutes, the latest transaction success rate and business failure rate data of each transaction scene is calculated, and through the statistical analysis of the success rate and the failure rate, and by combining the recorded transaction calling channel, transaction state, transaction response description, the reason for the decrease of the success rate and the increase of the business failure rate in a certain transaction scene can be located, the manual troubleshooting cost is reduced, and the troubleshooting efficiency is improved, such as expiration of third-party cooperative institution activity, unchecking of application channel calling due to coupon issuance, and right reservation times exceeding the limit warning, so as to guide the business to analyze whether the configuration rules are incorrect according to the business scene, and to adjust the incorrect configuration rules in time to improve user experience.

[0049] Compared with the prior art, the present application can reduce cost, improve quality and increase efficiency: through the intelligent monitoring and operation platform, the problem can be accurately located, the emergency efficiency is greatly improved, the labor cost is reduced, the research and development efficiency and operation quality are improved; improve user experience: empower business marketing activities, real-time monitor and warn activity inventory, abnormal inter-system link calling, and abnormal cooperative merchant system, and efficiently solve problems to reduce user complaints and provide better service and experience to increase user stickiness; promote innovation: through the intelligent monitoring and operation platform, customer business innovation can be promoted to quickly adapt to changes in business needs, thereby helping customers seize new business development opportunities; data transformation: with the rapid development of banking business and the increasing complexity of system architecture, to promote customers to accurately locate and quickly respond, based on the existing monitoring platform implementation experience, the intelligent monitoring and operation platform of the whole link business process integration is expanded and constructed, which will also help to promote the pace of bank data digitization.

[0050] The above descriptions are only the preferred embodiments of the present application, and are not intended to limit the present application. The present application can have various modifications and changes for those skilled in the art. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. An intelligent monitoring operation and maintenance method, characterized in that, Comprise: The jar component embeds the monitoring service platform in the business application system to asynchronously push messages, and the messages include transaction data of the business application system; wherein the business application system receives the transaction data through a real-time interface called by a channel end; According to the working principle mechanism of the MQ message queue, the business application system is defined as a message producer, and the monitoring service platform is defined as a message consumer, and a message queue name for connecting the producer and the consumer is set; The monitoring component starts the services of the business application system and the monitoring service platform; the monitoring service platform executes business functions according to the transaction data of the business application system, analyzes the system running health status, and pushes monitoring warning information when the system running health status is unhealthy; the monitoring component asynchronously collects transaction request information and pushes it to the monitoring service platform in real time; The monitoring service platform saves the pushed transaction request information to a transaction database, and generates a unique primary key ID and a transaction time; When the business application system transaction is completed and the channel end is returned, the monitoring component asynchronously collects transaction return information and pushes it to the monitoring service platform in real time; The monitoring service platform updates the pushed transaction return information to the transaction database according to the primary key ID; The analysis of the system running health status includes statistical analysis of monitoring level, transaction volume and transaction time consumption, as well as statistical analysis of transaction success rate and business failure rate, which includes: statistical analysis of transaction time consumption at a frequency of seconds, and real-time pushing of warnings when the single transaction time consumption is greater than a preset threshold; The monitoring result data queried and counted by the service backend executing business functions are returned to the front end in an array list by fusing the open source Java RPC remote call framework Dubbo and VUE+echarts technology, and the front end visualizes the result data in the form of report+chart. 2.The intelligent monitoring operation and maintenance method of claim 1, wherein, After starting the services of the business application system and the monitoring service platform, the method further comprises: Configuring multiple monitoring indicators of the monitoring service platform; the multiple monitoring indicators include any one or more of monitoring level, monitoring transaction function, monitoring frequency, monitoring time, monitoring threshold and monitoring message notification mode. 3.The intelligent monitoring operation and maintenance method of claim 1, wherein, The transaction return information includes any one or more of transaction service code, transaction request time, transaction calling channel, transaction processing server information, transaction state, transaction return time, transaction response code and transaction response description. 4.The intelligent monitoring operation and maintenance method of claim 1, wherein, The business functions include any one or more of monitoring platform processing task list query, transaction volume statistics, transaction time consumption statistics, transaction success rate and business failure rate statistics.

5. The intelligent monitoring operation and maintenance method of claim 1, wherein, The system running health status includes any one or more of unhealthy conditions such as business scenario, effective time and inventory check result not passed, and system exception not captured.

6. The intelligent monitoring operation and maintenance method of claim 1, wherein, The monitoring service platform uses a springboot technology framework and is connected with a database.

7. An intelligent monitoring operation and maintenance system, characterized in that, Comprise: jar component, the business application system embeds the monitoring service platform to asynchronously push a message, the message includes transaction data of the business application system; wherein the business application system receives the transaction data through a real-time interface called by a channel end; A message queue configuration module defines the business application system as a message producer and the monitoring service platform as a message consumer according to the working principle mechanism of the MQ message queue, and sets the message queue name of the connection between the producer and the consumer; A monitoring component starts the services of the business application system and the monitoring service platform; the monitoring service platform executes a business function according to the transaction data of the business application system and analyzes the system running health status, and pushes a monitoring early warning information when the system running health status is unhealthy; asynchronously collects transaction request information and pushes it to the monitoring service platform in real time; The monitoring service platform saves the pushed transaction request information to a transaction database, and generates a unique primary key ID and a transaction time; When the business application system transaction is completed and returns to the channel end, the monitoring component asynchronously collects transaction return information and pushes it to the monitoring service platform in real time; The monitoring service platform updates the pushed transaction return information to the transaction database according to the primary key ID; The analysis of the system running health status includes statistical analysis of monitoring level, transaction volume and transaction time consumption, and statistical analysis of transaction success rate and business failure rate, wherein it includes: statistical analysis of transaction time consumption at a second level, and real-time pushing of early warning when the single transaction time consumption is greater than a preset threshold; The monitoring result data returned to the front end by the service back end is visualized in the form of report and chart by the front end through the combination of Dubbo's open source Java RPC remote call framework and VUE+echarts technology.

8. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by a processor to realize an intelligent monitoring operation and maintenance method according to any one of claims 1-6. The computer program is executed by a processor to realize an intelligent monitoring operation and maintenance method according to any one of claims 1-6.

Images