Intelligent monitoring operation and maintenance method and system and storage medium

Abstract

The invention provides an intelligent monitoring operation and maintenance method and system and a storage medium, and relates to the field of monitoring platforms. The invention discloses an intelligent monitoring operation and maintenance method, and the method comprises the steps: enabling a jar assembly to embed a monitoring service platform asynchronous push message in a business application system, and the message comprises the transaction data of the business application system; according to a working principle mechanism of an MQ message queue, defining a service application system as a producer of the message and a monitoring service platform as a consumer of the message, and setting a message queue name of connection between the producer and the consumer; and the monitoring service platform executes a business function according to the transaction data of the business application system, analyzes the running health condition of the system, and pushes monitoring and early warning information when the system is not healthy. According to the invention, effective monitoring of the service application system can be realized, so that service development and service continuity guarantee are ensured, labor input cost is reduced, and user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of monitoring platforms, and in particular to an intelligent monitoring operation and maintenance method, system and storage medium. Background Art

[0002] With the advancement of digital transformation in all industries, system monitoring and operation will become more and more refined. Through the rapid integration of components with various business application systems, data sharing and interaction can be achieved, thereby building an intelligent monitoring and operation platform that integrates the entire business process, which will also help promote the pace of digital transformation of banks. With the rapid development of banking business and the increasing complexity of system architecture, in order to improve the stability, efficiency and security of the system, building an intelligent monitoring and operation platform can improve operation and maintenance efficiency, reduce failure rates, and help customers reduce costs, improve quality and efficiency, and enhance user experience, promoting customer business development and innovation.

[0003] In the technical architecture of the existing monitoring platform, the alarm information of general indicators such as transaction volume, transaction success rate, response time statistics, timeout response success rate, etc. of the business application system has been centrally monitored. However, with the increasing number of production business activities, the business rules are complex and changeable. In order to expand the market, third-party cooperation agencies are also growing rapidly, and the amount of business data is increasing day by day. How to solve the problem of frequent personnel changes leading to complex operation of the business application system of third-party cooperation agencies, realize effective monitoring of the business application system, thereby ensuring business development and business continuity, reducing labor input costs, and improving user experience, is a technical problem that urgently needs to be solved in this field. Summary of the invention

[0004] The purpose of the present invention is to provide an intelligent monitoring and operation and maintenance method, system and storage medium, which can solve the problem of complex operation of the business application system of a third-party cooperation organization due to frequent personnel changes, realize effective monitoring of the business application system, thereby ensuring business development and business continuity, and reducing labor input costs and improving user experience.

[0005] In order to solve the above technical problems, the technical solution adopted by the present invention is: An intelligent monitoring operation and maintenance method, comprising: The jar component is embedded in the business application system and the monitoring service platform pushes messages asynchronously. The messages include the transaction data of the above business application system. According to the working principle mechanism of MQ message queue, define the above business application system as the producer of messages, the above monitoring service platform as the consumer of messages, and set the message queue name connecting the producer and the consumer; Start the services of the above-mentioned business application system and the above-mentioned monitoring service platform; the above-mentioned monitoring service platform executes business functions according to the transaction data of the above-mentioned business application system, analyzes the health status of the system operation, and pushes monitoring warning information when it is unhealthy.

[0006] After the above-mentioned business application system and the above-mentioned monitoring service platform services are started, it also includes: Configure multiple monitoring indicators of the above monitoring service platform; the multiple monitoring indicators include any one or more of the monitoring level, monitoring transaction function, monitoring frequency, monitoring time, monitoring threshold and monitoring message notification method.

[0007] Asynchronously collect transaction request information through the monitoring component and push it to the monitoring service platform in real time; the monitoring service platform saves the pushed transaction request information to the transaction database and generates a unique primary key ID and transaction time; The above-mentioned business application system receives the above-mentioned transaction data through the real-time interface called by the channel end; when the transaction of the above-mentioned business application system is completed and returned to the channel end, the above-mentioned monitoring component asynchronously collects the transaction return information and pushes it to the above-mentioned monitoring service platform in real time; the above-mentioned monitoring service platform updates the above-mentioned transaction return information pushed to the above-mentioned transaction database according to the above-mentioned primary key ID.

[0008] The above-mentioned transaction return information includes any one or more of the transaction service code, transaction request time, transaction call channel, transaction processing server information, transaction status, transaction return time, transaction response code and transaction response description.

[0009] The above business functions include any one or more of monitoring platform processing task list query, transaction volume statistics, transaction time statistics, transaction success rate and business failure rate statistics.

[0010] The above system operation health status includes any one or more unhealthy conditions such as business scenarios, effective time and inventory verification result failure, and failure to capture system exceptions.

[0011] The above-mentioned monitoring service platform adopts the springboot technology framework. By establishing a connection with the database, integrating Dubbo's open source Java RPC remote call framework and VUE+echarts technology, the monitoring result data collected by the service backend from executing business function queries is returned to the front end in an array list. The front end visualizes the result data in the form of reports + charts.

[0012] The above analysis system operation health status includes: statistical analysis of monitoring level, transaction volume and transaction time, as well as statistical analysis of transaction success rate and business failure rate.

[0013] An intelligent monitoring and operation and maintenance system, comprising: jar component, which embeds the monitoring service platform in the business application system and pushes messages asynchronously. The messages include the transaction data of the above business application system. The message queue configuration module defines the business application system as the message producer and the monitoring service platform as the message consumer according to the working principle mechanism of the MQ message queue, and sets the message queue name connecting the producer and the consumer; The monitoring component starts the services of the above-mentioned business application system and the above-mentioned monitoring service platform; the above-mentioned monitoring service platform executes business functions according to the transaction data of the above-mentioned business application system, analyzes the health status of the system operation, and pushes monitoring warning information when it is unhealthy.

[0014] A computer-readable storage medium having a computer program stored thereon, characterized in that when the computer program is executed by a processor, the above-mentioned intelligent monitoring and operation method is implemented.

[0015] Compared with the prior art, the present invention has at least the following advantages or beneficial effects: The present application provides an intelligent monitoring and operation and maintenance method, which uses jar components to embed a monitoring service platform in the business application system to asynchronously push the transaction data of the business application system; according to the working principle mechanism of the MQ message queue, the business application system is defined as the producer of the message, the monitoring service platform is defined as the consumer of the message, and the message queue name connecting the producer and the consumer is set, so as to build a bridge for asynchronous communication and data transmission between the business application system and the monitoring service platform; the services of the business application system and the monitoring service platform are started; the monitoring service platform executes business functions according to the transaction data of the business application system, analyzes the health status of the system operation, and pushes monitoring warning information when it is unhealthy. In order to solve the problems existing in the prior art, the present application builds a monitoring service platform to collect the transaction data of the business application system, executes business activity functions and analyzes the health status of the system operation through transaction data, and promptly discovers problems in production business, so as to provide data support for comprehensive decision-making analysis of the overall health status of the business application system. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 This is a flow chart of the intelligent monitoring and operation and maintenance method of the embodiment of the present application according to the embodiment of the present invention. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations. Example

[0019] See also Figure 1 , Figure 1 The figure is a flow chart of the intelligent monitoring operation and maintenance method provided by the embodiment of the present application. The intelligent monitoring operation and maintenance method includes: The jar component is embedded in the business application system and the monitoring service platform pushes messages asynchronously. The messages include the transaction data of the above business application system. According to the working principle mechanism of MQ message queue, define the above business application system as the producer of messages, the above monitoring service platform as the consumer of messages, and set the message queue name connecting the producer and the consumer; Start the services of the above-mentioned business application system and the above-mentioned monitoring service platform; the above-mentioned monitoring service platform executes business functions according to the transaction data of the above-mentioned business application system, analyzes the health status of the system operation, and pushes monitoring warning information when it is unhealthy.

[0020] After the above-mentioned business application system and the above-mentioned monitoring service platform services are started, it also includes: Configure multiple monitoring indicators of the above monitoring service platform; the multiple monitoring indicators include any one or more of the monitoring level, monitoring transaction function, monitoring frequency, monitoring time, monitoring threshold and monitoring message notification method.

[0021] Asynchronously collect transaction request information through the monitoring component and push it to the monitoring service platform in real time; the monitoring service platform saves the pushed transaction request information to the transaction database and generates a unique primary key ID and transaction time; The above-mentioned business application system receives the above-mentioned transaction data through the real-time interface called by the channel end; when the transaction of the above-mentioned business application system is completed and returned to the channel end, the above-mentioned monitoring component asynchronously collects the transaction return information and pushes it to the above-mentioned monitoring service platform in real time; the above-mentioned monitoring service platform updates the above-mentioned transaction return information pushed to the above-mentioned transaction database according to the above-mentioned primary key ID.

[0022] The above-mentioned transaction return information includes any one or more of the transaction service code, transaction request time, transaction call channel, transaction processing server information, transaction status, transaction return time, transaction response code and transaction response description.

[0023] The above business functions include any one or more of monitoring platform processing task list query, transaction volume statistics, transaction time statistics, transaction success rate and business failure rate statistics.

[0024] The above system operation health status includes any one or more unhealthy conditions such as business scenarios, effective time and inventory verification result failure, and failure to capture system exceptions.

[0025] The above-mentioned monitoring service platform adopts the springboot technology framework. By establishing a connection with the database, integrating Dubbo's open source Java RPC remote call framework and VUE+echarts technology, the monitoring result data collected by the service backend from executing business function queries is returned to the front end in an array list. The front end visualizes the result data in the form of reports + charts.

[0026] The above analysis system operation health status includes: statistical analysis of monitoring level, transaction volume and transaction time, as well as statistical analysis of transaction success rate and business failure rate.

[0027] The monitoring service platform built is independent of the business application system so as to decouple it from the business application system and avoid affecting the existing business. The specific contents of configuring multiple monitoring indicators of the monitoring service platform are as follows: When configuring the monitoring level, set the monitoring level according to the four-quadrant rule. The important + urgent level is set to 1, the important non-urgent level is set to 2, the urgent but not important level is set to 3, and the general monitoring level is set to 4. For example, the monitoring of key core scene functions is set to monitoring level 1. Configure the monitoring transaction function. By setting each transaction scene function that needs to be monitored, the setting can be refined to the online interface, online interface response code, and batch tasks, and accurately monitor the functional tasks involved in each scene to quickly locate the cause of the problem. By integrating the monitoring level, set the monitoring frequency. For example, for the monitoring of key core functions, a higher frequency can be set so as to always pay attention to key alarm problems and avoid omissions. Set the monitoring time according to the specific scene function, such as real-time online interface function, set real-time monitoring alarm, and regular batch task function, set regular time alarm; so as to classify and process, reduce unnecessary system losses, and improve monitoring processing efficiency. Configure the monitoring threshold parameters according to the specific scene function. Notifications for setting alarm issues support SMS, APP messages, WeChat, and emails; monitoring message notifications are sent via mobile phones, making it easier for holiday duty personnel to discover problems in a timely manner and reduce the input of on-site duty personnel.

[0028] The business application system receives the transaction information of the real-time interface called by the channel end. The monitoring component asynchronously collects the transaction service code, transaction request time, transaction call channel, transaction processing server information and other transaction request information and pushes it to the monitoring service platform in real time. The monitoring service platform saves the pushed request transaction information to the storage device (this solution takes the transaction database as an example) and generates a unique primary key ID and transaction time. When the business application system returns to the channel end after processing the business logic, the monitoring component asynchronously collects the transaction service code, transaction status, transaction return time, transaction response code, transaction response description and other transaction return information and pushes it to the monitoring service platform in real time. The monitoring service platform updates the pushed return transaction information to the transaction database based on the unique primary key ID.

[0029] The monitoring platform processes task list queries, and uses structured SQL query statements to query the parameter rules configured for the transaction scenario monitoring indicators. The query statements are sorted in ascending order based on the monitoring level fields, so that important and urgent monitoring tasks can be processed in a timely and prioritized manner, such as key core transaction functions. Transaction volume statistics: Based on the queried monitoring processing tasks, the monitoring transaction function is matched with the saved business transaction data, and the total transaction volume in the last hour is grouped by transaction time and by second through structured SQL statements; at the same time, for transaction scenarios where the transaction volume exceeds the threshold, the total transaction volume of the previous cycle is synchronously counted, and the total transaction volume of the latest cycle and the total transaction volume of the previous cycle are pushed in real time through the configured monitoring notification method. Monitoring warning information, such as timely discovery of wool-pulling incidents. Transaction time statistics: Statistics on the time consumption of important and urgent transactions. Through structured query SQL statements, statistics on the changes in the time consumption of each transaction (the difference between the transaction request time and the transaction response time) are grouped by seconds every 10 minutes according to the transaction time; and according to the monitoring time parameters, for transactions that take more than 5 seconds, real-time monitoring warning information is pushed in the configured monitoring notification mode, so as to promptly respond to system performance problems caused by the sudden increase in concurrent transactions, accurately locate problems, improve troubleshooting efficiency, thereby avoiding affecting large-scale businesses and ensuring that business continuity is not affected; if the transaction time continues for 30 minutes without being resolved, monitoring warning information is sent regularly according to the configured monitoring frequency parameters. The statistical data of the business application system health analysis is the second-level transaction time statistics, which can effectively analyze the time nodes of system bottlenecks, quickly locate system performance problems, and improve solution efficiency.

[0030] Statistics of transaction success rate and business failure rate: Based on the collected business transaction information, the monitoring transaction function is taken as the atomic element, that is, the statistical dimension is to each transaction interface function, which is the smallest business scenario statistical dimension in the business application system. Therefore, the latest transaction success rate and business failure rate data of each transaction scenario on that day are counted every 10 minutes. The calculation method is: total transaction volume M, total transaction success number of transaction success response code N, total transaction business failure response code N2, success rate C=N / M*100%, failure rate F=N2 / M*100%.

[0031] Business transaction information, such as transaction information including: transaction service code, transaction request time, transaction call channel, transaction processing server information, transaction status, transaction return time, transaction response code, and transaction response description. The statistical method is: according to the above-mentioned saved business transaction information, the total number of transactions per second is grouped and counted by structured SQL language based on the transaction time of the saved data, and the total number of successful and failed transactions per second is grouped and counted by transaction response code. For example, transaction response code 0000 represents a successful transaction, and code 0001 represents a transaction failure caused by a business rule verification failure. The reasons for failure may be as follows: 1. Different business scenarios have different business rule parameter configurations. For example, the scenario should be configured to allow a certain channel end to call for coupon issuance, but the business is not configured to allow it. The system fails to pass the verification through the existing rule configuration, which is a transaction failure; 2. The third-party activity with the third-party cooperation agency expires, but the business does not maintain and update the activity validity period in time, and the system will also fail to verify, which is a transaction failure; 3. The inventory of the marketing activity is insufficient, and the business does not maintain the inventory in time, and the system will also fail to verify, which is a transaction failure; 4. The system abnormality is not effectively captured, and the system will also return a transaction abnormality, which is a transaction failure. For business application systems with more complex business rules, this way of displaying monitoring data can reduce operation and maintenance pressure, reduce manual troubleshooting costs, and also detect abnormal problems that are not controlled by the system in advance.

[0032] The monitoring service platform uses the springboot technology framework. By establishing a connection with the database, integrating Dubbo's high-performance, lightweight open source Java RPC remote call framework and VUE+echarts technology, the above monitoring result data queried and counted by the service backend is returned to the front end in an array list, and the front end visualizes the result data in the form of reports + charts. At the same time, the chart shows the servers where the failed exchanges are distributed, and the generated report information and charts are pushed to the mailbox of the designated contact person, so that the operation and maintenance personnel can quickly troubleshoot the log location problem on the designated server; at the same time, for the transaction success rate and business failure rate exceeding the threshold of the monitoring configuration, the real-time monitoring warning information is pushed in the configured monitoring notification method, so as to promptly discover whether there are system performance problems caused by a sudden increase in transaction volume, or a sudden increase in business failure rate due to business configuration rule parameter problems, affecting customer experience.

[0033] Through the above data analysis of the monitoring statistics of the business application system, and the data is visualized through the front-end echarts component, the health status of the system can be comprehensively analyzed and diagnosed: 1. According to the transaction time statistics, the important + urgent transaction volume and time statistics are obtained, and the time change of each transaction is obtained. According to the monitoring time parameters, for transactions that take more than 5 seconds, real-time monitoring warning information is pushed in the form of configured monitoring notifications, so as to promptly respond to system performance problems caused by the sudden increase in concurrent transactions; Statistical analysis of monitoring level and transaction volume time, for high-monitoring level transaction time, transaction volume and transaction time statistics: Analyze the response time of the business system based on the change of transaction volume, so as to deeply analyze the performance bottleneck of the business application system, such as insufficient program performance, insufficient server performance, insufficient database performance, etc., so as to facilitate the formulation of corresponding 1. Statistical analysis of transaction success rate and business failure rate: The latest transaction success rate and business failure rate data of each transaction scene on that day are counted every 10 minutes. Through statistical analysis of success rate and failure rate, and by combining the recorded transaction call channel, transaction status, and transaction response description, the reasons for the decrease in success rate and increase in business failure rate of a certain transaction scene can be located, reducing the cost of manual investigation and improving the efficiency of investigation, such as the expiration of activities of third-party cooperation institutions, the call to application channels due to the issuance of coupons without checking, and the warning of the number of rights and interests reservations exceeding the limit, so as to guide the business to timely analyze whether the configuration rules are correct according to the business scenario, and adjust the incorrectly configured rules in time to improve the user experience.

[0034] Compared with the prior art, the embodiments of the present application can reduce costs, improve quality and increase efficiency: the intelligent monitoring and operation and maintenance platform can accurately locate problems, greatly improve emergency response efficiency, reduce labor costs, and improve R&D efficiency and operation and maintenance quality; improve user experience: empower business marketing activities, conduct real-time monitoring and early warning of activity inventory, abnormal links between systems, and abnormal systems of cooperative merchants, and efficiently solve problems to reduce user complaints, provide users with better services and experience, and increase user stickiness; promote innovation: the intelligent monitoring and operation and maintenance platform can promote customer business innovation, so as to quickly adapt to changes in business needs, thereby helping customers seize new business development opportunities; digital transformation: with the rapid development of banking business and the increasing complexity of system architecture, in order to promote customers to accurately locate and respond to emergencies quickly, based on the implementation experience of existing monitoring platforms, expand and build an intelligent monitoring and operation and maintenance platform that integrates the entire link business process, which will also help promote the pace of digital transformation of banks.

[0035] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. An intelligent monitoring and operation method, characterized in that: include: The jar component is embedded in the business application system and the monitoring service platform pushes messages asynchronously, and the messages include transaction data of the business application system; According to the working principle mechanism of MQ message queue, define the business application system as the producer of messages, the monitoring service platform as the consumer of messages, and set the message queue name connecting the producer and the consumer; Starting the services of the business application system and the monitoring service platform; The monitoring service platform executes business functions based on the transaction data of the business application system, analyzes the health of the system operation, and pushes monitoring warning information when it is unhealthy.

2. The intelligent monitoring operation and maintenance method according to claim 1, characterized in that: After starting the services of the business application system and the monitoring service platform, the method further includes: Configure multiple monitoring indicators of the monitoring service platform; the multiple monitoring indicators include any one or more of the monitoring level, monitoring transaction function, monitoring frequency, monitoring time, monitoring threshold and monitoring message notification method.

3. The intelligent monitoring operation and maintenance method according to claim 1, characterized in that: Asynchronously collecting transaction request information through the monitoring component and pushing it to the monitoring service platform in real time; the monitoring service platform saves the pushed transaction request information to the transaction database and generates a unique primary key ID and transaction time; The business application system receives the transaction data through a real-time interface called by the channel end; when the transaction in the business application system is completed and returned to the channel end, the monitoring component asynchronously collects the transaction return information and pushes it to the monitoring service platform in real time; the monitoring service platform updates the pushed transaction return information to the transaction database according to the primary key ID.

4. The intelligent monitoring operation and maintenance method according to claim 3, characterized in that: The transaction return information includes any one or more of the transaction service code, transaction request time, transaction calling channel, transaction processing server information, transaction status, transaction return time, transaction response code and transaction response description.

5. The intelligent monitoring operation and maintenance method according to claim 1, characterized in that: The business functions include any one or more of monitoring platform processing task list query, transaction volume statistics, transaction time statistics, transaction success rate and business failure rate statistics.

6. The intelligent monitoring operation and maintenance method according to claim 1, characterized in that: The system operation health status includes any one or more unhealthy conditions among business scenarios, effective time, and inventory verification result failure, and failure to capture system abnormalities.

7. The intelligent monitoring operation and maintenance method according to claim 1, characterized in that: The monitoring service platform adopts the springboot technology framework. By establishing a connection with the database, it integrates Dubbo's open source Java RPC remote call framework and VUE+echarts technology, and returns the monitoring result data collected by the service backend to the front end in an array list. The front end visualizes the result data in the form of reports + charts.

8. The intelligent monitoring operation and maintenance method according to claim 1, characterized in that: The analysis of the system operation health includes: statistical analysis of monitoring level, transaction volume and transaction time, as well as statistical analysis of transaction success rate and business failure rate.

9. An intelligent monitoring and operation system, characterized in that: include: jar component, which embeds the monitoring service platform in the business application system and pushes messages asynchronously, and the messages include transaction data of the business application system; The message queue configuration module defines the business application system as the producer of messages and the monitoring service platform as the consumer of messages according to the working principle mechanism of the MQ message queue, and sets the message queue name for connecting the producer and the consumer; A monitoring component, which starts the services of the business application system and the monitoring service platform; The monitoring service platform executes business functions based on the transaction data of the business application system, analyzes the health of the system operation, and pushes monitoring warning information when it is unhealthy.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, an intelligent monitoring and operation method as described in any one of claims 1 to 8 is implemented.

Images