System running state monitoring method and device, computer equipment and storage medium

[0026] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It is to be understood that data so used can be interchanged under appropriate circumstances so that the embodiments described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" or "having" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed steps or units, but may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.

[0027] The embodiments of the present application may acquire and process related data based on artificial intelligence technology. Among them, artificial intelligence (AI) is a theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. .

[0028] The basic technologies of artificial intelligence generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation/interaction systems, and mechatronics. Artificial intelligence software technology mainly includes computer vision technology, robotics, biometrics, speech processing, natural language processing, and machine learning/deep learning.

[0029] When users use the application system, if there is a system abnormality, they usually report the abnormal problem to the customer service, and then the customer service will hand over the abnormal problem to the developer of the application system. By checking the logs and data of the application system, developers can find and correct errors in the system. This method of handling system exceptions is cumbersome and inefficient. In the related art, it is possible to perform burying in the application system to obtain data and summary information of the location of the burying. However, it is difficult for the buried points to cover all the business of the application system, and the buried points are isolated and scattered, so it is difficult to effectively solve the system abnormality based on the buried point data.

[0030] For ease of understanding, the following describes the specific process of the embodiment of the present invention, please refer to figure 1 , an embodiment of the monitoring method of the system running state in the embodiment of the present invention includes:

[0031] Step S101: Obtain multiple business processes of the target system and multiple business nodes in each business process; wherein, the multiple business processes are obtained by dividing the business of the target system in advance; each business process corresponds to the A business scenario; the connection relationship between multiple business nodes in the business process is determined based on the business processing order of the business process; each business node presets a data type to be collected;

[0032] The target system can be an application system in car insurance, car service, car life, or other functional areas. In advance, developers can divide the business in the target system to obtain multiple business processes, and each business process can correspond to a user business scenario. A business process can include all the steps involved in realizing a particular business. As an example, in the business scenario of purchasing business insurance, the business process corresponding to the business scenario may include steps such as selecting an insurance type, submitting an order, making a payment, and generating an insurance contract. Based on this step, multiple business nodes are set in the business process. Node 1 is used to select insurance types, service node 2 is used to submit orders, and service node 3 is used to pay. Based on the above-mentioned business processing order for purchasing business insurance, multiple business nodes in the business process are connected, so that the multiple business nodes have a sequence.

[0033] In actual implementation, developers set and edit business processes based on the differences in business functions. Specifically, based on the diversity of user scenarios, a variety of services are set in the system for users to choose from. Each service has different functions. Each service corresponds to at least one user scenario. The closed loop of each user scenario is regarded as a process. For example, if a user needs to handle a certain business, it is a closed-loop user scenario from the start of the transaction to the end of the transaction. It is set as a process. In this case, multiple processing stages are usually involved. Therefore, the process needs to be divided into multiple stages. A stage corresponds to one or more service nodes, and each service node is set with a unique node identifier to distinguish different service nodes.

[0034] When a business process includes multiple business nodes, it is necessary to obtain the business node identifiers, and establish the relationship between the nodes according to the business processing sequence. In actual implementation, based on the role of business nodes, it can be divided into task nodes, active nodes, branch nodes, aggregation nodes, decision nodes, etc. The data type of the node data of each node is determined by its own state, such as normal, error , node ID, node name, node interface, process ID of the business process to which it belongs, and runtime business data attributes. These nodes establish relationships in an orderly manner, forming a process. The nodes are connected through an interface, and the interface obtains the corresponding service node ID according to its own node interface, and connects with other service nodes with a logical relationship.

[0035] Step S102, for each service node, set a buried point at a position corresponding to the service node in the target system, and when the target system is running, obtain the data content corresponding to the preset data type of the service node through the buried point;

[0036] The data content corresponding to the business node can be stored in a database, such as a relational database. In actual implementation, each service node can preset a data structure in the database. When the user accesses the application system, if the user accesses a page corresponding to a service node, or the user performs an operation corresponding to the service node, the data content corresponding to the service node is collected. Then, the data content of the business node is stored in the relational database, so that the business node can be queried later to solve the user's problem.

[0037] One or more data acquisition interfaces can be set in the target application system. When there are multiple data acquisition interfaces, a service node is allocated to each interface, and the interface is used to collect the data of the allocated service node. The data collection interface needs to obtain the identifier of the service node corresponding to the interface according to the service function of the service node itself, and the node status reporting function needs to be decoupled and asynchronous with its own service function. That is, in the process of collecting the node data of the service node by the data collection interface, the service function of the application system should not be affected. In the database, the data structure defined for the business node can be in the form of a table structure and stored in the relational database. The node stores relevant interface information and is maintained by SQL (Structured Query Language).

[0038] Step S103 , based on the multiple business processes and the connection relationship between the business nodes in each business process, analyze and process the data content corresponding to the business nodes to obtain the running state data of the target system.

[0039] In this embodiment, the target system is divided into multiple business processes, and each business process includes business nodes that have a connection relationship with each other. Based on this, based on the connection relationship between business nodes and the division of business processes, each business process There is also a relationship between the data contents of the business nodes. Specifically, based on the connection relationship between business nodes, the association relationship between the content data of each business node in the business process can be obtained; based on the division between business processes, the data corresponding to each business process can be divided and compared. , association; in this way, the running status of the target system can be monitored comprehensively, and the running status of the target system can also be monitored as a whole.

[0040] Through the data of each node, the running state of the system can be analyzed, and the system state data can be obtained, and the system state data can be used for search and query. Developers can understand the operation of the system from the system status data, which is convenient to quickly understand the function and performance of the system.

[0041] The monitoring method for the above-mentioned system running state obtains multiple business processes of the target system and multiple business nodes in each business process; wherein, the multiple business processes are obtained by dividing the business of the target system in advance; each business process Corresponds to a business scenario in the target system; the connection relationship between multiple business nodes in the business process is determined based on the business processing order of the business process; each business node presets the type of data to be collected; for each business node , set a buried point at the position corresponding to the business node in the target system, and when the target system is running, obtain the data content corresponding to the preset data type of the business node through the buried point; The connection relationship between the nodes is analyzed, and the data content corresponding to the business node is analyzed and processed to obtain the running status data of the target system. In the above method, on the one hand, since the application system is pre-divided into multiple business processes, and each business process includes multiple business nodes, the operation status of the application system can be comprehensively monitored, and the data between each business node can be used by customer service personnel. View to quickly discover the cause of system anomalies and resolve them. On the other hand, the application system is divided into multiple business processes, and these business processes can cover most of the business of the application system. The business nodes are divided based on the business process, and the data of the business nodes are related based on the business process. Monitor the running status of the application system. When the system is abnormal, the data of multiple related business nodes can be linked and analyzed to improve the efficiency of solving system abnormalities and make the operation of the application system more stable.

[0042] see figure 2 , an embodiment of the monitoring method of the system running state in the embodiment of the present invention includes:

[0043] Step S201, obtaining multiple business processes of the target system and multiple business nodes in each business process; wherein, the multiple business processes are obtained by dividing the business of the target system in advance; each business process corresponds to the A business scenario; the connection relationship between multiple business nodes in the business process is determined based on the business processing order of the business process; each business node presets a data type to be collected;

[0044] Step S202, for each service node, set a buried point at the position corresponding to the service node in the target system;

[0045] The business node can correspond to a page or component in the target system, and a piece of code is set at the position of the page and component corresponding to the business node. The code has the relevant data for collecting the page or component corresponding to the business node, and the code is the above-mentioned buried point.

[0046] Step S203, in response to the user performing the business operation on the first business node, generating business operation data generated by the business operation;

[0047] The business operations can include various types, such as browsing pages, clicking controls, submitting orders, etc.; along with user operations, business operation data is generated, and the business operation data can be collected user behavior data, such as which pages have been browsed , which controls are clicked, etc., and may also include data submitted by the user, for example, the data information filled in by the user, the selected type of purchased product, the selected payment method, and so on.

[0048] Step S204, based on the business operation data and the data type corresponding to the first business node, collect the data content of the first business node; wherein, the data type includes: node identification, node status, node name, business process to which the node belongs, and business operation data.

[0049]In one way, the buried point of the service node can run regularly and collect data, or it can run and collect data only when the user performs an operation on the service node. In the above steps, for the first service node, the buried point on the first service node can detect in real time or regularly whether the user performs a service operation on the first service node, and if the service operation is performed, the data collection of the first service node is started. content. In addition to the above-mentioned business operation data, attribute data and status data of business nodes need to be collected, for example, node identification, node status, node name, and business process to which the node belongs.

[0050] The target system can also set up multiple data collection interfaces, each data collection interface is used to collect the data content of a business node of a branch, or it can also be allocated according to the business process, and each data collection interface is used to collect one or more services. The data content of the business node in the process. Each service node is preset with a data collection interface; the data content corresponding to each data type of the first service node is collected through the data collection interface preset by the first service node; the connection with the first service node is obtained through the data collection interface The second service node of the relationship, based on the connection relationship between the first service node and the second service node, associates the data content of the first service node with the data content of the second service node.

[0051] In the above manner, the data collection interface is not only used for collecting data content, but also used for correlating data between service nodes having a connection relationship. For example, an association identifier can be added to the content data of the service node, and the association between the content data can be represented by the identifier. When an exception occurs, the abnormal service node and the cause of the exception can be searched based on the association relationship between the data.

[0052] In another implementation manner, when the operation of the first service node ends, the operation log of the first service node is collected through a data collection interface preset by the first service node; and each data type of the first service node is extracted from the operation log. The corresponding data content is sent to a specified data analysis component in an asynchronous decoupling manner; wherein, the data analysis component is used to: analyze and process the data content to obtain the running status data of the target system.

[0053] The service node can store the data in the node to the database in real time or periodically. In actual implementation, when the application system is running, the corresponding node data is queried through the interface information. When the node operation ends (for example, normal execution or abnormal termination), combined with the log printing function, asynchronous decoupling technology (such as message queue MQ) is used. ), etc., report the node data (including business data) to the analysis platform ES (Open Source Distributed Search Engine), and store the node data after analysis by the platform. For the collected node data, based on the fact that the data is non-relational and belongs to text data, ES can be used as a data storage service to build a data analysis platform to provide visual, multi-dimensional analysis and positioning functions.

[0054] Step S205, for each business process, obtain the data content of each business node in the business process; based on the connection relationship between the business nodes in the business process, perform association processing on the content data of the business nodes in the business process to obtain the business process. Corresponding process state data; based on the process state data corresponding to each business process, the running state data of the target system is obtained.

[0055] In a specific implementation manner, there may also be an association relationship between business processes. If there are a first process and a second process in multiple business processes, and there is a specified process relationship between the first process and the second process, then Based on the process relationship, the process state data of the first process and the process state data of the second process are associated with each other to obtain process association data between the first process and the second process; the process state data corresponding to each business process , and the process association data between the first process and the second process with process relationship, which is determined as the operation state data of the target system. By analyzing the relationship between business processes, the running status of the target system can be monitored as a whole, and the monitoring of the running status is more comprehensive and reasonable.

[0056] Step S206, in response to the query instruction, extract the query keyword from the query instruction; extract data matching the query keyword from the operating status data of the target system to obtain the query result; Dimensions display query results.

[0057] Further, based on the high-performance distributed search analysis engine ES, various query conditions or query keywords can be set, such as: user ID, process ID, node ID, interface URL (Uniform Rsource Locator, Uniform Resource Locator), business Data keywords, etc., multi-dimensional analysis and visualization of data, ES supports Chinese full-text indexing, and the query efficiency is greatly improved. Customer service personnel can query specific services and specific error reasons from this product.

[0058] The above monitoring method of system running status reconstructs the process of system problem analysis and processing. With the help of this platform, customer service personnel can quickly locate the specific error information of specific business, analyze the type of problem in combination with the QA manual of the platform, and directly connect to the corresponding Responsible for the department, improve office efficiency. It provides a quantifiable, multi-dimensional system operation data analysis platform, which allows technicians to have a quick understanding and mastery of system functions and performance as well as business.

[0059] The method for monitoring the system running state in the embodiment of the present invention is described above. The following describes the monitoring device for the system running state in the embodiment of the present invention. Please refer to image 3 , an embodiment of the monitoring device for the system running state in the embodiment of the present invention includes:

[0060] The node obtaining module 31 is used to obtain multiple business processes of the target system and multiple business nodes in each business process; wherein, the multiple business processes are obtained by dividing the business of the target system in advance; each business process corresponds to A business scenario in the target system; the connection relationship between multiple business nodes in the business process is determined based on the business processing order of the business process; each business node is preset with the type of data to be collected;

[0061] The data acquisition set module 32 is configured to, for each business node, set a buried point at a position corresponding to the business node in the target system, and obtain the data content corresponding to the preset data type of the business node through the buried point when the target system is running;

[0062] The analysis module 33 is configured to analyze and process the data content corresponding to the business nodes based on the multiple business processes and the connection relationship between the business nodes in each business process to obtain the running state data of the target system.

[0063] The above-mentioned monitoring device for the operating state of the system obtains multiple business processes of the target system and multiple business nodes in each business process; wherein, the multiple business processes are obtained by dividing the business of the target system in advance; each business process Corresponds to a business scenario in the target system; the connection relationship between multiple business nodes in the business process is determined based on the business processing order of the business process; each business node presets the type of data to be collected; for each business node , set a buried point at the position corresponding to the business node in the target system, and when the target system is running, obtain the data content corresponding to the preset data type of the business node through the buried point; The connection relationship between the nodes is analyzed, and the data content corresponding to the business node is analyzed and processed to obtain the running status data of the target system. In the above method, on the one hand, since the application system is pre-divided into multiple business processes, and each business process includes multiple business nodes, the operation status of the application system can be comprehensively monitored, and the data between each business node can be used by customer service personnel. View to quickly discover the cause of system exceptions and resolve them. On the other hand, the application system is divided into multiple business processes, and these business processes can cover most of the business of the application system. The business nodes are divided based on the business process, and the data of the business nodes are related based on the business process. Monitor the running status of the application system. When the system is abnormal, the data of multiple related business nodes can be linked and analyzed to improve the efficiency of solving system abnormalities and make the operation of the application system more stable.

[0064] see Figure 4 , another embodiment of the monitoring device for the system running state in the embodiment of the present invention includes:

[0065] The node obtaining module 31 is used to obtain multiple business processes of the target system and multiple business nodes in each business process; wherein, the multiple business processes are obtained by dividing the business of the target system in advance; each business process corresponds to A business scenario in the target system; the connection relationship between multiple business nodes in the business process is determined based on the business processing order of the business process; each business node is preset with the type of data to be collected;

[0066] The data acquisition set module 32 is configured to, for each business node, set a buried point at a position corresponding to the business node in the target system, and obtain the data content corresponding to the preset data type of the business node through the buried point when the target system is running;

[0067] The above-mentioned data acquisition set module is further configured to: in response to the user performing a business operation on the first business node, generate business operation data generated by the business operation; based on the business operation data and the data type corresponding to the first business node, collect the data content.

[0068] Each service node is preset with a data collection interface; the above-mentioned data collection module is further configured to: collect the data content corresponding to each data type of the first service node through the data collection interface preset by the first service node; The interface acquires a second service node that has a connection relationship with the first service node, and associates the data content of the first service node with the data content of the second service node based on the connection relationship between the first service node and the second service node deal with.

[0069] The above data acquisition set module is further configured to: when the operation of the first service node ends, collect the operation log of the first service node through the data collection interface preset by the first service node; extract each of the first service nodes from the operation log The data content corresponding to the data type is asynchronously decoupled, and the data content is sent to the specified data analysis component; wherein, the data analysis component is used to: analyze and process the data content to obtain the running status data of the target system.

[0070] The analysis module 33 is configured to analyze and process the data content corresponding to the business nodes based on the multiple business processes and the connection relationship between the business nodes in each business process to obtain the running state data of the target system.

[0071] The above analysis module is also used to: for each business process, obtain the data content of each business node in the business process; based on the connection relationship between the business nodes in the business process, perform association processing on the content data of the business nodes in the business process , obtain the process state data corresponding to the business process; and obtain the running state data of the target system based on the process state data corresponding to each business process.

[0072] The above analysis module is also used for: if there are a first process and a second process in the multiple business processes, and there is a specified process relationship between the first process and the second process, based on the process relationship, the process status data of the first process is analyzed. Perform association processing with the process state data of the second process to obtain process association data between the first process and the second process; process the state data corresponding to each business process, and the first process and the second process with the process relationship. The process association data between them is determined as the operation status data of the target system.

[0073] The above device further includes: a display module 34 for: in response to the query instruction, extracting the query keyword from the query instruction; extracting data matching the query keyword from the operating state data of the target system to obtain a query result; based on the query keyword, determine the display dimension, and display the query results according to the display dimension.

[0074] above image 3 and Figure 4 The apparatus for monitoring the system running state in the embodiment of the present invention is described in detail, and the computer equipment in the embodiment of the present invention is described in detail below from the perspective of hardware processing.

[0075] Figure 5 is a schematic structural diagram of a computer device provided by an embodiment of the present invention. The computer device 500 may vary greatly due to different configurations or performance, and may include one or more processors (central processing units, CPU) 510 (for example, one or more processors) and memory 520, one or more storage media 530 (eg, one or more mass storage devices) that store applications 533 or data 532. Among them, the memory 520 and the storage medium 530 may be short-term storage or persistent storage. The program stored in the storage medium 530 may include one or more modules (not shown in the figure), and each module may include a series of instructions to operate on the computer device 500 . Furthermore, the processor 510 may be configured to communicate with the storage medium 530 to execute a series of instruction operations in the storage medium 530 on the computer device 500 .

[0076] Computer device 500 may also include one or more power supplies 540, one or more wired or wireless network interfaces 550, one or more input and output interfaces 560, and/or, one or more operating systems 531, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD and many more. Those skilled in the art can understand that, Figure 5 The illustrated structure of the computer device does not constitute a limitation of the computer device, and may include more or less components than those shown, or some components may be combined, or a different arrangement of components.

[0077] The present invention also provides a computer-readable storage medium. The computer-readable storage medium may be a non-volatile computer-readable storage medium. The computer-readable storage medium may also be a volatile computer-readable storage medium. Instructions are stored in the read storage medium, and when the instructions are executed on the computer, the computer executes the steps of the method for monitoring the running state of the system.

[0078] The present invention also provides a computer device, the computer device includes a memory and a processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the steps of the system operating state monitoring method in the above embodiments.

[0079] Further, the computer-readable storage medium may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required by at least one function, and the like; Use the created data, etc.

[0080] The blockchain referred to in the present invention is a new application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithm. Blockchain, essentially a decentralized database, is a series of data blocks associated with cryptographic methods. Each data block contains a batch of network transaction information to verify its Validity of information (anti-counterfeiting) and generation of the next block. The blockchain can include the underlying platform of the blockchain, the platform product service layer, and the application service layer.

[0081] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above may refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

[0082] The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of the various embodiments of the present invention. The aforementioned storage medium includes: U disk, removable hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program codes .

[0083] Above, the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still be used for the foregoing implementations. The technical solutions described in the examples are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.