Full-link monitoring system and method for three streams
Through a three-stream full-link monitoring system, combined with APM and ACCP protocols, integrated monitoring of services, data and control is achieved, solving the problem of incomplete monitoring in the existing technology, and improving system stability and problem response capabilities.
Patent Information
- Application Number
- CN202211603970.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-13
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2042-12-13
AI Technical Summary
The existing full-link monitoring methods fail to effectively combine services, data and control, resulting in incomplete data management and monitoring, and the inability to achieve comprehensive monitoring of the calling link.
It proposes a three-stream full-link monitoring system, which can obtain data information through the APM application performance monitoring system, and perform reverse control through the APM gateway. Combined with business scenarios, probes can be used to obtain the operating status of link nodes to realize business, data and control. In combination, ACCP protocol is used for lightweight data and control signaling transmission, supporting UDP and TCP methods.
It realizes integrated monitoring of service flow, data flow and control flow, and can promptly alert and alert in the link, improve system stability, reduce the impact of problems, and provide full monitoring of data, service and control link conditions.
Smart Images

Figure CN116016286B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of link monitoring technology, and in particular to a three-stream oriented full-link monitoring system and method. Background Art
[0002] As the power grid industry becomes increasingly automated and internet-based, the amount of accumulated data is growing exponentially. More and more system applications are sharing and referencing data, which poses unprecedented challenges to data management.
[0003] The industry's full-link monitoring method generally uses APM probe technology. A very representative example is the open source product SkyWalking. However, currently only some monitoring of the call chain has been achieved, and data collection and monitoring of the monitored objects have been realized from a technical level. There are also methods for monitoring data, but they are not integrated with the business. Summary of the invention
[0004] In order to solve the problem that data, control and business are not combined in the above-mentioned full-link monitoring, the present invention proposes a full-link monitoring system and method for three flows, which issues business flows and application call links through control instructions, obtains the operating status of each node in the link through probes, realizes early warning through monitoring, and combines business, data and control.
[0005] On the first aspect, a full-link monitoring system for three flows realizes data information acquisition based on the APM application performance monitoring system, performs reverse control through the APM gateway, and realizes the combination of business flow, data flow and control flow in combination with actual business scenarios. The full-link monitoring system also includes a system data module, an APM system probe module, and a business system module.
[0006] Specifically, the system data module stores data information, and the data information includes: APM system data and business system data.
[0007] Specifically, the APM system probe acquires data information and reversely controls the business system through the gateway, and also includes: a self-encoding enhancement submodule, a call chain monitoring submodule, a monitoring and early warning submodule, and a customized configuration submodule.
[0008] Specifically, the business system module is in the form of a business flow, including the business, conditions and results of actual business scenarios.
[0009] Specifically, the APM system probe module initiates control to the business system module in the form of a control flow, and the business system module pushes the business system information to the APM system probe module in the form of a data flow.
[0010] Specifically, it also includes a lightweight ACCP application protocol that interacts with applications for control. In the ACCP application protocol, the ACCP protocol stack provides basic capability support, including ACCP protocol encoding and decoding, abstracting the operation of the ACCP protocol into an API, and providing it to the upper-level business system module for actual business scenarios, thereby reducing the coupling between the upper-level business and the ACCP protocol.
[0011] Specifically, the data transmission between the ACCP system probe module and the business system module includes UDP mode and TCP mode; the UDP mode is used for data stream push of collected data; the TCP mode is used to maintain the system heartbeat and control stream transmission of control signaling in ACCP.
[0012] On the other hand, the full-link monitoring method for three streams is implemented based on the full-link monitoring system for three streams, and includes the following steps:
[0013] When monitoring and recording starts, the system will intelligently determine whether the system has been embedded. If no probe exists, it will prompt: This business system has no probe installed, and the business flow cannot be recorded and monitored;
[0014] After recording starts, users can operate the business system and complete the recording of a complete business flow through one or more click events;
[0015] Click the End Recording button to pop up the business recording completion saving interface. Enter the name of the business process. The application system can be automatically detected by the plug-in and filled in after the system name is detected, or it can be entered.
[0016] Select whether to push actively after business exceptions. If you choose to push, when the background captures the problem, it will be actively pushed to the monitoring system and prompt the exception. If you do not push, you can view it in the exception data list.
[0017] Furthermore, it also includes: in the APM monitoring terminal list, the recorded business system status and the business recorded and stored by the user can be displayed.
[0018] Furthermore, it also includes: when a business abnormality occurs, the system can locate the method in which the error occurred and a detailed prompt of the error, so that the user can be informed of the business abnormality and the cause in the first time.
[0019] Beneficial effects of the present invention: The present invention proposes a full-link monitoring system and method for three flows. The full-link monitoring system for three flows realizes data information acquisition based on the APM application performance monitoring system, performs reverse control through the APM gateway, and realizes the combination of business flow, data flow and control flow in combination with actual business scenarios; the full-link monitoring system for three flows is used to perform full-link monitoring, and the entire link of program calls is acquired by embedding probes, which can reach the method level, and the user's customized configuration can be realized. The business configuration and the system call link can be combined, and dynamic monitoring can be realized by issuing control instructions; the business, data and control are connected as a whole, and the business flow, data flow and control flow are combined with each other, providing users with a means to monitor the link status of the three data, business and control throughout the process, monitor the operating status, and when a problem occurs in a certain link in the link, an alert can be issued in the first time, and the user can learn which business has been abnormal, and notify the developers and operation and maintenance personnel in advance to handle and solve it, which not only improves the system stability, but also reduces the impact when the problem occurs. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 This is the architecture diagram of the full-link monitoring system for three streams of the present invention. DETAILED DESCRIPTION
[0021] In order to have a clearer understanding of the technical features, purposes and effects of the present invention, specific embodiments of the present invention are now described with reference to the accompanying drawings.
[0022] The present invention proposes a full-link monitoring system and method for three streams. In the first aspect, the full-link monitoring system for three streams acquires data information based on the APM application performance monitoring system, realizes reverse control through the APM gateway, and combines the three in combination with the business scenario to achieve the goal of full-link monitoring. The system architecture is as follows: Figure 1 As shown, it also includes a system data module, an APM system probe module, and a business system module. The system data module stores data information, and the data information includes: APM system data, business system data. The APM system probe obtains data information and reversely controls the business system through the gateway, and also includes: a self-encoding enhancement submodule, a call chain monitoring submodule, a monitoring and early warning submodule, and a customized configuration submodule. The business system module is in the form of a business flow, including the business, conditions and results of the actual business scenario.
[0023] The APM system probe module initiates control to the business system module in the form of a control flow, and the business system module pushes the business system information to the APM system probe module in the form of a data flow.
[0024] It also includes a lightweight ACCP application protocol that interacts with applications for control. The ACCP protocol stack in the ACCP application protocol provides basic capability support, including ACCP protocol encoding and decoding, abstracting the operation of the ACCP protocol into an API, and providing it to the upper-level business system module for actual business scenarios, thereby reducing the coupling between the upper-level business and the ACCP protocol.
[0025] The data transmission between the ACCP system probe module and the business system module includes UDP mode and TCP mode; the UDP mode is used for data stream push of collected data; the TCP mode is used to maintain the system heartbeat and control stream transmission of control signaling in ACCP.
[0026] In this embodiment, the system is implemented for the Java technology framework system, and support for other technical languages will be gradually realized in the future. In addition, data transmission adopts UDP and TCP, of which UDP is mainly used for the push of collected data. It can improve data transmission efficiency and reduce the link maintenance load of the link. TCP is used to maintain the heartbeat of the system, and the transmission of control signaling in ACCP (such as hot deployment scenarios) adopts tcp; the gateway and the Zombie system use the local loopback of the VM, and the transmission efficiency problem can be ignored. TCP is used to avoid packet sub-packaging and simplify coding.
[0027] In this embodiment, an ACCP application protocol is customized, which is a very lightweight private customized protocol and is used to interact with applications for control instructions. The ACCP protocol stack provides basic capability support, such as accp protocol encoding and decoding capabilities; the operation of the accp protocol is abstracted into an API and provided to the upper-layer business module to reduce the coupling between the upper-layer business and the accp protocol.
[0028] In this embodiment, the full-link monitoring system for three streams uses an account and password to log in. After logging in, click Start Recording on the page to perform full-link monitoring recording, including the following steps:
[0029] When monitoring and recording starts, the system will intelligently determine whether the system has been embedded. If no probe exists, it will prompt: This business system has no probe installed, and the business flow cannot be recorded and monitored;
[0030] After recording starts, users can operate the business system and complete the recording of a complete business flow through one or more click events;
[0031] Click the End Recording button to pop up the business recording completion saving interface. Enter the name of the business process. The application system can be automatically detected by the plug-in and filled in after the system name is detected, or it can be entered.
[0032] Select whether to push actively after business exceptions. If you choose to push, when the background captures the problem, it will be actively pushed to the monitoring system and prompt the exception. If you do not push, you can view it in the exception data list.
[0033] In this embodiment, the recorded business system status can also be viewed on the APM monitoring terminal. All services recorded and stored by the user are displayed in this list. When an abnormality occurs in the business, the system can locate the method in which the error occurred and detailed prompts of the error, so that the user can learn about the abnormality and cause of the business at the first time.
[0034] In this embodiment, the ACCP protocol is customized, and its control protocol packet TLV format is shown in the following table:
[0035]
[0036]
[0037] In this embodiment, the ACCP protocol package JSON configuration information is shown in the following table:
[0038]
[0039]
[0040] In this embodiment, the API function configuration is shown in the following table:
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048] The present invention proposes a full-link monitoring system and method for three flows. The full-link monitoring system for three flows realizes data information acquisition based on the APM application performance monitoring system, performs reverse control through the APM gateway, and realizes the combination of business flow, data flow and control flow in combination with actual business scenarios; the full-link monitoring system for three flows is used to perform full-link monitoring, and the entire link of program calls is acquired by embedding probes, which can reach the method level, and can realize user-defined configuration, and can combine business configuration with system call links, and realize dynamic monitoring by issuing control instructions; business, data and control are connected as a whole, and business flow, data flow and control flow are combined with each other, so as to provide users with a means to monitor the link conditions of data, business and control throughout the whole process, monitor the running status, and when a problem occurs in a certain link in the link, an early warning can be issued, and the user can learn which business has been abnormal, and notify the developers and operation and maintenance personnel in advance to handle and solve it, which not only improves the stability of the system, but also reduces the impact when the problem occurs.
[0049] The present invention has shown and described the basic principles and main features of the present invention and the advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention. The scope of protection of the present invention is defined by the attached claims and their equivalents.
Claims
1. A full-link monitoring system for three streams, based on the APM application performance monitoring system to achieve data information acquisition, characterized by: Reverse control is performed through the APM gateway, and the combination of business flow, data flow and control flow is realized in combination with actual business scenarios. The full-link monitoring system also includes a system data module, an APM system probe module, and a business system module; It also includes a lightweight ACCP application protocol that interacts with applications for control. The ACCP protocol stack in the ACCP application protocol provides basic capability support, including ACCP protocol encoding and decoding, abstracting the operation of the ACCP protocol into an API, and providing it to the upper-layer business system module for actual business scenarios, thereby reducing the coupling between the upper-layer business and the ACCP protocol; The business system module is in the form of business flow, including the business, conditions and results of actual business scenarios; The APM system probe module initiates control to the business system module in the form of control flow, and the business system module pushes the business system information to the APM system probe module in the form of data flow; The data transmission between the ACCP system probe module and the business system module includes UDP mode and TCP mode; the UDP mode is used for data stream push of collected data; the TCP mode is used to maintain the system heartbeat and control stream transmission of control signaling in ACCP.
2. The three-stream full-link monitoring system according to claim 1 is characterized in that: The system data module stores data information, and the data information includes: APM system data and business system data.
3. The three-stream full-link monitoring system according to claim 1 is characterized in that: The APM system probe acquires data information and reversely controls the business system through the gateway, and also includes: a self-encoding enhancement submodule, a call chain monitoring submodule, a monitoring and early warning submodule, and a customized configuration submodule.
4. A three-stream full-link monitoring method, implemented based on the three-stream full-link monitoring system according to any one of claims 1 to 3, characterized in that: The following steps are involved: When monitoring and recording starts, the system will intelligently determine whether the system has been embedded. If no probe exists, it will prompt: This business system has no probe installed, and the business flow cannot be recorded and monitored; After recording starts, the user operates the business system and completes the recording of a complete business flow through one or more click events; Click the End Recording button, and the business recording completion saving interface will pop up. Enter the name of the business process and the application system. The plug-in will automatically detect the system name and fill in or enter it. Select whether to push actively after business exceptions. If you choose to push, when the background captures the problem, it will be actively pushed to the monitoring system and prompt the exception. If not pushed, you can view it in the exception data list.
5. The three-stream full-link monitoring method according to claim 4 is characterized in that: Also includes: The APM monitoring list shows the recorded business system status and the business recorded and stored by the user.
6. The three-stream full-link monitoring method according to claim 4 is characterized in that: Also includes: When a business exception occurs, the system will detect the method in which the error occurred and provide detailed prompts of the error, so that users can learn about the business exception and its cause as soon as possible.
