Full link performance analysis tracking techniques

Abstract

The invention discloses a full-link performance analysis tracking technology which comprises a data acquisition unit, a data processing unit, an analysis display unit and an alarm display unit which are connected in sequence. And the data acquisition unit, the data processing unit, the analysis display unit and the alarm display unit are distributed architecture. According to the method, powerful data support is provided for performance tracking through multi-dimensional data collection, real link data is collected through data, a data comparison system is formed, and on the basis of existing data tracking, only special burying point information needs to be added to a back-end interface return value, so that performance analysis tracking of a whole link can be carried out.

Description

Technical Field

[0001] The present invention relates to the field of full-link performance analysis, and in particular to full-link performance analysis and tracing technology. Background Art

[0002] The "full link" refers to the entire workflow and decision-making process within a physical system, while the "full chain" refers to the complete process from start to finish, including the events and impacts of each link. This encompasses all links from start to finish in various fields, integrating them to achieve efficient management and optimization. Whether in marketing, design, or foreign trade, the "full link" concept emphasizes seamless connectivity and efficient operation throughout the entire process. With the development and expansion of the internet, network traffic has also increased, and the response speed of interfaces is crucial. In this context, interface performance monitoring solutions have emerged. Whether developing a monitoring solution yourself or using one, determining the correct performance is a challenging task.

[0003] Currently, manual tracking is generally used for performance analysis. However, manual analysis and tracking has no data support and can only be evaluated through human perception. This is highly subjective, and everyone has their own opinions, making it difficult to form a set of standards. At the same time, it wastes resources and requires the participation of multiple people in the same environment to minimize variables. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to overcome the defects of the existing technology of manual analysis and tracking, which has a large workload, large errors and low efficiency, and provide a full-link performance analysis and tracking technology.

[0005] The present invention solves the above technical problems through the following technical solutions:

[0006] The present invention provides a full-link performance analysis and tracking technology, including a data acquisition unit, a data processing unit, an analysis and display unit, and an alarm display unit. The data acquisition unit, data processing unit, analysis and display unit, and alarm display unit are connected in sequence, and the data acquisition unit, data processing unit, analysis and display unit, and alarm display unit are in a distributed architecture.

[0007] In this technical solution, through the aggregation, search, analysis and visualization of logs, users can quickly locate the cause of the problem, monitor the performance and status of network equipment in real time, ensure the stability and security of the network, and realize automated deployment, configuration management and monitoring. Through preset operation and maintenance scripts and strategies, manual intervention and errors are reduced, and the efficiency and accuracy of operation and maintenance are improved. By training models to identify abnormal patterns and fault characteristics, the accuracy and timeliness of alarms are improved. At the same time, potential business bottlenecks and optimization opportunities are discovered through data analysis.

[0008] Preferably, the data collection unit includes a business system data collection module and a network device data collection module.

[0009] Preferably, the data collected by the data collection unit includes performance indicators, log information and network traffic.

[0010] In this technical solution, data collection is achieved through various methods such as embedding points, log collection, and network packet capture to ensure the comprehensiveness and accuracy of the data.

[0011] Preferably, the data collection of the data collection unit is achieved through multiple methods such as embedding points, log collection, and network packet capture.

[0012] Preferably, the data processing unit includes a data cleaning module, a data integration module and a data storage unit.

[0013] Preferably, the data cleaning module and the data integration module use a real-time computing framework to process the data.

[0014] Preferably, the data storage unit stores data using a distributed storage system.

[0015] In this technical solution, distributed storage systems (such as Hadoop, HBase, etc.) and real-time computing frameworks (such as Spark Streaming, Kafka Streams, etc.) are used to process massive data and improve data processing efficiency and response speed.

[0016] Preferably, the analysis and display unit includes an analysis module and a display module.

[0017] In this technical solution, key performance indicators (KPIs), business trends, abnormal alarms and other information are displayed in the form of charts and dashboards to help users quickly understand business status and discover problems.

[0018] Preferably, the alarm display unit includes an alarm module, a notification module, a positioning module and a processing suggestion module.

[0019] Preferably, the alarm module includes an alarm rule preset module, a monitoring module and a central processing module.

[0020] In this technical solution, according to the preset alarm rules, when an abnormality or fault is detected, the system automatically triggers the alarm mechanism, notifies relevant personnel through various means such as email, text message, instant messaging tools, etc., and provides fault location and handling suggestions.

[0021] On the basis of conforming to the common sense in this field, the above-mentioned preferred conditions can be arbitrarily combined to obtain the preferred embodiments of the present invention.

[0022] The positive progress effect of the present invention is:

[0023] Through log aggregation, search, analysis, and visualization, this invention helps users quickly locate the cause of problems, monitor the performance and status of network devices in real time, ensure network stability and security, and implement automated deployment, configuration management, and monitoring. Pre-set operation and maintenance scripts and policies reduce manual intervention and errors, improving operation and maintenance efficiency and accuracy. Training models identify abnormal patterns and fault characteristics, improving the accuracy and timeliness of alarms. At the same time, data analysis can identify potential business bottlenecks and optimization opportunities.

[0024] The present invention provides strong data support for performance tracking through multi-dimensional data collection. By collecting real link data, a data comparison system is formed. On the basis of existing data tracking, it is only necessary to add special embedding information to the return value of the back-end interface, so that full-link performance analysis and tracking can be carried out. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 Schematic diagram of the overall framework of the full-link performance analysis and tracing technology in an embodiment of the present invention.

[0026] Figure 2 for Figure 1 The overall architecture diagram of the full-link performance analysis and tracing technology is shown.

[0027] Description of Reference Numerals

[0028] 1. Data acquisition unit;

[0029] 2. Data processing unit;

[0030] 3. Analysis and display unit;

[0031] 4. Alarm display unit;

[0032] 5. Business system data collection module;

[0033] 6. Network equipment data collection module;

[0034] 7. Data cleaning module;

[0035] 8. Data integration module;

[0036] 9. Data storage unit;

[0037] 10. Analysis module;

[0038] 11. Display module;

[0039] 12. Alarm module; 121. Alarm rule preset module; 122. Monitoring module; 123. Central processing module;

[0040] 13. Notification module;

[0041] 14. Positioning module;

[0042] 15. Processing suggestion module. DETAILED DESCRIPTION

[0043] The present invention is further described below by way of examples, but the present invention is not limited to the scope of the examples.

[0044] Figures 1 to 2 The figure shows a schematic diagram of the structure of an embodiment of the full-link performance analysis and tracing technology of the present invention. The full-link performance analysis and tracing technology includes a data acquisition unit 1, a data processing unit 2, an analysis and display unit 3, and an alarm display unit 4. The data acquisition unit 1, data processing unit 2, analysis and display unit 3, and alarm display unit 4 are connected in sequence and form a distributed architecture.

[0045] In this technical solution, through the aggregation, search, analysis and visualization of logs, users can quickly locate the cause of the problem, monitor the performance and status of network equipment in real time, ensure the stability and security of the network, and realize automated deployment, configuration management and monitoring. Through preset operation and maintenance scripts and strategies, manual intervention and errors are reduced, and the efficiency and accuracy of operation and maintenance are improved. By training models to identify abnormal patterns and fault characteristics, the accuracy and timeliness of alarms are improved. At the same time, potential business bottlenecks and optimization opportunities are discovered through data analysis.

[0046] The specific operation steps of the present invention are:

[0047] S1. Analyze needs, clarify monitoring objectives and scope, and determine the business processes and links that need to be monitored;

[0048] S2. Tool selection: select appropriate monitoring tools and technologies based on monitoring objectives and business needs;

[0049] S3. Deployment and implementation: Deploy the selected monitoring tools into the business system and perform configuration and debugging;

[0050] S4. Set monitoring indicators and set appropriate monitoring indicators and alarm thresholds according to business needs;

[0051] S5. Data analysis and optimization: Regularly analyze and report monitoring data, identify problems and optimize them, and continuously optimize the monitoring system based on business needs and technological development.

[0052] The data collection unit 1 includes a business system data collection module 5 and a network device data collection module 6 .

[0053] The data collected by the data collection unit 1 includes performance indicators, log information and network traffic.

[0054] In this technical solution, data collection is achieved through various methods such as embedding points, log collection, and network packet capture to ensure the comprehensiveness and accuracy of the data.

[0055] The business system data collection module 5 and the network device data collection module 6 are responsible for collecting data from various business systems and network devices, including performance indicators, log information, network traffic, etc. Data collection is achieved through various methods such as tracking points, log collection, and network packet capture to ensure the comprehensiveness and accuracy of the data.

[0056] The data collection unit 1 collects data through various methods such as embedding points, log collection, and network packet capture.

[0057] The data processing unit 2 includes a data cleaning module 7 , a data integration module 8 and a data storage unit 9 .

[0058] The data cleaning module 7 and the data integration module 8 process the data using a real-time computing framework.

[0059] The data storage unit 9 stores data using a distributed storage system.

[0060] In this technical solution, distributed storage systems such as Hadoop and HBase and real-time computing frameworks such as Spark Streaming and Kafka Streams are used to process massive amounts of data, thereby improving data processing efficiency and response speed.

[0061] The collected data is cleaned, integrated, and stored using the data cleaning module 7, data integration module 8, and data storage unit 9. Distributed storage systems such as Hadoop and HBase and real-time computing frameworks such as Spark Streaming and Kafka Streams are used to process massive amounts of data, improving data processing efficiency and response speed.

[0062] The analysis and display unit 3 includes an analysis module 10 and a display module 11 .

[0063] In this technical solution, key performance indicators (KPIs), business trends, abnormal alarms and other information are displayed in the form of charts and dashboards to help users quickly understand business status and discover problems.

[0064] The analysis module 10 and the display module 11 provide intuitive data analysis and visualization functions. Key performance indicators (KPIs), business trends, abnormal alarms, and other information are displayed in the form of charts and dashboards, helping users quickly understand business status and identify problems.

[0065] The alarm display unit 4 includes an alarm module 12 , a notification module 13 , a positioning module 14 and a processing suggestion module 15 .

[0066] The alarm module 12 includes an alarm rule preset module 121 , a monitoring module 122 and a central processing module 123 .

[0067] In this technical solution, according to the preset alarm rules, when an abnormality or fault is detected, the system automatically triggers the alarm mechanism, notifies relevant personnel through various means such as email, text message, instant messaging tools, etc., and provides fault location and handling suggestions.

[0068] By using the alarm module 12, notification module 13, positioning module 14 and processing suggestion module 15, according to the preset alarm rules, when an abnormality or fault is detected, the system automatically triggers the alarm mechanism, notifies relevant personnel through various means such as email, text message, instant messaging tools, etc., and provides fault location and processing suggestions.

[0069] The key technology of the present invention is:

[0070] Performance monitoring: Use the APM Application Performance Management tool to monitor application performance indicators in real time, such as response time, throughput, error rate, etc., and quickly locate performance bottlenecks by deeply analyzing the internal call relationships and resource usage of the application.

[0071] Log analysis: Use log analysis tools such as ELK Stack Elasticsearch, Logstash, and Kibana to collect and analyze application log data. Through log aggregation, search, analysis, and visualization, it helps users quickly locate the cause of the problem.

[0072] Network monitoring: Use network monitoring tools such as Nagios and Zabbix to monitor the performance and status of network devices in real time, obtain various indicator data of network devices through SNMP protocol, ICMP protocol, etc., to ensure the stability and security of the network.

[0073] Combined with automated operation and maintenance tools such as Ansible and Chef, it realizes automated deployment, configuration management and monitoring. Through preset operation and maintenance scripts and strategies, it reduces manual intervention and errors, and improves operation and maintenance efficiency and accuracy.

[0074] Use AI and machine learning algorithms to intelligently analyze monitoring data, identify abnormal patterns and fault characteristics through training models, improve the accuracy and timeliness of alarms, and at the same time, discover potential business bottlenecks and optimization opportunities through data analysis.

[0075] This invention uses high-precision data acquisition technology to ensure that every piece of data and every event can be accurately captured and recorded. Whether it is millisecond-level fluctuations in high-frequency trading or subtle changes in complex business logic, they cannot escape our strict monitoring to ensure the integrity and authenticity of the data.

[0076] We use multiple backup mechanisms to ensure that when any single point of failure occurs, we can quickly switch to the backup system to ensure the continuity and stability of monitoring services. Whether it is hardware failure, network interruption or software upgrade, it will not affect our full control over the system.

[0077] Combining advanced intelligent algorithms and automation technologies, the full-link monitoring system has powerful self-healing capabilities. When potential problems or anomalies are detected, the system can automatically trigger the emergency response mechanism to isolate faults, allocate resources, and repair problems, ensuring that the monitoring service resumes normal operation in the shortest time possible. This intelligent fault-tolerant mechanism allows enterprises to remain calm in the face of various sudden challenges.

[0078] Although specific embodiments of the present invention have been described above, those skilled in the art will appreciate that these are merely illustrative and that the scope of the present invention is defined by the appended claims. Those skilled in the art may make various changes or modifications to these embodiments without departing from the principles and essence of the present invention, and such changes and modifications are intended to fall within the scope of the present invention.

Claims

1. Full-link performance analysis and tracking technology, characterized by: The invention comprises a data collection unit (1), a data processing unit (2), an analysis and display unit (3) and an alarm display unit (4), wherein the data collection unit (1), the data processing unit (2), the analysis and display unit (3) and the alarm display unit (4) are connected in sequence, and the data collection unit (1), the data processing unit (2), the analysis and display unit (3) and the alarm display unit (4) are in a distributed architecture.

2. The full-link performance analysis and tracing technology according to claim 1, characterized in that: The data collection unit (1) comprises a business system data collection module (5) and a network device data collection module (6).

3. The full-link performance analysis and tracking technology according to claim 1, characterized in that: The data collected by the data collection unit (1) includes performance indicators, log information and network traffic.

4. The full-link performance analysis and tracing technology according to claim 1, characterized in that: The data collection unit (1) collects data through multiple methods such as embedding points, log collection, and network packet capture.

5. The full-link performance analysis and tracking technology according to claim 1, characterized in that: The data processing unit (2) comprises a data cleaning module (7), a data integration module (8) and a data storage unit (9).

6. The full-link performance analysis and tracking technology according to claim 5, characterized in that: The data cleaning module (7) and the data integration module (8) use a real-time computing framework to process the data.

7. The full-link performance analysis and tracing technology according to claim 5, characterized in that: The data storage unit (9) stores data using a distributed storage system.

8. The full-link performance analysis and tracing technology according to claim 1, characterized in that: The analysis and display unit (3) comprises an analysis module (10) and a display module (11).

9. The full-link performance analysis and tracing technology according to claim 1, characterized in that: The alarm display unit (4) comprises an alarm module (12), a notification module (13), a positioning module (14) and a processing suggestion module (15).

10. The full-link performance analysis and tracing technology according to claim 9, characterized in that: The alarm module (12) comprises an alarm rule preset module (121), a monitoring module (122) and a central processing module (123).

Images