Communication link monitoring system, operation data processing method and storage medium

Abstract

The invention provides a communication link monitoring system, an operation data processing method and a storage medium, and relates to the field of communication link monitoring, a monitoring module can be utilized to collect various link operation data from multiple communication links between a charging pile and a management system, and the various link operation data belonging to the same communication link are integrated, so that the communication link monitoring efficiency is improved. Then, the complete link operation data containing the abnormal operation data can be determined as the abnormal link operation data, and the complete link operation data not containing the abnormal operation data can be determined as the normal link operation data; and the abnormal link operation data and the normal link operation data are respectively transmitted to the rear-end processing module by using different transmission channels, so that the rear-end processing module carries out distinguishing processing on the abnormal link operation data and the normal link operation data, and the processing complexity of the rear end can be effectively reduced.

Description

Technical Field

[0001] The present invention relates to the field of communication link monitoring, and in particular to a communication link monitoring system, an operation data processing method and a storage medium. Background Art

[0002] In the current new energy vehicle charging industry, data exchanges between charging piles and background management systems are frequent. Any abnormality in the communication link between the two may lead to interruption of charging services, billing errors, or user information security risks. Therefore, how to reliably monitor the above communication link is an important part of ensuring the normal operation of the charging business.

[0003] In the related art, when monitoring a communication link, various link operation data of the communication link is usually collected and sent to the back-end for processing according to the data category. However, this requires the back-end to set up several components to receive and integrate various link operation data, and it is not possible to monitor each communication link efficiently and reliably. Summary of the invention

[0004] The purpose of the present invention is to provide a communication link monitoring system, an operation data processing method and a storage medium, which can reduce the complexity of receiving and processing link operation data at the back end, thereby improving the monitoring reliability of each communication link.

[0005] In order to solve the above technical problems, the present invention provides a communication link monitoring system, comprising: a monitoring module, a transmission module and a back-end processing module, wherein the monitoring module is connected to the back-end processing module through different transmission channels in the transmission module;

[0006] The monitoring module is used to collect multiple link operation data from multiple communication links between the charging pile and the management system, and integrate multiple link operation data belonging to the same communication link to obtain complete link operation data of each communication link;

[0007] determining the complete link operation data including the abnormal operation data as the abnormal link operation data, and determining the complete link operation data not including the abnormal operation data as the normal link operation data;

[0008] The abnormal link operation data and the normal link operation data are respectively transmitted to the back-end processing module by using the different transmission channels, so that the back-end processing module can distinguish and process the abnormal link operation data and the normal link operation data.

[0009] Optionally, the transmission module is a message middleware, and the message middleware includes a first message queue and a second message queue;

[0010] The monitoring module is also used for:

[0011] The abnormal link operation data is transmitted to the back-end processing module by using the first message queue, and the normal link operation data is transmitted to the back-end processing module by using the second message queue.

[0012] Optionally, the backend processing module includes: an abnormal data processing module and a normal data processing module;

[0013] The abnormal data processing module is used to receive the abnormal link operation data and process the abnormal link operation data;

[0014] The normal data processing module is used to receive the normal link operation data and process the normal link operation data.

[0015] Optionally, the abnormal data processing module includes: a stream processing platform, a time series database and a visual monitoring platform;

[0016] The stream processing platform is used to receive the abnormal link operation data, perform data content aggregation processing on the abnormal link operation data received within a preset time window to obtain aggregated abnormal data, and add the aggregated abnormal data to the time series database in a processing time sequence;

[0017] The visual monitoring platform is used to extract the aggregated abnormal data from the time series database, and output and display the aggregated abnormal data in a processing time sequence.

[0018] Optionally, the visual monitoring platform is further used for:

[0019] Determine whether the value of the aggregated abnormal data meets the preset warning condition;

[0020] If satisfied, output warning information for the aggregated abnormal data.

[0021] Optionally, the abnormal data processing module includes: a query platform and a relational database;

[0022] The query platform is used for:

[0023] receiving the abnormal link operation data, and saving the abnormal link operation data to the relational database;

[0024] Receive a query request input by a user terminal, query the abnormal link operation data corresponding to the query request in the relational database, and send the abnormal link operation data obtained by the query to the user terminal, so that the user terminal outputs and displays the abnormal link operation data; the user terminal receives the query request input by the user through a network page, and outputs the abnormal link operation data to the network page.

[0025] Optionally, the query platform is further used for:

[0026] The screening condition contained in the query request is parsed, and the abnormal link operation data whose data content meets the screening condition is searched in the relational database.

[0027] Optionally, the monitoring module is further used to add identification information and communication link type to the complete link operation data;

[0028] The query platform is also used for:

[0029] Filtering the abnormal link operation data with the same identification information to retain a copy of the abnormal link operation data with the same identification information;

[0030] Performing data deletion processing on the abnormal link operation data corresponding to the specified communication link type, so as to limit the link operation data amount contained in the abnormal link operation data corresponding to the specified communication link type to a preset amount;

[0031] De-duplicate abnormal link operation data with the same data content;

[0032] The processed abnormal link operation data is saved in the relational database.

[0033] Optionally, the normal data processing module includes: a log collection platform and a storage system;

[0034] The log collection platform is used to receive the normal link operation data, integrate the normal link operation data received within a preset time, and save the integrated normal link operation data to a storage system.

[0035] The present invention also provides an operation data processing method, which is applied to the communication link monitoring system as described above, comprising:

[0036] The monitoring module collects multiple link operation data from multiple communication links between the charging pile and the management system, and integrates multiple link operation data belonging to the same communication link to obtain complete link operation data of each communication link;

[0037] determining the complete link operation data including the abnormal operation data as the abnormal link operation data, and determining the complete link operation data not including the abnormal operation data as the normal link operation data;

[0038] The abnormal link operation data and the normal link operation data are respectively transmitted to a back-end processing module by using different transmission channels, so that the back-end processing module can distinguish and process the abnormal link operation data and the normal link operation data.

[0039] The present invention also provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are loaded and executed by a processor, the operating data processing method as described above is implemented.

[0040] The present invention also provides a computer program product, comprising a computer program or instructions, wherein when the computer program or instructions are executed by a processor, the operating data processing method as described above is implemented.

[0041] The present invention provides a communication link monitoring system, comprising: a monitoring module, a transmission module and a back-end processing module, wherein the monitoring module is connected to the back-end processing module via different transmission channels in the transmission module; the monitoring module is used to collect a variety of link operation data from a plurality of communication links between a charging pile and a management system, and integrate a variety of link operation data belonging to the same communication link to obtain complete link operation data of each communication link; determine the complete link operation data containing abnormal operation data as abnormal link operation data, and determine the complete link operation data not containing the abnormal operation data as normal link operation data; and utilize the different transmission channels to transmit the abnormal link operation data and the normal link operation data to the back-end processing module respectively, so that the back-end processing module can distinguish and process the abnormal link operation data and the normal link operation data.

[0042] The beneficial effect of the present invention is that in the communication link monitoring system provided by the present invention, the monitoring module can first collect multiple link operation data from multiple communication links between the charging pile and the management system, and integrate the multiple link operation data belonging to the same communication link to obtain the complete link operation data of each communication link, that is, the present invention can integrate various link operation data according to the communication link to which it belongs to form the complete link operation data of each communication link. Subsequently, the monitoring module can determine the complete link operation data containing abnormal operation data as abnormal link operation data, and determine the complete link operation data not containing abnormal operation data as normal link operation data, and then use different transmission channels to transmit the abnormal link operation data and the normal link operation data to the back-end processing module respectively, that is, the abnormal link operation data and the normal link operation data can be transmitted to the back-end processing module in two ways, which can facilitate the back-end processing module to distinguish and process the abnormal link operation data and the normal link operation data, thereby effectively reducing the processing complexity of the back-end processing module and improving the processing speed of the back-end processing module. The present invention also provides an operation data processing method and storage medium, which have the above-mentioned beneficial effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0044] Figure 1 A structural block diagram of a first communication link monitoring system provided by an embodiment of the present invention;

[0045] Figure 2 A structural block diagram of a second communication link monitoring system provided by an embodiment of the present invention;

[0046] Figure 3 A structural block diagram of a third communication link monitoring system provided by an embodiment of the present invention;

[0047] Figure 4 A structural block diagram of a fourth communication link monitoring system provided by an embodiment of the present invention;

[0048] Figure 5 A structural block diagram of a fifth communication link monitoring system provided by an embodiment of the present invention;

[0049] Figure 6 A structural block diagram of a sixth communication link monitoring system provided by an embodiment of the present invention;

[0050] Figure 7 A structural block diagram of a seventh communication link monitoring system provided by an embodiment of the present invention;

[0051] Figure 8 A flowchart of a method for processing running data provided by an embodiment of the present invention;

[0052] Fig. 9 A swimming lane diagram of a running data processing method provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0054] In the current new energy vehicle charging industry, data interactions between charging piles and background management systems are frequent. Any abnormality in the communication link between the two may lead to interruptions in charging services, billing errors, or potential safety hazards to user information. Therefore, how to reliably monitor the above-mentioned communication links is an important part of ensuring the normal operation of charging services. In related technologies, when monitoring communication links, various link operation data of the communication links are usually collected and sent to the back-end for processing according to the data category. However, this requires the back-end to set up several components to receive and integrate various link operation data, and it is not possible to monitor each communication link efficiently and reliably.

[0055] In view of this, in order to improve the technical problem of how to improve the back-end processing efficiency of link operation data, so as to improve the efficiency and reliability of monitoring each communication link, the present invention can provide a communication link monitoring system, which can collect the complete link operation data of each communication link at the link operation data collection point, and send the complete link operation data including abnormal operation data and the complete link operation data without abnormal operation data to the back-end processing module through different transmission channels, thereby reducing the complexity of integration and processing of link operation data at the back-end, thereby improving the monitoring reliability of each communication link.

[0056] For easier understanding, please refer to Figure 1 , Figure 1This is a structural block diagram of the first communication link monitoring system provided by an embodiment of the present invention. The system may include: a monitoring module 1, a transmission module 2 and a back-end processing module 3. The monitoring module 1 is connected to the back-end processing module 3 through different transmission channels in the transmission module 2. For example, the transmission module 2 may include a first transmission channel 21 and a second transmission channel 22, and the monitoring module 1 may be connected to the back-end processing module 3 through the first transmission channel 21 and the second transmission channel 22. The monitoring module 1 is also connected to the communication link between the charging pile and the management system, and the charging pile, the management system and the communication link are not drawn. It should be noted that the management system can communicate with multiple charging piles, and a communication link is set between the system and each charging pile. This embodiment does not limit the specific form of the communication link, for example, it can be a 5G link (fifth generation mobile communication technology, 5th Generation Mobile Communication Technology) and the like. In addition, the communication link may also be composed of multiple sub-links.

[0057] Monitoring module 1 can be used for:

[0058] Collect multiple link operation data from multiple communication links between the charging pile and the management system, and integrate multiple link operation data belonging to the same communication link to obtain complete link operation data of each communication link;

[0059] determining the complete link operation data including the abnormal operation data as the abnormal link operation data, and determining the complete link operation data not including the abnormal operation data as the normal link operation data;

[0060] The abnormal link operation data and the normal link operation data are respectively transmitted to the back-end processing module 3 by using different transmission channels, so that the back-end processing module 3 can distinguish and process the abnormal link operation data and the normal link operation data.

[0061] In this embodiment, in order to reduce the processing complexity of the link operation data by the back-end processing module 3 and improve the processing efficiency, the monitoring module 1 can be improved. Specifically, the monitoring module 1 can first collect the complete link operation data of multiple communication links, and the complete link operation data includes multiple link operation data of the same communication link. In this way, the back-end processing module 3 can directly use the complete link operation data to comprehensively analyze the working status of the communication link, which can avoid setting multiple components in the back-end processing module 3 to receive and process different types of link operation data, and can also avoid the back-end processing module 3 to integrate various link operation data, thereby reducing the processing complexity of the link operation data by the back-end processing module 3 and improving the processing efficiency. It is worth pointing out that the monitoring module 1 can integrate the link operation data of the same communication link according to the communication link to which each link operation data belongs, and obtain the complete link operation data of each communication link. In this way, the original acquisition program in the monitoring module 1 does not need to be modified, and only data acquisition and reporting need to be performed in the original way, and the monitoring module 1 can integrate various link operation data according to the communication link to which it belongs.

[0062] In addition, the monitoring module 1 can also determine the complete link operation data containing abnormal operation data as abnormal link operation data, and determine the complete link operation data not containing abnormal operation data as normal link operation data, according to whether the abnormal operation data is included, and can use different transmission channels to transmit the abnormal link operation data and the normal link operation data to the back-end processing module 3 respectively. For example, the monitoring module 1 can use the first transmission channel 21 to transmit the abnormal link operation data, and use the second transmission channel 22 to transmit the normal link operation data. In this way, the back-end processing module 3 can process the abnormal link operation data and the normal link operation data separately. Considering that in the actual working scenario of the communication link, the amount of abnormal link operation data is generally smaller than that of the normal link operation data, the two are transmitted separately to the back-end processing module 3, which can facilitate the back-end processing module 3 to adopt different strategies to process the two types of data, and can ensure that the back-end processing module 3 is more focused on processing and analyzing the abnormal link operation data, thereby further reducing the processing complexity of the back-end processing module 3 and further improving the processing efficiency.

[0063] It should be noted that the above-mentioned link operation data characterizes the operation status of the link, which may include multiple types, such as indicator data, link data, log data, etc. The above-mentioned complete link operation data includes multiple link operation data of the same link. The above-mentioned abnormal operation data is link operation data with data anomalies. There are many ways to determine the abnormal operation data. For example, for indicator data, a threshold comparison method can be used to determine the abnormal operation data in the indicator data; for link data, log data, etc., the abnormal operation data therein can be determined based on whether these data contain error information, such as error link data, error log, timeout log, etc.

[0064] Furthermore, this embodiment does not limit the specific form of the transmission module 2. For example, the transmission module 2 may be a message middleware, which is a system based on a message queue that can provide message transmission for an application system in a network environment. Figure 2 , Figure 2 This is a structural block diagram of a second communication link monitoring system provided by an embodiment of the present invention. The system may include a message middleware 20, and the message middleware 20 may include a first message queue 211 and a second message queue 221. At this time, the monitoring module 1 may also be used for:

[0065] The first message queue 211 is used to transmit abnormal link operation data to the backend processing module 3 , and the second message queue 221 is used to transmit normal link operation data to the backend processing module 3 .

[0066] In this embodiment, the monitoring module 1 can use different message queues in the message middleware 20 to send abnormal link operation data and normal link operation data to the back-end processing module 3 so that the latter can perform differentiated processing, and the reliability of data transmission can be improved based on the message middleware. It should be pointed out that the message middleware 20 in this embodiment is only used for data transmission, and it will not change the abnormal link operation data and the normal link operation data, that is, it will not destroy the integrity of these two types of data.

[0067] Specifically, the message queue is usually set in the message middleware 20 by setting the topic data (Topic), so the monitoring module 1 can send the abnormal link operation data and the normal link operation data to different Topics in the message middleware 20, and the back-end processing module 3 can receive the abnormal link operation data and the normal link operation data through different Topics.

[0068] It should be noted that this embodiment does not limit the specific message middleware, and can be set according to actual application requirements, for example, it can be Kafka.

[0069] Furthermore, in order to realize the differentiated processing of abnormal link operation data and normal link operation data, different processing modules can be set in the back-end processing module 3. Figure 3 , Figure 3 This is a structural block diagram of a third communication link monitoring system provided by an embodiment of the present invention. The backend processing module 3 of the system may include: an abnormal data processing module 31 and a normal data processing module 32.

[0070] The abnormal data processing module 31 is used to receive abnormal link operation data and process the abnormal link operation data;

[0071] The normal data processing module 32 is used to receive normal link operation data and process the normal link operation data.

[0072] In this embodiment, since different processing modules are provided, the back-end processing module 3 can adopt different strategies to process the above-mentioned abnormal link operation data and normal link operation data to improve the processing efficiency.

[0073] Based on the above embodiments, in the communication link monitoring system provided by the present invention, the monitoring module can first collect the complete link operation data of each communication link between the charging pile and the management system, wherein the complete link operation data includes various types of link operation data of the communication link, that is, the present invention can integrate various link operation data according to the communication link to which it belongs, and form complete link operation data of each communication link. Subsequently, the monitoring module can determine the complete link operation data including abnormal operation data as abnormal link operation data, and determine the complete link operation data not including abnormal operation data as normal link operation data, and then use different transmission channels to transmit the abnormal link operation data and the normal link operation data to the back-end processing module respectively, that is, the abnormal link operation data and the normal link operation data can be transmitted to the back-end processing module in two ways, which can facilitate the back-end processing module to distinguish and process the abnormal link operation data and the normal link operation data, thereby effectively reducing the processing complexity of the back-end processing module and improving the processing speed of the back-end processing module.

[0074] Based on the above embodiment, the specific form of the abnormal data processing module 31 is introduced below. In one possible case, please refer to Figure 4 , Figure 4 The structure block diagram of the fourth communication link monitoring system provided by the embodiment of the present invention is as follows: The abnormal data processing module 31 may include: a stream processing platform 311 , a time series database 312 and a visual monitoring platform 313 .

[0075] The stream processing platform 311 is used to receive abnormal link operation data, perform data content aggregation processing on the abnormal link operation data received within a preset time window to obtain aggregated abnormal data, and add the aggregated abnormal data to the time series database 312 in the order of processing time.

[0076] The visual monitoring platform 313 is used to extract aggregated abnormal data from the time series database 312 and output and display the aggregated abnormal data in the order of processing time.

[0077] In this embodiment, a stream processing platform 311, a time series database 312 and a visual monitoring platform 313 may be set in the abnormal data processing module 31. Among them, the stream processing platform 311 may actively receive abnormal link operation data, and may perform data content aggregation processing on the abnormal link operation data received within a preset time window to obtain aggregated abnormal data. For example, it may aggregate the abnormal link operation data received within 10 seconds, and may aggregate according to the five data contents of processing time, host name, link type, data count, and call result. Subsequently, the stream processing platform 311 may save the aggregated abnormal data obtained by aggregation to the time series database 312. The visual monitoring platform 313 may extract the aggregated abnormal data from the time series database 312, and output and display the aggregated abnormal data in the order of processing time. For example, the visual monitoring platform 313 may display the number of communication timeouts and communication errors that occur in the communication link at each moment in time order. In this way, this embodiment can visualize the abnormal changes of the communication link.

[0078] Furthermore, the visual monitoring platform 313 can also be used for:

[0079] Determine whether the value of the aggregated abnormal data meets the preset warning conditions;

[0080] If satisfied, output warning information for aggregated abnormal data.

[0081] In this embodiment, the visual monitoring platform 313 can also preset a variety of warning conditions, which are set based on the numerical value of the aggregated abnormal data, and then when it is determined that the numerical value of the aggregated abnormal data meets the preset warning condition, the corresponding warning information can be actively output to improve the convenience of user use, and can realize in-depth analysis and intelligent diagnosis of the communication link. It should be noted that this embodiment does not limit the specific preset warning conditions, which can be set according to actual application requirements.

[0082] It should be noted that this embodiment does not limit the specific stream processing platform, time series database and visual monitoring platform. For example, the stream processing platform may be Flink, the time series database may be influxDB, and the visual monitoring platform may be Grafana.

[0083] In another possible case, please refer to Figure 5 , Figure 5 The structure block diagram of the fifth communication link monitoring system provided by the embodiment of the present invention is as follows: The abnormal data processing module 31 may include: a query platform 314 and a relational database 315 .

[0084] The query platform 314 can be used to:

[0085] Receive abnormal link operation data, and save the abnormal link operation data to a relational database 315;

[0086] Receive a query request input by a user terminal, query the abnormal link operation data corresponding to the query request in the relational database 315, and send the abnormal link operation data obtained by the query to the user terminal, so that the user terminal outputs and displays the abnormal link operation data; the user terminal receives the query request input by the user through a network page, and outputs the abnormal link operation data to the network page.

[0087] In this embodiment, a query platform 314 and a relational database 315 can be set in the abnormal data processing module to meet the user's query needs for abnormal link operation data. Specifically, the query platform 314 can actively receive abnormal link operation data and save the abnormal link operation data to the relational database 315; in addition, the query platform 314 can also receive a query request input by a user terminal, query the abnormal link operation data corresponding to the query request in the relational database 315, and send the abnormal link operation data obtained by the query to the user terminal for output and display. Among them, the user terminal can receive the query request input by the user through a network page (Web page), and can output the abnormal link operation data to the network page. In this way, it can effectively facilitate users to query the abnormal link operation data, thereby improving the user's convenience.

[0088] It should be noted that this embodiment is not limited to a specific relational database 315 , and may be, for example, a MySQL database.

[0089] Furthermore, the query platform 314 can also be used to:

[0090] The filter conditions included in the query request are parsed, and the abnormal link operation data whose data content meets the filter conditions is searched in the relational database 315.

[0091] Specifically, the query request input by the user terminal may include a screening condition, which is used to limit the data content in the abnormal link operation data. For example, the screening condition may include a specified management center, a specified charging pile, a specified link type, a specified occurrence time, a specified link representation, a specified service identifier, a specified creation time, a modification time, etc. In this way, the convenience of users querying abnormal link operation data can be further improved.

[0092] Furthermore, the monitoring module 1 can also be used for:

[0093] Add identification information and communication link type to the complete link operation data;

[0094] The query platform 314 may also be used to:

[0095] Filtering the abnormal link operation data with the same identification information to retain a copy of the abnormal link operation data with the same identification information;

[0096] Performing data deletion processing on the abnormal link operation data corresponding to the specified communication link type, so as to limit the link operation data amount contained in the abnormal link operation data corresponding to the specified communication link type to a preset amount;

[0097] De-duplicate abnormal link operation data with the same data content;

[0098] The processed abnormal link operation data is saved in the relational database 315 .

[0099] In this embodiment, when the monitoring module 1 collects the complete link operation data, it can also add identification information (RequestedID) and the communication link type to the complete link operation data. Among them, the identification information is used to uniquely identify a set of complete link operation data, which can be used for data deduplication; the communication link type is mainly used to distinguish between ordinary communication links and special communication links. The special communication link can be, for example, an extra-long link, that is, a communication link with a long length composed of multiple sub-links. The particularity of the extra-long link is that since it is composed of multiple sub-links, and each sub-link can generate multiple link operation data, it may cause the amount of complete link operation data collected from the extra-long link at the same time to be too large. In addition, the complete link operation data of the extra-long link contains a large amount of data content that is of little or no help for abnormal link analysis and detection. Therefore, for the specified communication link type such as the extra-long link, it is necessary to perform data deletion processing on its abnormal link operation data to limit the amount of link operation data contained in the abnormal link operation data corresponding to the specified communication link type to a preset number, which can be 5000. Furthermore, when receiving abnormal link operation data, the query platform 314 can filter the abnormal link operation data with the same identification information to retain a copy of the abnormal link operation data with the same identification information to avoid saving multiple identical abnormal link operation data; it can also perform data deletion processing on the abnormal link operation data corresponding to the specified communication link type to limit the amount of link operation data contained in the abnormal link operation data corresponding to the specified communication link type to a preset number to reduce the amount of abnormal link operation data of the specified communication link type; it can also perform deduplication processing on the abnormal link operation data with the same data content, which can effectively reduce the data redundancy in the relational database 315.

[0100] It should be noted that the embodiments of the present invention do not limit the specific processes of the above-mentioned filtering processing, data deletion processing, and deduplication processing, and can be set according to actual application requirements. For data deletion processing, for example, only a part of the specified content in the abnormal link operation data can be retained, or only a preset number of data at the front of the abnormal link operation data can be retained. In addition, the above-mentioned filtering processing, data deletion processing, and deduplication processing can be processed using independent programs.

[0101] Based on the above embodiment, the specific form of the normal data processing module 32 is introduced below. In a possible case, please refer to Figure 6 , Figure 6 This is a structural block diagram of the sixth communication link monitoring system provided by an embodiment of the present invention. The above-mentioned normal data processing module 32 may include: a log collection platform 321 and a storage system 322 .

[0102] The log collection platform 321 is used to receive normal link operation data, integrate the normal link operation data received within a preset time, and save the integrated normal link operation data to a storage system.

[0103] In this embodiment, since the normal link operation data does not need to be processed and analyzed too much, this embodiment can use a log collection platform to perform regular log processing on these normal link operation data and save them to the storage system for persistent storage. When saving the normal link operation data, the log collection platform 321 simply integrates the normal link operation data according to a preset cycle time, and saves the integrated data to the storage system, such as simply integrating the normal link operation data by one hour, and saving the integrated data to the storage system.

[0104] For further understanding, please refer to Figure 7 , Figure 7 This is a structural block diagram of the seventh communication link monitoring system provided by an embodiment of the present invention, which shows the detailed structures of the abnormal data processing module 31 and the normal data processing module 32.

[0105] Based on the above introduction to the communication link monitoring system, the operation data processing method provided by the embodiment of the present invention is described in detail below. Figure 8 , Figure 8 A flowchart of a method for processing running data provided by an embodiment of the present invention, which is applied to the communication link monitoring system as described above, may include:

[0106] S100, the monitoring module collects multiple link operation data from multiple communication links between the charging pile and the management system, and integrates multiple link operation data belonging to the same communication link to obtain complete link operation data of each communication link;

[0107] S200, determining the complete link operation data including abnormal operation data as abnormal link operation data, and determining the complete link operation data not including abnormal operation data as normal link operation data;

[0108] S300: Use different transmission channels to transmit abnormal link operation data and normal link operation data to a back-end processing module respectively, so that the back-end processing module can distinguish and process the abnormal link operation data and the normal link operation data.

[0109] It can be seen that in the embodiment of the present invention, the monitoring module can first collect multiple link operation data from multiple communication links between the charging pile and the management system, and integrate the multiple link operation data belonging to the same communication link to obtain complete link operation data of each communication link, that is, the present invention can integrate various link operation data according to the communication link to which it belongs to form complete link operation data of each communication link. Subsequently, the monitoring module can determine the complete link operation data containing abnormal operation data as abnormal link operation data, and determine the complete link operation data not containing abnormal operation data as normal link operation data, and then use different transmission channels to transmit the abnormal link operation data and the normal link operation data to the back-end processing module respectively, that is, the abnormal link operation data and the normal link operation data can be transmitted to the back-end processing module in two ways, which can facilitate the back-end processing module to distinguish and process the abnormal link operation data and the normal link operation data, thereby effectively reducing the processing complexity of the back-end processing module and improving the processing speed of the back-end processing module.

[0110] Optionally, the transmission module is a message middleware, and the message middleware includes a first message queue and a second message queue; the method may further include:

[0111] The monitoring module transmits abnormal link operation data to the back-end processing module by using the first message queue, and transmits normal link operation data to the back-end processing module by using the second message queue.

[0112] Optionally, the backend processing module includes: an abnormal data processing module and a normal data processing module; the method may also include:

[0113] The abnormal data processing module receives the abnormal link operation data and processes the abnormal link operation data;

[0114] The normal data processing module receives the normal link operation data and processes the normal link operation data.

[0115] Optionally, the abnormal data processing module includes: a stream processing platform, a time series database and a visual monitoring platform; the method may also include:

[0116] The stream processing platform receives abnormal link operation data, performs data content aggregation processing on the abnormal link operation data received within a preset time window to obtain aggregated abnormal data, and adds the aggregated abnormal data to the time series database in the order of processing time;

[0117] The visual monitoring platform extracts aggregated abnormal data from the time series database and outputs and displays the aggregated abnormal data in the order of processing time.

[0118] Optionally, the method may further include:

[0119] The visual monitoring platform determines whether the value of the aggregated abnormal data meets a preset warning condition;

[0120] If satisfied, output warning information for the aggregated abnormal data.

[0121] Optionally, the abnormal data processing module includes: a query platform and a relational database; the method may also include:

[0122] The query platform receives the abnormal link operation data and saves the abnormal link operation data to a relational database;

[0123] Receive a query request input by a user terminal, query the abnormal link operation data corresponding to the query request in a relational database, and send the abnormal link operation data obtained by the query to the user terminal, so that the user terminal outputs and displays the abnormal link operation data; the user terminal receives the query request input by the user through a network page, and outputs the abnormal link operation data to the network page.

[0124] Optionally, the method may further include:

[0125] The query platform parses the filter conditions contained in the query request and searches the relational database for abnormal link operation data whose data content meets the filter conditions.

[0126] Optionally, the method may further include:

[0127] The monitoring module adds identification information and communication link type to the complete link operation data;

[0128] The query platform filters the abnormal link operation data with the same identification information to retain a copy of the abnormal link operation data with the same identification information; performs data deletion processing on the abnormal link operation data corresponding to the specified communication link type to limit the amount of link operation data contained in the abnormal link operation data corresponding to the specified communication link type to a preset number; performs deduplication processing on the abnormal link operation data with the same data content; and saves the processed abnormal link operation data to a relational database. Optionally, the normal data processing module includes: a log collection platform and a storage system; the method may also include:

[0129] The log collection platform receives the normal link operation data, integrates the normal link operation data received within a preset time, and saves the integrated normal link operation data to the storage system.

[0130] Based on the above embodiment, the above operation data processing method is introduced below based on a specific example. Fig. 9, Fig. 9 A swimming lane diagram of a running data processing method provided by an embodiment of the present invention. The system to which the present invention is applicable may include a monitoring Agent (monitoring module), Kafka (message middleware) and a backend processing module. The backend processing module may include Flume (log processing platform), MonitorProcessor (query platform), relational database and HBase (storage system). Of course, the backend processing module may also include Flink (stream processing platform), influxDB (time series database) and Grafana (visual monitoring platform). Figure 8 Not marked in. During the working process, the monitoring agent can first collect full-link data (that is, complete link operation data), and divide the full-link data into full-link abnormal data and full-link all data according to whether it contains abnormal operation data. Subsequently, the monitoring agent can transmit the full-link abnormal data through the full-link abnormal topic (full-link abnormal Topic) in Kafka, and can transmit the full-link all data through the full-link topic (full-link Topic) in Kafka. MonitorProcessor can actively consume the full-link abnormal Topic to receive the full-link abnormal data and save the data to the relational database; Flume can actively consume the full-link Topic to receive the full-link all data, and save the data to HBase on an hourly basis to achieve the distinction between the full-link abnormal data and the full-link all data.

[0131] An embodiment of the present invention further provides a computer program product, including a computer program / instruction, which implements the operation data processing method described in the above embodiment when executed by a processor.

[0132] Since the embodiments of the computer program product part correspond to the embodiments of the running data processing method part, please refer to the description of the embodiments of the running data processing method part for the embodiments of the computer program product part, and will not be repeated here.

[0133] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the operating data processing method described in the above embodiment is implemented.

[0134] Since the embodiments of the computer-readable storage medium part correspond to the embodiments of the running data processing method part, the embodiments of the storage medium part refer to the description of the embodiments of the running data processing method part, which will not be repeated here.

[0135] The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description.

[0136] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0137] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0138] The above is a detailed introduction to a communication link monitoring system, an operation data processing method and a storage medium provided by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present invention, several improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the scope of protection of the present invention.

Claims

1. A communication link monitoring system, characterized in that: include: A monitoring module, a transmission module and a back-end processing module, wherein the monitoring module is connected to the back-end processing module through different transmission channels in the transmission module; The monitoring module is used to collect multiple link operation data from multiple communication links between the charging pile and the management system, and integrate multiple link operation data belonging to the same communication link to obtain complete link operation data of each communication link; determining the complete link operation data including the abnormal operation data as the abnormal link operation data, and determining the complete link operation data not including the abnormal operation data as the normal link operation data; The abnormal link operation data and the normal link operation data are respectively transmitted to the back-end processing module by using the different transmission channels, so that the back-end processing module can distinguish and process the abnormal link operation data and the normal link operation data.

2. The communication link monitoring system according to claim 1, characterized in that: The transmission module is a message middleware, and the message middleware includes a first message queue and a second message queue; The monitoring module is also used for: The abnormal link operation data is transmitted to the back-end processing module by using the first message queue, and the normal link operation data is transmitted to the back-end processing module by using the second message queue.

3. The communication link monitoring system according to claim 1, characterized in that: The backend processing module includes: an abnormal data processing module and a normal data processing module; The abnormal data processing module is used to receive the abnormal link operation data and process the abnormal link operation data; The normal data processing module is used to receive the normal link operation data and process the normal link operation data.

4. The communication link monitoring system according to claim 3, characterized in that: The abnormal data processing module includes: a stream processing platform, a time series database and a visual monitoring platform; The stream processing platform is used to receive the abnormal link operation data, perform data content aggregation processing on the abnormal link operation data received within a preset time window to obtain aggregated abnormal data, and add the aggregated abnormal data to the time series database in a processing time sequence; The visual monitoring platform is used to extract the aggregated abnormal data from the time series database and output and display the aggregated abnormal data in a processing time sequence.

5. The communication link monitoring system according to claim 4, characterized in that: The visual monitoring platform is also used for: Determine whether the value of the aggregated abnormal data meets the preset warning condition; If satisfied, output warning information for the aggregated abnormal data.

6. The communication link monitoring system according to claim 3, characterized in that: The abnormal data processing module includes: a query platform and a relational database; The query platform is used for: receiving the abnormal link operation data, and saving the abnormal link operation data to the relational database; Receive a query request input by a user terminal, query the abnormal link operation data corresponding to the query request in the relational database, and send the abnormal link operation data obtained by the query to the user terminal, so that the user terminal outputs and displays the abnormal link operation data; the user terminal receives the query request input by the user through a network page, and outputs the abnormal link operation data to the network page.

7. The communication link monitoring system according to claim 6, characterized in that: The query platform is also used for: The screening condition contained in the query request is parsed, and the abnormal link operation data whose data content meets the screening condition is searched in the relational database.

8. The communication link monitoring system according to claim 6, characterized in that: The monitoring module is further used to add identification information and communication link type to the complete link operation data; The query platform is also used for: Filtering the abnormal link operation data with the same identification information to retain a copy of the abnormal link operation data with the same identification information; Performing data deletion processing on the abnormal link operation data corresponding to the specified communication link type, so as to limit the link operation data amount contained in the abnormal link operation data corresponding to the specified communication link type to a preset amount; De-duplicate abnormal link operation data with the same data content; The processed abnormal link operation data is saved in the relational database.

9. The communication link monitoring system according to claim 3, characterized in that: The normal data processing module includes: a log collection platform and a storage system; The log collection platform is used to receive the normal link operation data, integrate the normal link operation data received within a preset time, and save the integrated normal link operation data to the storage system.

10. A method for processing operation data, characterized in that: A communication link monitoring system as claimed in any one of claims 1 to 9, comprising: The monitoring module collects multiple link operation data from multiple communication links between the charging pile and the management system, and integrates multiple link operation data belonging to the same communication link to obtain complete link operation data of each communication link; determining the complete link operation data including the abnormal operation data as the abnormal link operation data, and determining the complete link operation data not including the abnormal operation data as the normal link operation data; The abnormal link operation data and the normal link operation data are respectively transmitted to a back-end processing module by using different transmission channels, so that the back-end processing module can distinguish and process the abnormal link operation data and the normal link operation data.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are loaded and executed by the processor, the operation data processing method according to claim 10 is implemented.

12. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the operation data processing method according to claim 10 is implemented.

Images