Data monitoring method, device and equipment based on target built-in protocol and storage medium

Abstract

The invention discloses a data monitoring method and device based on a target built-in protocol, equipment and a storage medium, and relates to the technical field of radar calibration, and the method comprises the steps: determining the target built-in protocol from a locally pre-stored protocol set based on the import data of to-be-monitored equipment; carrying out information interaction with the to-be-monitored equipment based on the target built-in protocol, and obtaining collection data of the to-be-monitored equipment; obtaining corrected collection data according to an abnormal data monitoring model and the collection data; and filtering the corrected acquisition data to obtain filtered acquisition data, and uploading the filtered acquisition data to an operation and maintenance platform, so that the operation and maintenance platform displays a monitoring result. Automatic data processing is realized through the target built-in protocol and the abnormal data monitoring model, and the abnormal data does not need to be positioned, analyzed and processed manually, so that the operation and maintenance cost is reduced, and the maintenance efficiency is improved.

Description

Technical Field

[0001] This application relates to the technical field of data monitoring, and particularly to a data monitoring method, device, equipment, and storage medium based on a target built-in protocol. Background Art

[0002] In today's digital age, data has become the core asset of enterprises and organizations. With the continuous expansion and complexity of business, the volume of data generation, transmission, storage, and processing has increased exponentially. To ensure data integrity and availability, and to promptly discover and solve potential problems, data monitoring technology has emerged. Data monitoring not only helps improve system reliability and performance but also provides real-time support for decision-making and enhances the competitiveness of enterprises.

[0003] However, the current data monitoring solutions have many drawbacks. In the protocol acquisition link, frontline personnel need to search for matching intelligent protocols on protocol websites based on device models or protocol texts. In the protocol testing stage, it is necessary to connect to actual devices to verify data accuracy. During device monitoring, once abnormal data and alarms occur, maintenance personnel cannot independently correct the abnormal data and print alarm logs and can only rely on R & D personnel to modify the protocol. Moreover, when users put forward new requirements, maintenance personnel also cannot independently meet them and need to rely on R & D personnel again. Such a data monitoring solution has low maintenance efficiency. Summary of the Invention

[0004] The main purpose of this application is to provide a data monitoring method, device, equipment, and storage medium based on a target built-in protocol, aiming to solve the technical problem of low maintenance efficiency of existing data monitoring solutions.

[0005] To achieve the above object, this application proposes a data monitoring method based on a target built-in protocol. The method is applied to a data monitoring system based on a target built-in protocol. The data monitoring system based on a target built-in protocol, the device to be monitored, and the operation and maintenance platform are connected through a communication protocol. The method includes:

[0006] Determine a target built-in protocol from a protocol set pre-stored locally based on the imported data of the device to be monitored;

[0007] Perform information interaction with the device to be monitored based on the target built-in protocol and obtain the collected data of the device to be monitored;

[0008] Obtain the corrected collected data according to the abnormal data monitoring model and the collected data;

[0009] Perform filtering processing on the corrected collected data to obtain the filtered collected data, and upload the filtered collected data to the operation and maintenance platform so that the operation and maintenance platform can display the monitoring results.

[0010] In one embodiment, the step of determining a target built-in protocol from a locally pre-stored protocol set based on the imported data of the device to be monitored includes:

[0011] When the imported data of the device to be monitored is not empty, determine the target built-in protocol from the locally pre-stored protocol set according to the type of the imported data;

[0012] When the imported data of the device to be monitored is empty, control the built-in manufacturer information to sequentially request parsed data from the device to be monitored, and obtain the parsed value of the parsed data. When the parsed value is within a preset parsed value range, obtain the built-in protocol corresponding to the parsed value from the locally pre-stored protocol set, and determine the built-in protocol corresponding to the parsed value as the target built-in protocol.

[0013] In one embodiment, the step of determining a target built-in protocol from a locally pre-stored protocol set according to the type of the imported data includes:

[0014] When the imported data is a device list, determine the target built-in protocol from the locally pre-stored protocol set according to the manufacturer information, device model, and software version of the device list;

[0015] When the imported data is a device picture, determine the target built-in protocol from the locally pre-stored protocol set according to the device nameplate and device panel information of the device picture;

[0016] When the imported data is a protocol text, convert the protocol text and the built-in protocol text into a first vector and a second vector respectively, and determine the target built-in protocol from the locally pre-stored protocol set according to the cosine similarity between the first vector and the second vector.

[0017] In one embodiment, after the step of determining a target built-in protocol from a locally pre-stored protocol set based on the imported data of the device to be monitored, the following steps are further included:

[0018] When it is detected that the target built-in protocol does not meet the requirements, obtain a demand virtual semaphore;

[0019] Input the text information corresponding to the demand virtual semaphore;

[0020] Split the text information into several keyword fields, and store the keyword fields in a protocol dependency file, so that the target built-in protocol can obtain the keyword fields from the protocol dependency file.

[0021] In one embodiment, the step of obtaining the corrected acquisition data according to the abnormal data monitoring model and the acquisition data includes:

[0022] Preprocess the collected data through an abnormal data monitoring model to obtain preprocessed collected data. The preprocessing at least includes data collection, data cleaning, feature engineering, and data standardization;

[0023] Use the preprocessed collected data as historical data, and train the abnormal data monitoring model according to the historical data to obtain a trained abnormal data monitoring model;

[0024] Perform prediction through the trained abnormal data monitoring model to obtain prediction data for a future preset time period;

[0025] Obtain the actual data of the device to be monitored in a future preset time period;

[0026] Obtain corrected collected data according to the actual data and the prediction data.

[0027] In one embodiment, the step of obtaining corrected collected data according to the actual data and the prediction data includes:

[0028] When the difference between the actual data and the prediction data is greater than a preset difference threshold, mark the actual data as abnormal data;

[0029] Automatically correct the abnormal data to obtain corrected actual data, so that the difference between the corrected actual data and the prediction data is less than or equal to the preset difference threshold.

[0030] In one embodiment, after the step of obtaining corrected collected data according to the abnormal data monitoring model and the collected data, the method further includes:

[0031] Obtain the abnormal data corresponding to the corrected collected data;

[0032] Save the data packet corresponding to the abnormal data to a log file;

[0033] Analyze the abnormal data based on the log file to obtain an abnormal data analysis report.

[0034] In addition, to achieve the above object, the present application also proposes a data monitoring device based on a target built-in protocol. The data monitoring device based on the target built-in protocol includes:

[0035] A determination module for determining a target built-in protocol from a protocol set pre-stored locally based on the imported data of the device to be monitored;

[0036] An acquisition module for performing information interaction with the device to be monitored based on the target built-in protocol and acquiring the collected data of the device to be monitored;

[0037] A correction module, configured to obtain corrected collected data according to an abnormal data monitoring model and the collected data;

[0038] A monitoring module, configured to perform filtering processing on the corrected collected data to obtain filtered collected data, and upload the filtered collected data to an operation and maintenance platform, so that the operation and maintenance platform displays a monitoring result.

[0039] In addition, to achieve the above object, the present application further provides a data monitoring device based on a target built-in protocol, where the device includes: a memory, a processor, and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the data monitoring method based on the target built-in protocol as described above.

[0040] In addition, to achieve the above object, the present application further provides a storage medium, where the storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the data monitoring method based on the target built-in protocol as described above are implemented.

[0041] In addition, to achieve the above object, the present application further provides a computer program product, where the computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the data monitoring method based on the target built-in protocol as described above are implemented.

[0042] One or more technical solutions proposed by the present application determine a target built-in protocol from a protocol set pre-stored locally based on imported data of a device to be monitored; perform information interaction with the device to be monitored based on the target built-in protocol, and obtain collected data of the device to be monitored; obtain corrected collected data according to an abnormal data monitoring model and the collected data; perform filtering processing on the corrected collected data to obtain filtered collected data, and upload the filtered collected data to an operation and maintenance platform, so that the operation and maintenance platform displays a monitoring result. Through the target built-in protocol and the abnormal data monitoring model, automated data processing is realized, and there is no need to locate, analyze, and process abnormal data manually, reducing the operation and maintenance cost and improving the maintenance efficiency. Description of the Drawings

[0043] The drawings here are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.

[0044] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0045] Figure 1 It is a schematic flowchart provided for the first embodiment of the data monitoring method based on the target built-in protocol of the present application;

[0046] Figure 2 It is a brief schematic diagram of an implementation manner in an embodiment of the data monitoring method based on the target built-in protocol of the present application;

[0047] Figure 3 It is a brief schematic flowchart of an implementation method for obtaining the corrected collected data according to the abnormal data monitoring model and the collected data in an embodiment of the data monitoring method based on the target built-in protocol of the present application;

[0048] Figure 4 It is a schematic flowchart provided for the second embodiment of the data monitoring method based on the target built-in protocol of the present application;

[0049] Figure 5 It is a schematic diagram of the module structure of the data monitoring device based on the target built-in protocol in the embodiments of the present application;

[0050] Figure 6 It is a schematic diagram of the device structure of the hardware operating environment involved in the data monitoring method based on the target built-in protocol in the embodiments of the present application.

[0051] The realization of the purpose, functional features and advantages of the present application will be further described with reference to the embodiments and the drawings. Specific embodiments

[0052] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0053] To better understand the technical solutions of the present application, the following will be described in detail in combination with the drawings of the specification and the specific embodiments.

[0054] The main solution of the embodiment of the present application is: determining a target built-in protocol from a protocol set pre-stored locally based on the imported data of the device to be monitored; performing information interaction with the device to be monitored based on the target built-in protocol, and acquiring the collected data of the device to be monitored; obtaining the corrected collected data according to the abnormal data monitoring model and the collected data; performing filtering processing on the corrected collected data to obtain the filtered collected data, and uploading the filtered collected data to the operation and maintenance platform so that the operation and maintenance platform displays the monitoring result.

[0055] Since most of the existing data monitoring solutions have many drawbacks, in the protocol acquisition link, front-line personnel need to search for matching intelligent protocols on the protocol website according to the device model or protocol text. In the protocol testing stage, it is necessary to connect to the actual device to check the data accuracy. During the device monitoring, once abnormal data and alarms occur, maintenance personnel cannot correct the abnormal data and print the alarm logs independently, and can only rely on R & D personnel to modify the protocol. Moreover, when users put forward new requirements, maintenance personnel also cannot meet them independently and need to rely on R & D personnel again. Such a data monitoring solution has low maintenance efficiency.

[0056] The present application provides a solution, which realizes automatic data processing through the target built-in protocol and the abnormal data monitoring model, eliminates the need for manual positioning, analysis and processing of abnormal data, reduces the operation and maintenance cost, and improves the maintenance efficiency.

[0057] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a data monitoring device based on the target built-in protocol, etc., such as a data monitoring system based on the target built-in protocol. Hereinafter, the data monitoring system based on the target built-in protocol is taken as an example to illustrate this embodiment and the following embodiments.

[0058] Based on this, the embodiment of the present application provides a data monitoring method based on the target built-in protocol, referring to Figure 1 , Figure 1 is the schematic flowchart of the first embodiment of the data monitoring method based on the target built-in protocol of the present application.

[0059] In this embodiment, the data monitoring method based on the target built-in protocol is applied to a data monitoring system based on the target built-in protocol. The data monitoring system based on the target built-in protocol, the device to be monitored and the operation and maintenance platform are connected through a communication protocol. The method includes steps S10 to S40:

[0060] Step S10: Determining a target built-in protocol from a protocol set pre-stored locally based on the imported data of the device to be monitored.

[0061] It should be noted that the devices to be monitored cover a wide range and have various types. Common network devices include routers, switches, servers, storage devices, and various sensors, industrial automation devices, etc. Network devices are usually at the key nodes of data transmission, and their operating status directly affects network connectivity and data transmission speed; as the core of data processing and storage, the load capacity and operating stability of servers are crucial; sensors are used to sense physical quantities, chemical quantities, etc. in the environment, and their accuracy and real-time performance determine the quality of monitoring data; industrial automation devices are related to the normal operation of the production process, and the reliability and performance of the devices affect production efficiency and product quality. The devices to be monitored play an indispensable role in the data monitoring system. They are the source of data, generating various data through their own operations, and these data reflect the working status, performance indicators of the devices, and changes in the surrounding environment. Monitoring these devices can promptly detect device failures, performance bottlenecks, and potential security hazards, providing strong support for ensuring the stable operation of the system, optimizing resource allocation, and improving production efficiency, etc.

[0062] The data imported by the devices to be monitored is the basic information source of the entire data monitoring system, which plays a key role in accurately evaluating the device status, predicting potential risks, and optimizing system operation. The imported data can be a device list, device pictures, protocol texts, etc.

[0063] In addition, the data monitoring system based on the target built-in protocol consists of several field supervision units (FSUs), and the locally pre-stored protocol set can be built into the FSU. Therefore, this protocol is called the built-in protocol in this paper, and the locally pre-stored protocol set (including at least 20 protocols) can be compatible with multiple (including at least 3000) devices to be monitored. Users only need to select the imported data to quickly retrieve the corresponding protocol, complete data collection and go online, which is convenient and fast.

[0064] The FSU is an intelligent device mainly responsible for data collection, processing, and transmission of various on-site devices to be monitored. It can penetrate into each monitoring site and perceive the operating status of devices in real time. In terms of data collection, the FSU has strong compatibility and can be connected to a variety of different types of devices to be monitored, whether they are network devices, servers, or various sensors and industrial automation devices. It can obtain relevant data of these devices regularly or in real time according to preset rules. For example, it can collect information such as network traffic and port status from network devices, data such as the usage rate of the Central Processing Unit (CPU) and memory usage from servers, environmental data such as temperature and humidity from sensors, and information such as operating parameters and production progress from industrial automation devices. After collecting the data, the FSU will perform preliminary processing and analysis on these raw data. It can screen and filter the data to remove abnormal or incorrect data, ensuring the accuracy and reliability of the data uploaded to the monitoring platform. At the same time, the FSU can also perform certain calculations and statistics on the data, such as calculating the average network traffic over a period of time and the average load of the server, in order to more intuitively reflect the operating trend of the device. After completing the data processing, the FSU uploads the processed data to the monitoring platform through a specific communication interface (such as the common B interface). This process ensures that the monitoring center can obtain the operating data of on-site devices in real time, thereby realizing remote monitoring and management of the devices. When an abnormal situation occurs in the device, the FSU can promptly capture the relevant data changes and quickly send alarm information to the monitoring platform so that the operation and maintenance personnel can take timely measures to handle it. The existence of the FSU greatly improves the efficiency and reliability of data monitoring. It enables the devices to be monitored scattered in each site to be centrally managed and monitored, providing strong support for ensuring the stable operation of the entire system.

[0065] It is understandable that the target built-in protocol can be the one that best matches the imported data, enabling the FSU to seamlessly interface with monitoring devices of different types and manufacturers. As mentioned above, the FSU needs to connect to network devices, servers, sensors, industrial automation devices, etc. The built-in protocol is like a universal key that enables the FSU to understand and parse data signals from different devices. In terms of data processing, the built-in protocol provides a standard process for the FSU. When the FSU collects raw data, the built-in protocol guides the FSU to screen and filter the data. It will identify abnormal or incorrect data based on pre-set algorithms and thresholds. For example, if the temperature data transmitted by the sensor significantly exceeds the reasonable range, the built-in protocol will instruct the FSU to mark it as abnormal data and not upload it to the monitoring platform, thus ensuring the reliability of the uploaded data. At the same time, the built-in protocol also supports the FSU to perform data calculation and statistics, such as calculating the average load of the server over a period of time, which helps to more intuitively present the operation trend of the device. In the data transmission link, the built-in protocol stipulates the way for the FSU to interact with the monitoring platform through specific communication interfaces. It ensures the integrity and accuracy of the data during transmission, preventing data loss or damage. For example, when an abnormal situation occurs in the device, the built-in protocol will guide the FSU to quickly organize alarm information and send the alarm information to the monitoring platform quickly according to the specified format and transmission method, enabling the operation and maintenance personnel to detect and handle problems in a timely manner.

[0066] All in all, the one-to-many built-in protocol solution can improve the efficiency of maintenance personnel in downloading protocols and debugging, and can solve the problems of complex protocol access and difficult access.

[0067] In a feasible implementation, reference can be made to Figure 2 , and after step S10, steps A11 to A13 can also be included:

[0068] Step A11: When it is detected that the target built-in protocol does not meet the requirements, obtain the required virtual semaphore.

[0069] It should be noted that the target built-in protocol not meeting the requirements usually means that a specific function clearly stipulated in the requirements is needed to meet the scenario of large-scale device collaborative work, but the target built-in protocol does not provide the corresponding function module or instruction set and cannot achieve efficient coordination and control of multiple devices.

[0070] In addition, a virtual semaphore is a software mechanism used in a computer system to achieve inter-process communication and synchronization. It is an extension and abstraction of the traditional semaphore concept and does not correspond to actual physical signals or hardware resources. It is mainly used to manage and control various resource requests and task collaborations in the software layer.

[0071] Step A12: Input the text information corresponding to the required virtual semaphore.

[0072] It should be noted that the virtual semaphore can be triggered by text input, that is, the preconditions (text information) corresponding to the virtual semaphore can be input.

[0073] In a specific embodiment, if the target built-in protocol does not fully meet the delivery requirements, and the requirement is to trigger an AC power outage when the three-phase voltages are all less than or equal to 100V, then the requirement virtual alarm volume of "AC power outage" can be triggered by inputting that the "phase A voltage", "phase B voltage", and "phase C voltage" are all less than or equal to "100V" to meet the above delivery requirements.

[0074] Step A13: Split the text information into several keyword fields and store the keyword fields in a protocol-dependent file, so that the target built-in protocol can obtain the keyword fields from the protocol-dependent file.

[0075] It should be noted that keyword fields usually refer to fields in a file that have key significance and specific functions when defining or describing a certain protocol. These fields are crucial for the correct understanding, implementation, and execution of the protocol.

[0076] In addition, protocol-dependent files usually refer to files that contain various information, rules, data structures, etc. required to implement a certain protocol. These files provide necessary support for the implementation, configuration, and operation of the protocol. They can ensure that the protocol can communicate and interact with data according to unified standards and rules in different devices, systems, and environments. For example, in network communication, protocol-dependent files can stipulate the data format, transmission method, error handling mechanism, etc., so that the sender and receiver can accurately understand and process the data and achieve effective communication.

[0077] It can be understood that after the keyword fields are stored in the protocol-dependent file, the target built-in protocol will obtain the relevant fields from the dependent file when acquiring the collected data in real time and implement them through the operation logic.

[0078] Specifically, after the target built-in protocol obtains the relevant fields, it will process the collected data according to the pre-defined operation logic. The operation logic may include operations such as data conversion, filtering, calculation, and analysis. For example, converting the collected original analog signal data into digital signal data, filtering the data to remove noise, calculating the value of a physical quantity according to a specific formula, or judging whether the data is abnormal through data analysis algorithms. Finally, the data processing and interaction functions specified by the protocol are realized, providing support for the subsequent operations and decisions of the system.

[0079] Step S20: Perform information interaction with the device to be monitored based on the target built-in protocol, and obtain the acquisition data of the device to be monitored.

[0080] In a specific embodiment, the target built-in protocol can achieve information interaction with the device to be monitored through 485 serial port communication or Transmission Control Protocol (TCP) network communication, so as to achieve real-time acquisition of acquisition data.

[0081] It should be noted that when the system starts or the relevant function module is activated, the built-in protocol can first perform its own initialization operations. This includes setting protocol parameters, such as the frequency of data acquisition, the accuracy requirements of acquisition, the format of data transmission, etc.; at the same time, it will also perform initialization configuration on the hardware devices or software modules related to the acquisition data; after the initialization configuration is completed, the built-in protocol can enter the data acquisition stage. If the acquisition object is a signal in the physical world, such as temperature, pressure, displacement, etc., the relevant sensors will convert these physical signals into electrical signals or digital signals. For example, a temperature sensor will generate a corresponding voltage signal according to the change of the ambient temperature, and then convert it into a digital signal through an analog-to-digital conversion circuit so that the system can process it; and the built-in protocol will read data from the sensors or other data sources according to the set acquisition frequency and method. For multiple sensors or data sources, the protocol will read data in a certain order or priority in turn to ensure that important data is not missed. The read data will be temporarily stored in the cache area of the system waiting for further processing; when the acquired data accumulates to a certain amount or reaches a specific trigger condition in the cache area, the built-in protocol will send the data to other modules of the system for processing or storage according to the specified data transmission format and communication method. For the sake of easy understanding, in this application, the data acquired by the target built-in protocol is called acquisition data.

[0082] Step S30: Obtain the corrected acquisition data according to the abnormal data monitoring model and the acquisition data.

[0083] It should be noted that the abnormal data monitoring model is a model used to monitor and correct abnormal data. In this embodiment, it can be a Long Short-Term Memory (LSTM) model.

[0084] In specific implementation, the collected data can be preprocessed through an abnormal data monitoring model to obtain the preprocessed collected data. The preprocessing at least includes data collection, data cleaning, feature engineering, and data standardization. The preprocessed collected data is used as historical data, and the abnormal data monitoring model is trained based on the historical data to obtain a trained abnormal data monitoring model. Prediction is performed through the trained abnormal data monitoring model to obtain prediction data for a future preset time period. The actual data of the device to be monitored in the future preset time period is obtained. The corrected collected data is obtained based on the actual data and the prediction data. The step of obtaining the corrected collected data based on the actual data and the prediction data includes: when the difference between the actual data and the prediction data is greater than a preset difference threshold, the actual data is marked as abnormal data; the abnormal data is automatically corrected to obtain the corrected actual data, so that the difference between the corrected actual data and the prediction data is less than or equal to the preset difference threshold.

[0085] Specifically, the previously obtained collected data can be preprocessed to obtain the preprocessed collected data, and the preprocessed collected data is used as historical data. The abnormal data monitoring model is continuously trained based on the historical data to obtain a trained abnormal data monitoring model. At this time, the trained abnormal data monitoring model has the function of predicting the collected data. Then, the collected data within a future preset time period is obtained through the data monitoring model to obtain prediction data. Information interaction is performed with the device to be monitored based on the target built-in protocol to obtain the actual data of the device to be monitored within the future preset time period, and the difference between the prediction data and the actual data is calculated. The difference between the prediction data and the actual data is compared with the preset difference threshold. When the difference between the actual data and the prediction data is greater than the preset difference threshold, the actual data is marked as abnormal data; the abnormal data is automatically corrected to obtain the corrected actual data. For example, when the actual data of the A-phase voltage is monitored to be 2220V, while the predicted data of the A-phase voltage is 220V, their difference is 2000V, and the preset difference threshold is 15V, then the actual data of the A-phase voltage is marked as abnormal data and is automatically divided by 10 based on the actual data of the A-phase voltage (2220V) to reduce it by 10 times, and the corrected actual data is 220V, meeting the requirement that the difference between the corrected actual data and the prediction data is less than or equal to the preset difference threshold (15V).

[0086] It should be emphasized that when the difference between the actual data and the predicted data is greater than the preset difference threshold, if it is also detected that the values of the first 10 collected data are all within the preset value threshold range, it will be determined that the current actual data is an abnormal value returned by the device, while the panel value of the device itself is normal. Only in this case will the actual data be determined as an abnormal value and the automatic correction operation be started.

[0087] In addition, after detecting abnormal data, the abnormal data can also be saved in a log file and an analysis report of the abnormal data can be obtained. Specifically: obtain the abnormal data corresponding to the corrected collected data; save the data packet corresponding to the abnormal data to the log file; analyze the abnormal data based on the log file to obtain an analysis report of the abnormal data.

[0088] Among them, a log file is usually a file used to record events, operations, and status information that occur during the operation of a system, software, or application. When a system or application fails, the log file can record relevant information before and after the failure, such as error codes, exception prompts, related operations, etc., providing important clues for finding the cause of the failure.

[0089] It can be understood that automatically saving the data packet where the abnormal data is located to the log file can provide R & D personnel for problem location, and at the same time, the analysis report of the abnormal data output based on the log file and the abnormal data can be provided for users to view so that users can understand the reasons.

[0090] Exemplarily, to help understand the implementation process of step S30 in this embodiment to obtain the corrected collected data according to the abnormal data monitoring model and the collected data, please refer to Figure 3 , Figure 3A brief process schematic diagram of an implementation method for obtaining corrected collected data based on an abnormal data monitoring model and the collected data is provided, specifically including steps S301 to S306: Step S301: Preprocess the collected data through the abnormal data monitoring model to obtain preprocessed collected data, where the preprocessing at least includes data collection, data cleaning feature engineering, and data standardization; Step S302: Use the preprocessed collected data as historical data and train the abnormal data monitoring model based on the historical data to obtain a trained abnormal data monitoring model; Step S303: Make predictions through the trained abnormal data monitoring model to obtain prediction data for a future preset time period; Step S304: Obtain the actual data of the device to be monitored for the future preset time period; Step S305: When the difference between the actual data and the prediction data is greater than a preset difference threshold, mark the actual data as abnormal data; Step S306: Automatically correct the abnormal data to obtain corrected actual data so that the difference between the corrected actual data and the prediction data is less than or equal to the preset difference threshold.

[0091] Step S40: Perform filtering processing on the corrected collected data to obtain filtered collected data, and upload the filtered collected data to the operation and maintenance platform so that the operation and maintenance platform can display the monitoring results.

[0092] It should be noted that the filtering process usually filters out invalid collected data, and the invalid collected data at least includes: data with incomplete fields, data with incorrect data formats, and data that does not conform to logic.

[0093] In addition, the operation and maintenance platform usually refers to a comprehensive tool and system for managing and maintaining information technology (IT) infrastructure such as computer systems, network devices, and software applications. It plays a key role in ensuring the stable operation, efficient management, and optimization and improvement of enterprise IT services. Specifically: Through the operation and maintenance platform, the performance indicators of key components such as servers, network devices, and databases can be monitored in real time, and the operating status of devices and applications can be grasped in real time, including whether the device is online, whether the service starts normally, and whether the process runs stably. Various log files generated by the system and applications, such as system logs, application logs, and security logs, can also be collected, stored, and analyzed.

[0094] It can be understood that by uploading the filtered collected data to the operation and maintenance platform and displaying the monitoring results through the operation and maintenance platform, not only can the accuracy of the reported data be ensured, but also the accurate collected data can be more conveniently displayed to the staff.

[0095] This embodiment provides a data monitoring method based on a target built-in protocol. The target built-in protocol is determined from a protocol set pre-stored locally based on the imported data of the device to be monitored; information interaction is performed with the device to be monitored based on the target built-in protocol, and the acquisition data of the device to be monitored is obtained; the acquired data is corrected according to an abnormal data monitoring model and the acquired data; the corrected acquired data is filtered to obtain filtered acquired data, and the filtered acquired data is uploaded to an operation and maintenance platform so that the operation and maintenance platform displays a monitoring result. Automatic data processing is realized through the target built-in protocol and the abnormal data monitoring model, without the need to locate, analyze, and process abnormal data manually, reducing the operation and maintenance cost and improving the maintenance efficiency.

[0096] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar content as in the above-mentioned first embodiment can be referred to the above introduction and will not be repeated hereinafter. On this basis, please refer to Figure 4 , step S10 includes steps S101 to S102:

[0097] Step S101: When the imported data of the device to be monitored is not empty, determine the target built-in protocol from the protocol set pre-stored locally according to the type of the imported data.

[0098] It should be noted that the types of the imported data include at least: device list, device picture, and protocol text.

[0099] In a specific embodiment, when the imported data is a device list, the target built-in protocol is determined from the protocol set pre-stored locally according to the manufacturer information, device model, and software version of the device list; when the imported data is a device picture, the target built-in protocol is determined from the protocol set pre-stored locally according to the device nameplate and device panel information of the device picture; when the imported data is a protocol text, the protocol text and the built-in protocol text are respectively converted into a first vector and a second vector, and the target built-in protocol is determined from the protocol set pre-stored locally according to the cosine similarity between the first vector and the second vector.

[0100] Specifically, when the imported data is a device list, the corresponding built-in protocol can be quickly selected as the target built-in protocol based on the manufacturer information, device model, and software version of the device list; when the imported data is a device picture, the most matching built-in protocol can be quickly selected as the target built-in protocol based on the device nameplate and device panel picture; when the imported data is a protocol text, the imported protocol text and the protocol text built into the FSU can be converted into vectors by using the cosine similarity algorithm, and then the cosine similarity between the two text vectors can be calculated. The output result is a value between 0 and 1, and the closer the value is to 1, the more similar the texts are, so as to quickly select the most matching built-in protocol as the target built-in protocol.

[0101] Step S102: When the imported data of the device to be monitored is empty, control the built-in manufacturer information to sequentially request parsing data from the device to be monitored, and obtain the parsing value of the parsing data. When the parsing value is within the preset parsing value range, obtain the built-in protocol corresponding to the parsing value from the protocol set pre-stored locally, and determine the built-in protocol corresponding to the parsing value as the target built-in protocol.

[0102] It should be noted that when the manufacturer information, device picture, and protocol text of the intelligent device cannot be obtained, it is determined that the imported data of the device to be monitored is empty.

[0103] Specifically, when the manufacturer information, device picture, and protocol text of the intelligent device cannot be obtained, the blind scan function can be started to automatically switch and control the built-in manufacturer information (manufacturer name, device model, and software version) to poll and request parsing data from the device. When parsing data is requested and the parsing value of the parsing data is within the preset parsing value range, it is considered that the built-in protocol corresponding to the currently blindly selected manufacturer matches the device to be monitored connected, so as to select the automatically matched built-in protocol as the target built-in protocol.

[0104] In this embodiment, when the imported data of the device to be monitored is not empty, the target built-in protocol is determined from the protocol set pre-stored locally according to the type of the imported data; when the imported data of the device to be monitored is empty, control the built-in manufacturer information to sequentially request parsing data from the device to be monitored, and obtain the parsing value of the parsing data. When the parsing value is within the preset parsing value range, obtain the built-in protocol corresponding to the parsing value from the protocol set pre-stored locally, and determine the built-in protocol corresponding to the parsing value as the target built-in protocol. Determining the target built-in protocol according to the situation of the imported data improves the universality of the data monitoring method based on the target built-in protocol.

[0105] It should be noted that the above examples are only for understanding this application and do not constitute a limitation to the data monitoring method based on the target built-in protocol of this application. Based on this technical concept, more forms of simple transformation are within the protection scope of this application.

[0106] This application also provides a data monitoring device based on the target built-in protocol. Please refer to Figure 5 The data monitoring device based on the target built-in protocol includes:

[0107] A determination module 10, configured to determine the target built-in protocol from a protocol set pre-stored locally based on the imported data of the device to be monitored.

[0108] An acquisition module 20, configured to perform information interaction with the device to be monitored based on the target built-in protocol and acquire the acquisition data of the device to be monitored.

[0109] A correction module 30, configured to obtain the corrected acquisition data according to the abnormal data monitoring model and the acquisition data.

[0110] A monitoring module 40, configured to perform filtering processing on the corrected acquisition data to obtain the filtered acquisition data, and upload the filtered acquisition data to the operation and maintenance platform so that the operation and maintenance platform displays the monitoring result.

[0111] The data monitoring device based on the target built-in protocol provided by this application adopts the data monitoring method based on the target built-in protocol in the above embodiment, and can solve the technical problem of low maintenance efficiency of the existing data monitoring solution. Compared with the prior art, the beneficial effects of the data monitoring device based on the target built-in protocol provided by this application are the same as those of the data monitoring method based on the target built-in protocol provided in the above embodiment, and other technical features in the data monitoring device based on the target built-in protocol are the same as the features disclosed in the method of the above embodiment, which will not be elaborated here.

[0112] In one embodiment, the determination module 10 is further configured to, when the imported data of the device to be monitored is not empty, determine the target built-in protocol from the protocol set pre-stored locally according to the type of the imported data; when the imported data of the device to be monitored is empty, control the built-in manufacturer information to sequentially request the device to be monitored to parse data, and acquire the parsing value of the parsed data. When the parsing value is within the preset parsing value range, acquire the built-in protocol corresponding to the parsing value from the protocol set pre-stored locally, and determine the built-in protocol corresponding to the parsing value as the target built-in protocol.

[0113] In one embodiment, the determining module 10 is further configured to, when the imported data is a device list, determine a target built-in protocol from a protocol set pre-stored locally according to the manufacturer information, device model, and software version of the device list; when the imported data is a device picture, determine a target built-in protocol from the protocol set pre-stored locally according to the device nameplate and device panel information of the device picture; when the imported data is a protocol text, convert the protocol text and the built-in protocol text into a first vector and a second vector respectively, and determine a target built-in protocol from the protocol set pre-stored locally according to the cosine similarity between the first vector and the second vector.

[0114] In one embodiment, the determining module 10 is further configured to, when it is detected that the target built-in protocol does not meet the requirements, obtain a demand virtual semaphore; input the text information corresponding to the demand virtual semaphore; split the text information into several key fields, and store the key fields in a protocol dependency file, so that the target built-in protocol can obtain the key fields from the protocol dependency file.

[0115] In one embodiment, the obtaining module 20 is further configured to preprocess the collected data through an abnormal data monitoring model to obtain preprocessed collected data, and the preprocessing at least includes data collection, data cleaning, feature engineering, and data standardization; use the preprocessed collected data as historical data, and train the abnormal data monitoring model according to the historical data to obtain a trained abnormal data monitoring model; perform prediction through the trained abnormal data monitoring model to obtain prediction data for a future preset time period; obtain the actual data of the device to be monitored in the future preset time period; and obtain corrected collected data according to the actual data and the prediction data.

[0116] In one embodiment, the obtaining module 20 is further configured to, when the difference between the actual data and the prediction data is greater than a preset difference threshold, mark the actual data as abnormal data; automatically correct the abnormal data to obtain corrected actual data, so that the difference between the corrected actual data and the prediction data is less than or equal to the preset difference threshold.

[0117] In one embodiment, the obtaining module 20 is further configured to obtain the abnormal data corresponding to the corrected collected data; save the data packet corresponding to the abnormal data to a log file; and analyze the abnormal data based on the log file to obtain an abnormal data analysis report.

[0118] The present application provides a data monitoring device based on a target built-in protocol. The data monitoring device based on the target built-in protocol includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the data monitoring method based on the target built-in protocol in Embodiment 1 above.

[0119] Reference is made below to Figure 6 , which shows a schematic structural diagram of a data monitoring device based on a target built-in protocol suitable for use in implementing the embodiments of the present application. The data monitoring device based on the target built-in protocol in the embodiments of the present application may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions: tablet computers), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The data monitoring device based on the target built-in protocol shown is merely an example and should not impose any limitation on the functions and usage scope of the embodiments of the present application.

[0120] As Figure 6As shown, the data monitoring device based on the target built-in protocol may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM: Read Only Memory) 1002 or the program loaded from the storage device 1003 into the random access memory (RAM: Random Access Memory) 1004. In the RAM 1004, various programs and data required for the operation of the data monitoring device based on the target built-in protocol are also stored. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other through a bus 1005. The input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the data monitoring device based on the target built-in protocol to communicate with other devices wirelessly or wiredly to exchange data. Although the figure shows a data monitoring device based on the target built-in protocol with various systems, it should be understood that it is not required to implement or have all the shown systems. More or fewer systems can be alternatively implemented or had.

[0121] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device, or installed from the storage device 1003, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiments disclosed in the present application are executed.

[0122] The data monitoring device based on the target built-in protocol provided by the present application adopts the data monitoring method based on the target built-in protocol in the above embodiments, and can solve the technical problem of low maintenance efficiency of the existing data monitoring solutions. Compared with the prior art, the beneficial effects of the data monitoring device based on the target built-in protocol provided by the present application are the same as those of the data monitoring method based on the target built-in protocol provided by the above embodiments, and other technical features in the data monitoring device based on the target built-in protocol are the same as the features disclosed in the method of the previous embodiment, and will not be elaborated here.

[0123] It should be understood that each part disclosed in this application can be implemented by hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in a suitable manner in any one or more embodiments or examples.

[0124] As described above, the above is only the specific implementation manner of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed in this application can easily think of changes or substitutions, which should all be covered within the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

[0125] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., computer programs) stored thereon, and the computer-readable program instructions are used to execute the data monitoring method based on the target built-in protocol in the above embodiments.

[0126] The computer-readable storage medium provided by this application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or flash memory, optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or combined with an instruction execution system, device, or device. The program code contained on the computer-readable storage medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0127] The above computer-readable storage medium can be included in the data monitoring device based on the target built-in protocol; or it can exist separately without being assembled into the data monitoring device based on the target built-in protocol.

[0128] The above computer-readable storage medium carries one or more programs which, when executed by a data monitoring device based on a target built-in protocol, cause the data monitoring device based on the target built-in protocol to: determine a target built-in protocol from a locally pre-stored protocol set based on imported data of a device to be monitored; perform information interaction with the device to be monitored based on the target built-in protocol and obtain acquisition data of the device to be monitored; obtain corrected acquisition data according to an abnormal data monitoring model and the acquisition data; perform filtering processing on the corrected acquisition data to obtain filtered acquisition data, and upload the filtered acquisition data to an operation and maintenance platform so that the operation and maintenance platform displays a monitoring result.

[0129] Computer program code for performing the operations of the present application may be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, execute as a stand-alone software package, execute partially on the user's computer and partially on a remote computer, or execute entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (for example, by connecting through an Internet service provider via the Internet).

[0130] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0131] The modules involved in the embodiments of the present application can be implemented in software or in hardware. Among them, the name of the module does not constitute a limitation on the unit itself in some cases.

[0132] The readable storage medium provided by the present application is a computer-readable storage medium. The computer-readable storage medium stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned data monitoring method based on the target built-in protocol, which can solve the technical problem of low maintenance efficiency of the existing data monitoring solution. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as those of the data monitoring method based on the target built-in protocol provided by the above embodiments, and will not be elaborated here.

[0133] The present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the steps of the data monitoring method based on the target built-in protocol as described above.

[0134] The computer program product provided by the present application can solve the technical problem of low maintenance efficiency of the existing data monitoring solution. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as those of the data monitoring method based on the target built-in protocol provided by the above embodiments, and will not be elaborated here.

[0135] The above are only some embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structural transformation made by using the content of the specification and drawings of the present application under the technical concept of the present application, or any direct / indirect application in other related technical fields, is included in the patent protection scope of the present application.

Claims

1. A data monitoring method based on a target built-in protocol, characterized in that: The method is applied to a data monitoring system based on a target built-in protocol, wherein the data monitoring system based on a target built-in protocol, a device to be monitored and an operation and maintenance platform are connected via a communication protocol, and the method comprises: Determining a target built-in protocol from a locally pre-stored protocol set based on the imported data of the device to be monitored; Performing information exchange with the device to be monitored based on the target built-in protocol, and acquiring collected data of the device to be monitored; Obtaining corrected collected data according to the abnormal data monitoring model and the collected data; The corrected collected data is filtered to obtain filtered collected data, and the filtered collected data is uploaded to the operation and maintenance platform so that the operation and maintenance platform displays the monitoring results.

2. The method according to claim 1, characterized in that The step of determining the target built-in protocol from a locally pre-stored protocol set based on the imported data of the device to be monitored includes: When the imported data of the device to be monitored is not empty, determining a target built-in protocol from a locally pre-stored protocol set according to the type of the imported data; When the imported data of the device to be monitored is empty, the built-in manufacturer information is controlled to request parsed data from the device to be monitored in turn, and obtain the parsed value of the parsed data; when the parsed value is within a preset parsed value range, the built-in protocol corresponding to the parsed value is obtained from a locally pre-stored protocol set, and the built-in protocol corresponding to the parsed value is determined to be the target built-in protocol.

3. The method according to claim 2, characterized in that The step of determining the target built-in protocol from the locally pre-stored protocol set according to the type of the imported data includes: When the imported data is a device list, determining the target built-in protocol from a locally pre-stored protocol set according to the manufacturer information, device model and software version of the device list; When the imported data is a device image, determining a target built-in protocol from a locally pre-stored protocol set according to the device nameplate and device panel information of the device image; When the imported data is a protocol text, the protocol text and the built-in protocol text are converted into a first vector and a second vector respectively, and a target built-in protocol is determined from a locally pre-stored protocol set according to the cosine similarity of the first vector and the second vector.

4. The method according to claim 1, characterized in that After the step of determining the target built-in protocol from the locally pre-stored protocol set based on the imported data of the device to be monitored, the method further includes: When it is detected that the target built-in protocol does not meet the requirements, the required virtual semaphore is obtained; Enter the text information corresponding to the required virtual semaphore; The text information is split into a plurality of key fields, and the key fields are stored in a protocol dependency file, so that the target built-in protocol obtains the key fields from the protocol dependency file.

5. The method according to claim 1, characterized in that The step of obtaining the corrected collected data according to the abnormal data monitoring model and the collected data comprises: Preprocessing the collected data through an abnormal data monitoring model to obtain preprocessed collected data, wherein the preprocessing at least includes data collection, data cleaning feature engineering, and data standardization; Using the preprocessed collected data as historical data, and training the abnormal data monitoring model according to the historical data to obtain a trained abnormal data monitoring model; Perform predictions using the trained abnormal data monitoring model to obtain prediction data for a future preset time period; Acquire actual data of the device to be monitored in a preset time period in the future; Corrected collected data is obtained according to the actual data and the predicted data.

6. The method according to claim 5, characterized in that The step of obtaining the corrected collected data according to the actual data and the predicted data comprises: When the difference between the actual data and the predicted data is greater than a preset difference threshold, marking the actual data as abnormal data; The abnormal data is automatically corrected to obtain corrected actual data, so that the difference between the corrected actual data and the predicted data is less than or equal to the preset difference threshold.

7. The method according to claim 1, characterized in that After the step of obtaining the corrected collected data according to the abnormal data monitoring model and the collected data, the method further includes: Acquire abnormal data corresponding to the corrected collected data; Saving the data packet corresponding to the abnormal data to a log file; The abnormal data is analyzed based on the log file to obtain an abnormal data analysis report.

8. A data monitoring device based on a target built-in protocol, characterized in that: The data monitoring device based on the target built-in protocol includes: A determination module, used to determine a target built-in protocol from a locally pre-stored protocol set based on the imported data of the device to be monitored; An acquisition module, used for performing information exchange with the device to be monitored based on the target built-in protocol, and acquiring the collected data of the device to be monitored; A correction module, used for obtaining corrected collected data according to the abnormal data monitoring model and the collected data; The monitoring module is used to filter the corrected collected data to obtain filtered collected data, and upload the filtered collected data to the operation and maintenance platform so that the operation and maintenance platform can display the monitoring results.

9. A data monitoring device based on a target built-in protocol, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the data monitoring method based on the target built-in protocol according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the data monitoring method based on the target built-in protocol as described in any one of claims 1 to 7 are implemented.

Images