Data monitoring method, system, device and storage medium

Abstract

The application discloses a data monitoring method, system and device, and a storage medium. The method comprises the following steps: receiving a monitoring instruction, and identifying a target monitoring device that sends the monitoring instruction, wherein the monitoring instruction is used for monitoring data information in a to-be-monitored device; analyzing the monitoring instruction, and determining a to-be-monitored device indicated by the monitoring instruction; determining a backup database of the to-be-monitored device, and acquiring running data of the to-be-monitored device from the backup database according to the monitoring instruction; processing the running data according to a level of the to-be-monitored device, and obtaining target data after processing; sending the target data to the target monitoring device, and determining an abnormal condition of the target data through the target monitoring device. Through the application, the problem that the efficiency of monitoring data in different data systems using different to-be-monitored devices is low and monitoring resources are wasted in the prior art is solved.

Description

Technical Field

[0001] This application relates to the field of data processing, and more specifically, to a data monitoring method, system, apparatus, and storage medium. Background Technology

[0002] As online business volume continues to expand in financial institutions and the number of financial institutions increases, the number and types of data systems or platforms used also increase. Due to the different data types or formats between different data systems or platforms, data interaction and monitoring between multiple platforms and systems become difficult due to data differences, making it impossible to monitor uniformly. This necessitates using the corresponding data monitoring devices for each platform or system, thereby reducing data monitoring efficiency and wasting monitoring resources.

[0003] There is currently no effective solution to the problem of low efficiency and wasted monitoring resources when using different devices to monitor data in different data systems in related technologies. Summary of the Invention

[0004] This application provides a data monitoring method, system, device, and storage medium to solve the problems of low efficiency and wasted monitoring resources in the related art when using different devices to monitor data in different data systems.

[0005] According to one aspect of this application, a data monitoring method is provided. The method includes: receiving a monitoring instruction and identifying the target monitoring device sending the monitoring instruction, wherein the monitoring instruction is used to monitor data information in the device to be monitored; parsing the monitoring instruction to determine the device to be monitored as indicated by the monitoring instruction; determining a backup database for the device to be monitored and obtaining the operating data of the device to be monitored from the backup database according to the monitoring instruction; processing the operating data according to the level of the device to be monitored to obtain processed target data; sending the target data to the target monitoring device and determining any abnormalities in the target data through the target monitoring device.

[0006] Optionally, determining the backup database for the device to be monitored includes: identifying the primary database of the device to be monitored and determining the number of backup databases associated with the primary database; if the primary database is associated with one backup database, determining the backup database as the backup database for the device to be monitored; if the primary database is associated with multiple backup databases, obtaining the usage rate of each backup database, obtaining the backup database with the lowest usage rate, obtaining the target database, and determining the target database as the backup database for the device to be monitored.

[0007] Optionally, the operational data is processed according to the level of the device to be monitored to obtain the processed target data, including: determining whether there is abnormal data in the operational data, and deleting the abnormal data if abnormal data is found, to obtain the first data; determining whether the level of the device to be monitored is the first level, and obtaining a preset format if the level is the first level, and converting the first data using the preset format to obtain the target data; determining whether the level of the device to be monitored is the second level, and obtaining a preset format if the level is the second level, and converting the first data using the preset format to obtain the second data; obtaining the data processing flow associated with the device to be monitored, and processing the second data using the data processing flow to obtain the target data.

[0008] Optionally, the data information includes the number of data points. Before processing the operational data according to the level of the device to be monitored to obtain the processed target data, the method further includes: obtaining the attribute information of the device to be monitored and determining a first score of the device to be monitored based on the attribute information; determining a second score of the device to be monitored based on the number of data points; calculating the total score of the device to be monitored based on the first score and the second score, and determining the level of the device to be monitored based on the total score.

[0009] Optionally, obtaining the operating data of the device to be monitored from the backup database according to the monitoring instructions includes: determining the system type of the device to be monitored to obtain the target system type; determining the data transmission interface associated with the target system type to obtain the target interface; sending a data acquisition instruction to the backup database through the target interface, and receiving the operating data through the target interface.

[0010] Optionally, after determining the abnormality of the target data through the target monitoring device, the method further includes: receiving feedback information sent by the target monitoring device and determining whether the feedback information indicates that there is an abnormality in the operating data; if the feedback information indicates that there is an abnormality in the operating data, determining the cause of the abnormal operating data and sending the cause of the abnormality to the device to be monitored.

[0011] Optionally, after sending the target data to the target monitoring device, the method further includes: obtaining the storage pool where the target monitoring device is located in the database to obtain the target storage pool; sending the target data to the target storage pool and obtaining the data storage volume in the target storage pool; determining whether the data storage volume is greater than the preset storage volume; if the data storage volume is greater than the preset storage volume, deleting the data with the longest storage time in the target data pool to obtain the updated data storage pool, wherein the data storage volume of the updated data storage pool is less than or equal to the preset storage volume.

[0012] According to another aspect of this application, a data monitoring system is provided. The system includes: a device to be monitored, used to send operational data to a data processing device; a data processing device, used to receive monitoring instructions, identify the target monitoring device sending the monitoring instructions, parse the monitoring instructions, determine the device to be monitored indicated by the monitoring instructions, determine a backup database for the device to be monitored, and retrieve the operational data of the device to be monitored from the backup database according to the monitoring instructions, process the operational data according to the level of the device to be monitored to obtain processed target data, send the target data to the target monitoring device, and determine any abnormalities in the target data through the target monitoring device, wherein the monitoring instructions are used to monitor data information in the device to be monitored; and a target monitoring device, connected to the data processing device, used to send monitoring instructions, receive the target data sent by the data processing device, and determine any abnormalities in the target data.

[0013] According to another aspect of this application, a data monitoring device is provided. The device includes: a first receiving unit for receiving monitoring instructions and identifying the target monitoring device sending the monitoring instructions, wherein the monitoring instructions are used to monitor data information in the device to be monitored; a parsing unit for parsing the monitoring instructions and determining the device to be monitored indicated by the monitoring instructions; a first determining unit for determining a backup database for the device to be monitored and obtaining the operating data of the device to be monitored from the backup database according to the monitoring instructions; a processing unit for processing the operating data according to the level of the device to be monitored to obtain processed target data; and a second determining unit for sending the target data to the target monitoring device and determining any abnormalities in the target data through the target monitoring device.

[0014] According to another aspect of the present invention, a computer storage medium is also provided for storing a program, wherein the program, when running, controls the device where the computer storage medium is located to execute a data monitoring method.

[0015] According to another aspect of the present invention, an electronic device is also provided, comprising one or more processors and a memory; the memory stores computer-readable instructions, and the processor is configured to execute the computer-readable instructions, wherein the computer-readable instructions execute a data monitoring method when executed.

[0016] This application employs the following steps: receiving a monitoring instruction and identifying the target monitoring device sending the instruction, wherein the monitoring instruction is used to monitor data information in the device to be monitored; parsing the monitoring instruction to determine the device to be monitored as indicated by the instruction; determining the backup database for the device to be monitored and retrieving the operational data of the device to be monitored from the backup database according to the monitoring instruction; processing the operational data according to the level of the device to be monitored to obtain processed target data; sending the target data to the target monitoring device and determining any abnormalities in the target data through the target monitoring device. This solves the problem of low efficiency and wasted monitoring resources associated with using different devices to monitor data in different data systems in related technologies. By identifying the target monitoring device sending the monitoring instruction, determining the device to be monitored, and retrieving data from the backup database of the device to be monitored, and then uniformly processing the data according to the level of the device to be monitored, and sending the processed data to the target monitoring device, the data monitoring efficiency is improved and data monitoring resources are saved by processing the data differently according to the type of device to be monitored in the data processing device. Attached Figure Description

[0017] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments and descriptions of this application are used to explain this application and do not constitute an undue limitation of this application. In the drawings:

[0018] Figure 1 This is a flowchart of a data monitoring method provided according to an embodiment of this application;

[0019] Figure 2 This is a flowchart of an optional backup library selection method provided according to an embodiment of this application;

[0020] Figure 3 This is a schematic diagram of a data monitoring system provided according to an embodiment of this application;

[0021] Figure 4 This is a schematic diagram of a data monitoring device provided according to an embodiment of this application;

[0022] Figure 5 This is a schematic diagram of an electronic device provided according to an embodiment of this application. Detailed Implementation

[0023] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0024] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0025] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this application described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0026] It should be noted that all information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are information and data authorized by the user or fully authorized by all parties. For example, this system has an interface with relevant users or organizations. Before obtaining relevant information, it is necessary to send an acquisition request to the aforementioned user or organization through the interface, and obtain the relevant information after receiving consent information from the aforementioned user or organization.

[0027] It should be noted that the data monitoring methods, systems, devices, and storage media defined in this disclosure can be used in the field of data processing, or in any field other than data processing. The application fields of the data monitoring methods, systems, devices, and storage media defined in this disclosure are not limited.

[0028] According to an embodiment of this application, a data monitoring method is provided.

[0029] Figure 1 This is a flowchart of a data monitoring method according to an embodiment of this application. For example... Figure 1 As shown, the method includes the following steps:

[0030] Step S101: Receive monitoring instructions and identify the target monitoring device that sent the monitoring instructions. The monitoring instructions are used to monitor the data information in the device to be monitored.

[0031] Specifically, the data processing device can be connected to multiple devices to be monitored, as well as multiple devices used by users to be monitored. When a user issues a monitoring command using the target monitoring device, the target monitoring device will send the monitoring command to the data processing device. At this time, the data processing device will identify the source IP information in the monitoring command to determine the device that sent the monitoring command, and then accurately return the data after obtaining it.

[0032] Step S102: parse the monitoring command and determine the device to be monitored as indicated by the monitoring command.

[0033] Specifically, after receiving a monitoring command, the command can be parsed to determine the devices that the user needs to monitor.

[0034] Step S103: Determine the backup database for the device to be monitored, and obtain the operating data of the device to be monitored from the backup database according to the monitoring instructions.

[0035] Specifically, in order to minimize the impact on the monitored device when acquiring its data, the data indicated in the monitoring instructions can be obtained from the backup database of the monitored device, thereby obtaining the operating data of the monitored device.

[0036] Step S104: Process the operating data according to the level of the device to be monitored to obtain the processed target data.

[0037] Specifically, since different devices have different equipment types and data storage types, after obtaining the operational data, the data processing equipment can process the data to standardize it, so that the data received by the monitoring equipment is standardized data.

[0038] Step S105: Send the target data to the target monitoring device and determine any abnormalities in the target data through the target monitoring device.

[0039] Specifically, after obtaining standardized data, the data can be returned to the target monitoring device based on the source IP. The target monitoring device can then verify and check the operational data to determine whether there are any problems with the monitored device.

[0040] The data monitoring method provided in this application embodiment receives a monitoring instruction and identifies the target monitoring device sending the instruction. The monitoring instruction is used to monitor data information in the device to be monitored. The method parses the monitoring instruction to determine the device to be monitored. It then determines a backup database for the device to be monitored and retrieves the device's operational data from the backup database according to the monitoring instruction. The operational data is processed according to the monitoring device's classification level to obtain processed target data. The target data is then sent to the target monitoring device, and any abnormalities in the target data are identified through the target monitoring device. This method solves the problem of low efficiency and wasted monitoring resources associated with using different devices to monitor data in different data systems in related technologies. By determining the target monitoring device sending the monitoring instruction, identifying the device to be monitored, and retrieving data from the backup database of the device to be monitored, and then uniformly processing the data according to the classification level of the monitored device, the processed data is sent to the target monitoring device. By processing the data differently according to the type of the monitored device in the data processing device, the method improves data monitoring efficiency and saves data monitoring resources.

[0041] Optionally, Figure 2 This is a flowchart of an optional backup library selection method provided according to embodiments of this application, such as... Figure 2 As shown, in the data monitoring method provided in this application embodiment, step S103, determining the backup database of the device to be monitored includes:

[0042] Step S201: Identify the main database of the device to be monitored and determine the number of backup databases associated with the main database;

[0043] Step S202: When the primary database is associated with a backup database, the backup database is identified as the backup database for the device to be monitored.

[0044] Step S203: When the primary database is associated with multiple backup databases, obtain the utilization rate of each backup database, and obtain the backup database with the lowest utilization rate to obtain the target database. The target database is then determined as the backup database of the device to be monitored.

[0045] Specifically, since acquiring data from the monitored device usually affects its operation, in order to minimize the impact on the operation of the monitored device, the first step is to obtain the operating data from the backup database, thereby avoiding the impact on the main database. Furthermore, if there are multiple backup databases, the backup database with the lowest usage rate can be identified, and the operating data can be obtained from that database to reduce the impact on the operation of the monitored device.

[0046] Optionally, in the data monitoring method provided in this application embodiment, processing the operating data according to the level of the device to be monitored to obtain the processed target data includes: determining whether there is abnormal data in the operating data, and deleting the abnormal data if there is abnormal data to obtain first data; determining whether the level of the device to be monitored is first level, and obtaining a preset format if the level of the device to be monitored is first level, and converting the first data through the preset format to obtain target data; determining whether the level of the device to be monitored is second level, and obtaining a preset format if the level of the device to be monitored is second level, and converting the first data through the preset format to obtain second data; obtaining the data processing flow associated with the device to be monitored, and processing the second data through the data processing flow to obtain target data.

[0047] Specifically, due to the differences between the devices to be monitored, the data needs to be processed according to the level of the devices to be monitored after the operational data is obtained.

[0048] Regardless of the monitoring level of the device, abnormal data in the obtained operational data must be deleted, that is, the data must be cleaned. Missing data can also be filled in according to the relationship between the operational data, or missing abnormal data can be deleted, so as to ensure the validity of the data.

[0049] Furthermore, when the monitored device is at level one, the data needs to be standardized according to general rules. That is, the primary data needs to be converted using a preset format to obtain the target data. Table 1 shows an optional comparison table of operational data before and after conversion. As shown in Table 1, the field names in the data can be changed according to the preset format in Table 1.

[0050] Table 1

[0051] sys head_sys Data Header - System Identifier - name head_name Data Header - System Name code head_code Data Header - System Abbreviation desc head_desc Data Header - Description from head_from Data Header - Source type head_type Data Header - Type

[0052] Finally, when the monitoring device is at level two, the operating data needs to be standardized according to the above process to obtain the second data. At the same time, the unique standardization process of the monitoring device needs to be obtained, and then the monitoring device is subjected to secondary standardization processing, so as to achieve the effect of corresponding processing of the operating data of different devices.

[0053] Optionally, in the data monitoring method provided in this application embodiment, the data information includes the data quantity. Before processing the operating data according to the level of the device to be monitored to obtain the processed target data, the method further includes: obtaining the attribute information of the device to be monitored and determining a first score of the device to be monitored based on the attribute information; determining a second score of the device to be monitored based on the data quantity; calculating the total score of the device to be monitored based on the first score and the second score, and determining the level of the device to be monitored based on the total score.

[0054] Specifically, when determining the level of the device to be monitored, it can first be determined based on the attribute information. That is, if the attribute information represents the importance of the device to be monitored as X, the score corresponding to X can be determined as part of the first score. Similarly, the scores of the other attribute information can also be determined, that is, grouped according to characteristics and different scores are determined for each group. For example, if the importance is X and X is in the second group, the score can be 2 points.

[0055] Furthermore, as the amount of data to be monitored increases, the need for standardized data becomes more crucial. Therefore, the amount of data to be monitored can be used to determine the second score, and the total score can be determined based on the first and second scores. For example, the first and second scores can be weighted and summed, or they can be summed directly. Once the total score is obtained, the level of the device to be monitored can be determined based on the correspondence between the total score and the level.

[0056] Optionally, in the data monitoring method provided in this application embodiment, obtaining the operating data of the device to be monitored from the backup database according to the monitoring instruction includes: determining the system type of the device to be monitored to obtain the target system type; determining the data transmission interface associated with the target system type to obtain the target interface; sending a data acquisition instruction to the backup database through the target interface, and receiving the operating data through the target interface.

[0057] Specifically, when obtaining data from the device under monitoring through the data processing device, it is necessary to first obtain the system type of the device under monitoring and determine the interface information based on the system type, such as a database interface or an API interface. After determining the interface information, the device under monitoring is connected through the database interface or API interface to accurately obtain the operating data from the device under monitoring.

[0058] Optionally, in the data monitoring method provided in this application embodiment, after determining the abnormality of the target data through the target monitoring device, the method further includes: receiving feedback information sent by the target monitoring device and determining whether the feedback information indicates that there is an abnormality in the operating data; if the feedback information indicates that there is an abnormality in the operating data, determining the abnormal cause of the abnormal operating data and sending the abnormal cause to the device to be monitored.

[0059] Specifically, after obtaining the target data, it can be sent to the target monitoring device, which will then check the data. If the target monitoring device detects an anomaly in the target data, it can identify the cause of the anomaly and send it to the data processing device. The data processing device can then retrieve the historical data of the device under monitoring and send it to the target monitoring device for further analysis of the cause of the anomaly. It can also send alarm information to the device under monitoring based on the cause of the anomaly, thereby stopping the device under monitoring from performing its current operation and resolving the anomaly in a timely manner.

[0060] Optionally, in the data monitoring method provided in this application embodiment, after sending the target data to the target monitoring device, the method further includes: obtaining the storage pool where the target monitoring device is located in the database to obtain the target storage pool; sending the target data to the target storage pool and obtaining the data storage volume in the target storage pool; determining whether the data storage volume is greater than a preset storage volume; if the data storage volume is greater than the preset storage volume, deleting the data with the longest storage time in the target data pool to obtain an updated data storage pool, wherein the data storage volume of the updated data storage pool is less than or equal to the preset storage volume.

[0061] Specifically, in order to ensure that historical target data can be obtained in a timely manner when equipment malfunctions, the target data can be stored after it is obtained. If the storage volume exceeds the preset storage volume, the data with the longest storage time will be deleted, that is, the data with the oldest time will be deleted. This ensures both the timeliness of the data and the absence of data redundancy, thus ensuring the normal operation of the storage pool.

[0062] It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0063] According to an embodiment of this application, a data monitoring system is provided. Figure 3 This is a schematic diagram of a data monitoring system provided according to an embodiment of this application. For example... Figure 3 As shown, the system includes:

[0064] The device to be monitored, 301, is used to send operating data to the data processing device, 302.

[0065] Specifically, there can be multiple devices 301 to be monitored. Each device 301 can send its corresponding operating data to the data processing device 302 after receiving the monitoring instruction sent by the data processing device 302, thereby completing the data transmission operation.

[0066] The data processing device 302 is used to receive monitoring instructions, identify the target monitoring device 303 that sends the monitoring instructions, parse the monitoring instructions, determine the device to be monitored 301 indicated by the monitoring instructions, determine the backup database of the device to be monitored 301, and obtain the operating data of the device to be monitored 301 from the backup database according to the monitoring instructions. The operating data is processed according to the level of the device to be monitored 301 to obtain the processed target data, and the target data is sent to the target monitoring device 303. The target monitoring device 303 determines any abnormalities in the target data. The monitoring instructions are used to monitor the data information in the device to be monitored 301.

[0067] Specifically, after receiving the monitoring instruction from the target monitoring device 303, the data processing device 302 can obtain the operating data from the device to be monitored 301, process the operating data according to the level of the device to be monitored 301, obtain the target data, store the target data and send it to the target monitoring device 303, thereby completing the data standardization operation.

[0068] The target monitoring device 303 is connected to the data processing device 302 and is used to send monitoring instructions, receive target data sent by the data processing device 302, and determine any abnormalities in the target data.

[0069] Specifically, after receiving the target data, the target monitoring device 303 can inspect the target data. If the target monitoring device 303 detects an anomaly in the target data, it can identify the cause of the anomaly and send the cause to the data processing device 302. The data processing device 302 can then retrieve historical data from the monitored device 301 and send it to the target monitoring device 303 for further analysis of the cause of the anomaly. It can also send alarm information to the monitored device 301 based on the cause of the anomaly, thereby stopping the monitored device 301 from performing its current operation and resolving the anomaly promptly.

[0070] This application also provides a data monitoring device. It should be noted that the data monitoring device of this application can be used to execute the data monitoring method provided in this application. The data monitoring device provided in this application is described below.

[0071] Figure 4 This is a schematic diagram of a data monitoring device provided according to an embodiment of this application. For example... Figure 4As shown, the device includes: a first receiving unit 41, a parsing unit 42, a first determining unit 43, a processing unit 44, and a second determining unit 45.

[0072] The first receiving unit 41 is used to receive monitoring instructions and identify the target monitoring device that sends the monitoring instructions, wherein the monitoring instructions are used to monitor the data information in the device to be monitored.

[0073] The parsing unit 42 is used to parse the monitoring command and determine the device to be monitored as indicated by the monitoring command.

[0074] The first determining unit 43 is used to determine the backup database of the device to be monitored and to obtain the operating data of the device to be monitored from the backup database according to the monitoring instructions.

[0075] The processing unit 44 is used to process the operating data according to the level of the device to be monitored, and obtain the processed target data.

[0076] The second determining unit 45 is used to send the target data to the target monitoring device and determine the abnormal situation of the target data through the target monitoring device.

[0077] The data monitoring device provided in this application embodiment receives monitoring instructions through a first receiving unit 41 and identifies the target monitoring device sending the monitoring instructions. The monitoring instructions are used to monitor data information in the device to be monitored. A parsing unit 42 parses the monitoring instructions to determine the device to be monitored as indicated by the instructions. A first determining unit 43 determines the backup database of the device to be monitored and retrieves the operating data of the device to be monitored from the backup database according to the monitoring instructions. A processing unit 44 processes the operating data according to the level of the device to be monitored to obtain processed target data. A second determining unit 45 sends the target data to the target monitoring device and determines any abnormalities in the target data through the target monitoring device. This solves the problem of low efficiency and wasted monitoring resources associated with using different devices to monitor data in different data systems in related technologies. By determining the target monitoring device sending the monitoring instructions, identifying the device to be monitored, and retrieving data from the backup database of the device to be monitored, and then uniformly processing the data according to the level of the device to be monitored, the processed data is sent to the target monitoring device. By processing the data differently according to the type of device to be monitored in the data processing device, the efficiency of data monitoring is improved, and data monitoring resources are saved.

[0078] Optionally, in the data monitoring device provided in this application embodiment, the first determining unit 43 includes: an identification module, used to identify the main database of the device to be monitored and determine the number of backup databases associated with the main database; a first determining module, used to determine the backup database as the backup database of the device to be monitored when the main database is associated with one backup database; and a first obtaining module, used to obtain the usage rate of each backup database when the main database is associated with multiple backup databases, and obtain the backup database with the lowest usage rate to obtain the target database, and determine the target database as the backup database of the device to be monitored.

[0079] Optionally, in the data monitoring device provided in this application embodiment, the processing unit 44 includes: a first judgment module, used to judge whether there is abnormal data in the running data, and if there is abnormal data in the running data, delete the abnormal data to obtain first data; a second judgment module, used to judge whether the level of the device to be monitored is the first level, and if the level of the device to be monitored is the first level, obtain a preset format, and convert the first data through the preset format to obtain target data; a third judgment module, used to judge whether the level of the device to be monitored is the second level, and if the level of the device to be monitored is the second level, obtain a preset format, and convert the first data through the preset format to obtain second data, and obtain the data processing flow associated with the device to be monitored, and process the second data through the data processing flow to obtain target data.

[0080] Optionally, in the data monitoring device provided in this application embodiment, the data information includes the number of data. The device further includes: a first acquisition unit, used to acquire attribute information of the device to be monitored and determine a first score of the device to be monitored based on the attribute information; a third determination unit, used to determine a second score of the device to be monitored based on the number of data; and a fourth determination unit, used to calculate the total score of the device to be monitored based on the first score and the second score, and determine the level of the device to be monitored based on the total score.

[0081] Optionally, in the data monitoring device provided in this application embodiment, the first determining unit 43 includes: a second determining module, used to determine the system type of the device to be monitored and obtain the target system type; a third determining module, used to determine the data transmission interface associated with the target system type and obtain the target interface; and a second acquiring module, used to send a data acquiring instruction to the backup database through the target interface and receive running data through the target interface.

[0082] Optionally, in the data monitoring device provided in the embodiments of this application, the device further includes: a second receiving unit, used to receive feedback information sent by the target monitoring device and determine whether the feedback information indicates that there is an abnormality in the operating data; and a fifth determining unit, used to determine the cause of the abnormal operating data when the feedback information indicates that there is an abnormality in the operating data, and send the cause of the abnormality to the device to be monitored.

[0083] Optionally, in the data monitoring device provided in this application embodiment, the device further includes: a second acquisition unit, used to acquire the storage pool where the target monitoring device is located in the database, and obtain the target storage pool; a sending unit, used to send the target data to the target storage pool and acquire the data storage volume in the target storage pool; a judgment unit, used to judge whether the data storage volume is greater than a preset storage volume; and a deletion unit, used to delete the data with the longest storage time in the target data pool when the data storage volume is greater than the preset storage volume, and obtain an updated data storage pool, wherein the data storage volume of the updated data storage pool is less than or equal to the preset storage volume.

[0084] The aforementioned data monitoring device includes a processor and a memory. The first receiving unit 41, parsing unit 42, first determining unit 43, processing unit 44, and second determining unit 45 are all stored in the memory as program units. The processor executes the aforementioned program units stored in the memory to achieve the corresponding functions.

[0085] The processor contains a kernel, which retrieves the corresponding program unit from memory. One or more kernels can be configured. By adjusting kernel parameters, the inefficiency and wasted monitoring resources associated with using different monitored devices to monitor data in different data systems can be addressed in related technologies.

[0086] The memory may include non-permanent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0087] This invention provides a computer-readable storage medium storing a program thereon, which, when executed by a processor, implements the data monitoring method.

[0088] This invention provides a processor for running a program, wherein the program executes the data monitoring method during runtime.

[0089] like Figure 5As shown, this embodiment of the invention provides an electronic device 50, which includes a processor, a memory, and a program stored in the memory and executable on the processor. When the processor executes the program, it performs the following steps: receiving a monitoring instruction and identifying the target monitoring device sending the instruction, wherein the monitoring instruction is used to monitor data information in the device to be monitored; parsing the monitoring instruction to determine the device to be monitored as indicated by the instruction; determining a backup database for the device to be monitored and obtaining the operating data of the device to be monitored from the backup database according to the monitoring instruction; processing the operating data according to the level of the device to be monitored to obtain processed target data; sending the target data to the target monitoring device and determining any abnormalities in the target data through the target monitoring device. The device in this document can be a server, PC, PAD, mobile phone, etc.

[0090] This application also provides a computer program product, which, when executed on a data processing device, is suitable for executing an initialization program with the following method steps: receiving a monitoring instruction and identifying the target monitoring device sending the monitoring instruction, wherein the monitoring instruction is used to monitor data information in the device to be monitored; parsing the monitoring instruction to determine the device to be monitored indicated by the monitoring instruction; determining a backup database for the device to be monitored and obtaining the operating data of the device to be monitored from the backup database according to the monitoring instruction; processing the operating data according to the level of the device to be monitored to obtain processed target data; sending the target data to the target monitoring device and determining any abnormalities in the target data through the target monitoring device.

[0091] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0092] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0093] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0094] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0095] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0096] Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0097] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0098] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0099] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A data monitoring method, characterized in that, Applied to a data processing device, the method includes: Receive monitoring instructions and identify the target monitoring device that sends the monitoring instructions, wherein the monitoring instructions are used to monitor data information in the device to be monitored; Parse the monitoring command to determine the device to be monitored as indicated by the monitoring command; Determine a backup database for the device to be monitored, and retrieve the operating data of the device to be monitored from the backup database according to the monitoring instructions; The process of determining the backup database for the device to be monitored includes: identifying the main database of the device to be monitored and determining the number of backup databases associated with the main database; if the main database is associated with one backup database, determining the backup database as the backup database for the device to be monitored; if the main database is associated with multiple backup databases, obtaining the usage rate of each backup database and obtaining the backup database with the lowest usage rate to obtain a target database, and determining the target database as the backup database for the device to be monitored. The process of processing the operational data according to the level of the device to be monitored to obtain processed target data includes: determining whether there is abnormal data in the operational data, and deleting the abnormal data if it exists to obtain first data; determining whether the level of the device to be monitored is first level, and obtaining a preset format if it is first level, and converting the first data using the preset format to obtain the target data; determining whether the level of the device to be monitored is second level, and obtaining a preset format if it is second level, and converting the first data using the preset format to obtain second data; obtaining the data processing flow associated with the device to be monitored, and processing the second data using the data processing flow to obtain the target data. The data information includes the number of data points. Before processing the operational data according to the level of the device to be monitored to obtain the processed target data, the method further includes: acquiring the attribute information of the device to be monitored and determining a first score of the device to be monitored based on the attribute information; determining a second score of the device to be monitored based on the number of data points; calculating the total score of the device to be monitored using the first score and the second score, and determining the level of the device to be monitored based on the total score. The target data is sent to the target monitoring device, and the target monitoring device determines any abnormalities in the target data.

2. The method according to claim 1, characterized in that, Retrieving the operating data of the monitored device from the backup database according to the monitoring instruction includes: Determine the system type of the device to be monitored to obtain the target system type; Determine the data transmission interface associated with the target system type to obtain the target interface; The target interface is used to send a data retrieval command to the backup database and to receive the running data.

3. The method according to claim 1, characterized in that, After determining the anomaly in the target data through the target monitoring device, the method further includes: Receive feedback information sent by the target monitoring device and determine whether the feedback information indicates that there is an anomaly in the operating data; If the feedback information indicates that the operating data is abnormal, the cause of the abnormal operating data is determined and the cause of the abnormality is sent to the device to be monitored.

4. The method according to claim 1, characterized in that, After sending the target data to the target monitoring device, the method further includes: Obtain the storage pool where the target monitoring device is located from the database to obtain the target storage pool; The target data is sent to the target storage pool, and the amount of data stored in the target storage pool is obtained; Determine whether the amount of data stored is greater than the preset storage amount; If the data storage volume is greater than the preset storage volume, delete the data with the longest storage time in the target data pool to obtain an updated data storage pool, wherein the data storage volume of the updated data storage pool is less than or equal to the preset storage volume.

5. A data monitoring system, characterized in that, include: The device to be monitored is used to send operational data to the data processing device; The data processing device is configured to receive monitoring instructions, identify the target monitoring device sending the monitoring instructions, parse the monitoring instructions, determine the device to be monitored indicated by the monitoring instructions, determine the backup database of the device to be monitored, obtain the operating data of the device to be monitored from the backup database according to the monitoring instructions, process the operating data according to the level of the device to be monitored to obtain processed target data, send the target data to the target monitoring device, and determine the abnormality of the target data through the target monitoring device. The monitoring instructions are used to monitor the data information in the device to be monitored. The process of determining the backup database for the device to be monitored includes: identifying the main database of the device to be monitored and determining the number of backup databases associated with the main database; if the main database is associated with one backup database, determining the backup database as the backup database for the device to be monitored; if the main database is associated with multiple backup databases, obtaining the usage rate of each backup database and obtaining the backup database with the lowest usage rate to obtain a target database, and determining the target database as the backup database for the device to be monitored. The data processing device is configured to process the operating data according to the level of the device to be monitored to obtain processed target data, including: determining whether there is abnormal data in the operating data, and deleting the abnormal data to obtain first data if the abnormal data exists; determining whether the level of the device to be monitored is first level, and obtaining a preset format and converting the first data using the preset format to obtain the target data if the level of the device to be monitored is first level; determining whether the level of the device to be monitored is second level, and obtaining a preset format and converting the first data using the preset format to obtain second data; obtaining the data processing flow associated with the device to be monitored, and processing the second data using the data processing flow to obtain the target data; The data information includes the number of data points. Before processing the operational data according to the level of the device to be monitored to obtain the processed target data, the method further includes: acquiring the attribute information of the device to be monitored and determining a first score of the device to be monitored based on the attribute information; determining a second score of the device to be monitored based on the number of data points; calculating the total score of the device to be monitored using the first score and the second score, and determining the level of the device to be monitored based on the total score. The target monitoring device is connected to the data processing device and is used to send monitoring instructions, receive target data sent by the data processing device, and determine any abnormalities in the target data.

6. A data monitoring device, characterized in that, Applied to a data processing device, the device includes: The first receiving unit is used to receive monitoring instructions and identify the target monitoring device that sends the monitoring instructions, wherein the monitoring instructions are used to monitor data information in the device to be monitored; A parsing unit is used to parse the monitoring command and determine the device to be monitored indicated by the monitoring command; The first determining unit is used to determine the backup database of the device to be monitored, and to obtain the operating data of the device to be monitored from the backup database according to the monitoring instruction; The first determining unit includes: an identification module, used to identify the main database of the device to be monitored and determine the number of backup databases associated with the main database; a first determining module, used to determine the backup database as the backup database of the device to be monitored when the main database is associated with one backup database; and a first obtaining module, used to obtain the usage rate of each backup database when the main database is associated with multiple backup databases, and obtain the backup database with the lowest usage rate to obtain a target database, and determine the target database as the backup database of the device to be monitored. The processing unit is used to process the operating data according to the level of the device to be monitored, and obtain the processed target data. The processing unit includes: a first judgment module, used to judge whether there is abnormal data in the running data, and if there is abnormal data in the running data, to delete the abnormal data to obtain first data; a second judgment module, used to judge whether the level of the device to be monitored is the first level, and if the level of the device to be monitored is the first level, to obtain a preset format, and to convert the first data through the preset format to obtain the target data; a third judgment module, used to judge whether the level of the device to be monitored is the second level, and if the level of the device to be monitored is the second level, to obtain a preset format, and to convert the first data through the preset format to obtain second data, and to obtain the data processing flow associated with the device to be monitored, and to process the second data through the data processing flow to obtain the target data; The data information includes the number of data items. The data monitoring device further includes: a first acquisition unit, used to acquire the attribute information of the device to be monitored and determine a first score of the device to be monitored based on the attribute information; a third determination unit, used to determine a second score of the device to be monitored based on the number of data items; and a fourth determination unit, used to calculate the total score of the device to be monitored based on the first score and the second score, and determine the level of the device to be monitored based on the total score. The second determining unit is used to send the target data to the target monitoring device and determine the abnormality of the target data through the target monitoring device.

7. A computer storage medium, characterized in that, The computer storage medium is used to store a program, wherein the program, when running, controls the device where the computer storage medium is located to execute the data monitoring method according to any one of claims 1 to 4.

Images