Data Processing Method, Apparatus, Device, and Storage Medium

Abstract

The present application provides a data processing method, device, equipment and storage medium. The method includes: obtaining first alarm data received at a first time and second alarm data received at a second time; the first alarm data includes the alarm release time of the monitored object, and the second alarm data includes the alarm occurrence time of the monitored object; determining a target operation according to the first time, the second time, the alarm release time and the alarm occurrence time; the target operation is used to indicate deleting the second alarm data or storing the second alarm data; and performing the target operation on the second alarm data.

Description

Technical Field

[0001] This application relates to the field of monitoring technologies, and in particular, to a data processing method, apparatus, device, and storage medium. Background Art

[0002] The statistical analysis and visual display of alarm data can provide useful information for fault monitoring. Currently, data is obtained from a database for the statistical analysis or visual display of alarm data.

[0003] Alarm data includes active alarm data and cleared alarm data. The active alarm data is used to indicate that an alarm has occurred for a monitored object, and the cleared alarm data is used to indicate that the alarm for the monitored object has been lifted. A business monitoring system often sends multiple pieces of active alarm data and then sends one piece of cleared alarm data. Usually, the active alarm data arrives at the database before the cleared alarm data. To ensure the response speed of the database, the database will clean up some alarm data according to the reception time of the alarm data, that is, the database will clear the active alarm data that arrived before the cleared alarm data.

[0004] However, if the active alarm data arrives at the database later than the cleared alarm data, the active alarm data that arrives after the cleared alarm data will be recognized as new alarm data generated after the alarm has been lifted and used for statistical analysis and visual display at the front end. In this way, the active alarm data obtained at the front end will be inaccurate, resulting in problems with incorrect fault monitoring. Summary of the Invention

[0005] This application provides a data processing method, apparatus, device, and storage medium to solve the problem that if the active alarm data arrives at the database later than the cleared alarm data, the active alarm data that arrives after the cleared alarm data will be recognized as new alarm data generated after the alarm has been lifted and used for statistical analysis and visual display at the front end. In this way, the active alarm data obtained at the front end will be inaccurate, resulting in problems with incorrect fault monitoring.

[0006] In a first aspect, this application provides a data processing method, including: obtaining first alarm data received at a first time and second alarm data received at a second time; the first alarm data includes the alarm clearance time of a monitored object, and the second alarm data includes the alarm occurrence time of the monitored object; determining a target operation according to the first time, the second time, the alarm clearance time, and the alarm occurrence time; the target operation is used to indicate deleting the second alarm data or storing the second alarm data; performing the target operation on the second alarm data

[0007] In a second aspect, the present application provides a data processing device, comprising: an acquisition module, used to acquire first alarm data received at a first time and second alarm data received at a second time; the first alarm data includes the alarm release time of the monitored object, and the second alarm data includes the alarm occurrence time of the monitored object; a determination module, used to determine a target operation based on the first time, the second time, the alarm release time and the alarm occurrence time; the target operation is used to indicate deleting the second alarm data or storing the second alarm data; an execution module, used to execute the target operation on the second alarm data.

[0008] In a third aspect, the present application provides an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

[0009] The memory stores computer-executable instructions;

[0010] The processor executes the computer-executable instructions stored in the memory to implement the method according to the first aspect.

[0011] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method described in the first aspect.

[0012] The data processing method, device, equipment and storage medium provided by the present application obtain the first alarm data received at the first time and the second alarm data received at the second time, wherein the first alarm data includes the alarm release time of the monitored object, and the second alarm data includes the alarm occurrence time of the monitored object, and the target operation is determined according to the first time, the second time, the alarm release time and the alarm occurrence time; the target operation is used to indicate the deletion of the second alarm data or the storage of the second alarm data; and the target operation is performed on the second alarm data. Since the deletion of the second alarm data or the storage of the second alarm data is determined according to the first time, the second time, the alarm release time and the alarm occurrence time, the accuracy of clearing the alarm record can be improved. Furthermore, according to the alarm occurrence time and the alarm release time, all the first alarm data before the alarm release time of the same monitored object can be processed. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0014] Figure 1 The following is an architecture diagram of a data processing method in the prior art;

[0015] Figure 2It is an architecture diagram of the data processing system provided by the embodiments of the present application;

[0016] Figure 3 It is an architecture diagram of the data processing system provided by the embodiments of the present application;

[0017] Figure 4 It is the flow of the data processing method provided by the embodiments of the present application Figure 1 ;

[0018] Figure 5 It is the flow of the data processing method provided by the embodiments of the present application Figure 2 ;

[0019] Figure 6 It is the flow of the data processing method provided by the embodiments of the present application Figure 3 ;

[0020] Figure 7 It is another application scenario diagram provided by the embodiments of the present application;

[0021] Figure 8 It is based on the architecture diagram provided by the embodiments of the present application Figure 7 ;

[0022] Figure 9 It is a schematic structural diagram of the data processing device provided by the embodiments of the present application;

[0023] Figure 10 It is a schematic structural diagram of the electronic device provided by the embodiments of the present application.

[0024] Through the above-mentioned drawings, the specific embodiments of the present application have been shown, and there will be more detailed descriptions hereinafter. These drawings and textual descriptions are not intended to limit the scope of the concept of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. Detailed Description of the Embodiments

[0025] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0026] Figure 1 It is an architecture diagram of the data processing method in the prior art. As Figure 1 shown, the architecture includes: business system 10, business monitoring system 11, database 12, and terminal device 13;

[0027] The business monitoring system 11 can set multiple collection points in the business system 10 by means of embedding points, etc., and collect the operation data of the business system 10, and send the operation data of the business system 10 to the business monitoring system 11. The business monitoring system 11 determines whether the monitored object 10 is running normally through the business monitoring strategy. If it is judged that the operation is abnormal, it will send alarm data to the database 12. The database 12 stores the alarm data and records the reception time of each alarm data.

[0028] Furthermore, the user can obtain the alarm data from the database 12 through the terminal device 13 for report analysis, data query, etc. Afterwards, the alarm data is cleaned up according to the receiving time. Exemplarily, the database 12 receives the active alarm data a1, a2 and a3 at t1, t2 and t3 in sequence, and receives a clear alarm data c1 at t4, and receives an active alarm data a4 at t5. t1, t2, t3, t4 and t5 are in the time sequence from front to back, that is, t1 is earlier than t2, t2 is earlier than t3, t3 is earlier than t4, and t4 is earlier than t5. In addition, the active alarm data a1, a2, a3 and a4, and the clear alarm data c1 correspond to the data generation time, which are t'1, t'2, t'3, t'4 and t'5 in sequence, that is, the time when the business monitoring system 11 generates the active alarm data or clears the alarm data. If the data generation time of the above data is t'1, t'2, t'3, t'5 and t'4 in order from the beginning to the end, the active alarm data a4 will be identified as newly generated alarm data.

[0029] When performing statistical analysis and visualization on the front end, if the number of active alarm data at the current moment is required, one active alarm data will be obtained, but in fact there is no active alarm data at the current moment. This will cause the active alarm data obtained by the front end to be inaccurate, leading to fault monitoring errors.

[0030] In response to the above technical problems, the inventors of the present application proposed the following technical concept: when cleaning the active alarm data, the considerations of the alarm occurrence time of the active alarm data and the alarm release time of the cleared alarm data are added, that is, according to the reception time of the active alarm data, the alarm occurrence time of the active alarm data, the reception time of the cleared alarm data and the alarm release time of the cleared alarm data, determine whether the active alarm data needs to be cleaned, thereby avoiding the problem of misprocessing caused only by the reception time.

[0031] The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. The following several specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

[0032] Figure 2 It is an architecture diagram of the data processing system provided by the embodiment of the present application. As Figure 2 shown, the application scenario includes: a monitoring object 21, a service monitoring system 22, a data processing device 23, a first server 24, a second server 25, a first terminal device 26, and a second terminal device 27;

[0033] The monitoring object 21 may be a service system. The service monitoring system 22 may set multiple collection points in the service system through means such as data embedding, collect the operation data of the service system, and send the operation data of the service system to the service monitoring system 22. The service monitoring system 22 generates alarm data according to the service monitoring strategy and sends it to the data processing device 23;

[0034] A big data computing engine Flink is deployed in the data processing device 23. Flink can be applied to real-time computing in high-real-time scenarios and has characteristics such as supporting high throughput, low latency, and high performance.

[0035] The first server 24 is a data warehouse server, and a data warehouse is set in the first server 24. The data warehouse may be a Clickhouse data warehouse. Clickhouse is an on-line analytical processing (OLAP) database with a large-scale parallel processing architecture and is suitable for online analysis scenarios. In the data storage layer of the data processing system, Clickhouse is used to store alarm data, and the alarm data can also be divided into three layers, namely the operation data store (ODS), the data warehouse details (DWD), and the data warehouse service (DWS); among them, the operation data store is also called the data original layer, and the data warehouse service is also called the index summary layer. The ODS layer includes a first alarm data table and a second alarm data table. The DWD layer includes alarm detail tables of different network types such as wireless networks, transmission networks, and access networks. The DWS layer includes index summary tables such as base station disconnection and cell outage. The alarm detail tables and index summary tables provide data support for business report analysis, enabling the second terminal device to conveniently analyze alarm indicators and view alarm details through structured query language (SQL).

[0036] A memory database is set in the second server 25, and the memory database can be a Redis database.

[0037] The alarm data generated by the service monitoring system 22 is transmitted to the data processing device 23 through the Kafka message queue. After the data processing device 23 extracts (extract), transforms (transform), and loads (load) the alarm data through the data warehouse technology (Extract Transform Load, ETL), the first alarm data and the second alarm data are obtained.

[0038] Among them, the first terminal device 26 can be a large-screen device, and the second terminal device is a device with report analysis capabilities, such as a smart phone, a tablet computer, a desktop computer, a laptop computer, a server, etc.

[0039] Specifically, the data processing device 23 can send the first alarm data and the second alarm data to the first server 24, and the first server 24 stores the first alarm data and the second alarm data in the data warehouse. In addition, the data processing device 23 sends the first alarm data and the second alarm data to the second server 25, and the second server 25 stores the first alarm data and the second alarm data in the memory database.

[0040] Figure 3 This is the architecture diagram of the data processing system provided by the embodiment of the present application. As Figure 3 shown, the architecture includes a data source layer, a data warehouse technology (Extract-Transform-Load, ETL) layer, a data storage layer, and a data application layer;

[0041] Among them, the ETL layer is implemented through the big data computing engine Flink, and the big data computing engine Flink includes a data access (DataSource) module, a data processing (Transformation) module, and a data output (DataSink) module;

[0042] Among them, the DataSource module receives the original alarm data sent by Kafka in real time through the Kafka data connector. The original alarm data is in the format of a JavaScript Object Notation (JSON) string.

[0043] The Transformation module is used to parse the original alarm data. For example, it performs date format verification on keyword fields such as the alarm occurrence time and the alarm clearance time, and performs non-empty verification on the alarm unique identifier and the alarm status. The alarm status includes a first status and a second status. The first status is used to indicate that an alarm has occurred for the monitored object, and the second status is used to indicate that the alarm for the monitored object has been cleared. If the alarm status is the first status, the alarm data is determined as the first alarm data; if the alarm status is the second status, the alarm data is determined as the second alarm data.

[0044] The DataSink module defines database system connectors. It inserts the first alarm data into the first alarm data table in Clickhouse through the Clickhouse connector, and inserts the second alarm data into the second alarm data table in Clickhouse. Also, through the Redis connector, it inserts the first alarm data and the second alarm data into the third alarm data table in the Redis database.

[0045] Furthermore, the third alarm data table provides a data query function for the application corresponding to the first business application type. Exemplarily, the first terminal device 26 can send a data acquisition request to the second server 25 to obtain the first alarm data and / or the second alarm data from the third alarm data table, and the first terminal device 26 can use the first alarm data and / or the second alarm data for large-screen display.

[0046] The first server 24 can also generate an associated data table based on the first alarm data table and the second alarm data table, and store it in the data warehouse. The associated data table is used as a data source for the application corresponding to the second business application type, such as a report analysis application. Exemplarily, the second terminal device 27 can send a data acquisition request to the first server 24 to obtain the first alarm data and / or the second alarm data from the associated data table, and the second terminal device 27 can use the first alarm data and / or the second alarm data for data report analysis.

[0047] It should be understood that in some embodiments, the data warehouse and the in-memory database can also be set on the same server.

[0048] In some embodiments, the first server 24 can be configured to receive a report analysis request from the second terminal device 26, obtain the data source required for report analysis from the data warehouse, and send the data source to the second terminal device 26. And the second server 25 can be configured to receive a data query request from the first terminal device 26, obtain the data required for large-screen display from the second server 25, and send the data for large-screen display to the first terminal device 26.

[0049] Based on Figure 2The application scenario shown is Figure 4 The process of the data processing method provided in the embodiment of the present application Figure 1 .like Figure 4 As shown, the data processing method comprises the following steps:

[0050] S401, obtaining first alarm data received at a first time and second alarm data received at a second time; the first alarm data includes the alarm release time of the monitored object, and the second alarm data includes the alarm occurrence time of the monitored object.

[0051] The execution subject of this embodiment can be Figure 2 Specifically, the execution subject of step S401 may be the first server. Before step S401, the first server 24 may perform the following steps:

[0052] S400a1, receiving first alarm data at a first time, and receiving second alarm data at a second time; the first time and the second time are different times.

[0053] Specifically, the first server receives the first alarm data and the second alarm data sent by the data processing device.

[0054] S400a2. Store the first alarm data in a first alarm data table of the data warehouse, and store the second alarm data in a second alarm data table of the data warehouse.

[0055] The first alarm data table and the second alarm data table can be used to generate an associated data table, and the associated data table is used to provide a data source for an application corresponding to the second business application type. Based on step S400a2, the first server can also perform step S400a3: generate an associated data table based on the first alarm data table and the second alarm data table; and store the associated data table in the data warehouse.

[0056] In some embodiments, the first server may also generate a wireless network alarm data table, a transmission network alarm data table, or an access network alarm data table according to the first alarm data table and the second alarm data table.

[0057] Then in step S401, the first server obtains the first alarm data from the first alarm data table, and obtains the second alarm data from the second alarm data table.

[0058] The execution subject of step S401 may also be the second server. Then, before step S401, the second server may execute the following steps:

[0059] S400b1. Receive first alarm data at a first time, and receive second alarm data at a second time; the first time and the second time are different times.

[0060] Specifically, the second server receives the first alarm data and the second alarm data sent by the data processing device.

[0061] S400b2. Store the first alarm data and the second alarm data in the third alarm data table of the memory database.

[0062] Correspondingly, in step S401, the second server obtains the first alarm data and the second alarm data from the third alarm data table.

[0063] S402. Determine a target operation according to the first time, the second time, the alarm cancellation time, and the alarm occurrence time; the target operation is used to instruct to delete the second alarm data or store the second alarm data.

[0064] In some embodiments, the target operation is determined based on the first time, the second time, the alarm cancellation time and the alarm occurrence time, including: if the second server determines that the first time is after the second time and the alarm cancellation time is after the alarm occurrence time, then the target operation is determined to be storing the second alarm data.

[0065] In other embodiments, determining the target operation according to the first time, the second time, the alarm release time, and the alarm occurrence time includes:

[0066] a1. If the second server determines that the first time is before the second time and the alarm cancellation time is after the alarm occurrence time, the second server obtains the service application type corresponding to the first alarm data.

[0067] a2. The second server determines the target operation according to the business application type corresponding to the first alarm data.

[0068] Among them, step a2 includes: if the business application type corresponding to the first alarm data is the first business application type, then determining the target operation is to delete the second alarm data; if the business application type corresponding to the first alarm data is the second business application type, then determining the target operation is to set the state of the second alarm data to the first state, and the first state is used to indicate that the second alarm data is the alarm occurrence data of which the alarm has been cleared.

[0069] Optionally, the first business application type may be a data query application, such as a large-screen display application. Since the first business application type is data query, and data query is usually to query the first alarm data, the second alarm data may be directly deleted.

[0070] Optionally, the second service application type may be a data report analysis application. Since data report analysis applications usually require relatively detailed data, that is, both the first alarm data and the second alarm data are required, the second alarm data may be continued to be retained in the second alarm data table, but the status of the second alarm data may be set to the first status to indicate that the second alarm data is alarm occurrence data with the alarm lifted. For example, setting the status of the second alarm data to 0 indicates that the second alarm data is alarm occurrence data with the alarm lifted.

[0071] S403. Perform a target operation on the second alarm data.

[0072] Specifically, if the target operation determined in step S402 is to store the second alarm data, then correspondingly, S403 is to continue storing the second alarm data, that is, not to delete the second alarm data.

[0073] If the target operation determined in step S402 is to delete the second alarm data, then correspondingly, S403 is to delete the second alarm data.

[0074] If the target operation determined in step S402 is to set the status of the second alarm data to the first status, then correspondingly, S403 is to set the status of the second alarm data to the first status.

[0075] In this embodiment, by obtaining the first alarm data received at the first time and the second alarm data received at the second time, where the first alarm data includes the alarm lift time of the monitored object and the second alarm data includes the alarm occurrence time of the monitored object, determining a target operation according to the first time, the second time, the alarm lift time, and the alarm occurrence time; the target operation is used to indicate deleting the second alarm data or storing the second alarm data; and performing the target operation on the second alarm data. Since it is determined to delete or store the second alarm data according to the first time, the second time, the alarm lift time, and the alarm occurrence time, the accuracy of clearing alarm records can be improved. Further, according to the alarm occurrence time and the alarm lift time, all the first alarm data before the alarm lift time of the same monitored object can be reasonably processed.

[0076] Based on the above embodiment, Figure 5 is the flowchart of the data processing method provided by the embodiment of the present application Figure 2 . As Figure 5 shown, after generating an associated data table according to the first alarm data table and the second alarm data table, it further includes:

[0077] S501. Receive a data acquisition request sent by the terminal device through an application of the second service application type.

[0078] The terminal device in this embodiment may be a second terminal device.

[0079] S502. Obtain a data source from an associated data table according to a data acquisition request.

[0080] In this embodiment, the associated data table may be a detailed list of networks of different network types, such as a detailed list of wireless network alarms, a detailed list of transmission network alarms, or a detailed list of access network alarms.

[0081] S503. Send the data source to the terminal device.

[0082] The execution subject of this embodiment may be a first server, and the terminal device may be Figure 2 the second terminal device in. Exemplarily, if the second terminal device sends a request for acquiring wireless network alarm data to the first server through an application of a second service application type, such as a report analysis application, the first server acquires the alarm data of the wireless network from the detailed list of wireless network alarms and returns it to the second terminal device.

[0083] Based on the above method embodiment, Figure 6 is the flow of the data processing method provided by the embodiment of the present application Figure 3 . As Figure 6 shown, after storing the first alarm data and the second alarm data in the third alarm data table, it further includes:

[0084] S601. Receive a data query request sent by the terminal device through an application of a first service application type.

[0085] The terminal device in this embodiment may be a first terminal device.

[0086] S602. Obtain a data query result from the third alarm data table according to the data query request.

[0087] S603. Send the data query result to the terminal device.

[0088] The execution subject of this embodiment may be a second server, and the terminal device may be Figure 2 the first terminal device in. Exemplarily, if the first terminal device sends a request for acquiring wireless network alarm data to the second server through an application of a first service application type, such as a large screen display application, the second server acquires the first alarm data and / or the second alarm data from the third alarm data table and returns it to the first terminal device.

[0089] Based on the above embodiment, if Figure 4The execution subject of the embodiment shown is the first server, and the first server can also receive the first alarm data and the second alarm data sent by the data processing device, and store the first alarm data in the first alarm data table in the data warehouse, and store the second alarm data in the second alarm data table in the data warehouse. And send a control instruction, the first alarm data and the second alarm data to the second server to instruct the second server to receive the first alarm data and the second alarm data, and store the first alarm data and the second alarm data in the third alarm data table of the memory database. The first server can not only obtain the first alarm data and the second alarm data from the data warehouse, and determine the target operation according to the first time, the second time, the alarm release time and the alarm occurrence time, and perform the target operation on the second alarm data, but also obtain the first alarm data and the second alarm data from the second server, and determine the target operation according to the first time, the second time, the alarm release time and the alarm occurrence time, and perform the target operation on the second alarm data in the second server. Further, the first server can also perform the following method steps:

[0090] Step b1: receiving a data processing request sent by a terminal device, wherein the data processing request includes an identifier of a service application type.

[0091] Step b2: Determine the business application type in the data processing request according to the identifier of the business application type.

[0092] Exemplarily, the identifier of the first service application type may be preset to 0, and the identifier of the second service application type may be preset to 1. Then, the service application type may be determined to be the first service application type or the second service application type according to whether the identifier of the service application type is 1 or 0.

[0093] In some other examples, the identifier of the business application type may also be the name of the business application type, and then it may be determined whether the business application type is the first business application type or the second business application type according to the name of the business application type.

[0094] Step b3: If the business application type in the data processing request is the first business application type, then according to the data query request, obtain the data query result from the third alarm data table, and send the data query result to the terminal device.

[0095] Wherein, in step b3, according to the data query request, the data query result is obtained from the third alarm data table, and the data query result is sent to the terminal device. Figure 6 Description of the illustrated embodiment.

[0096] Step b4: If the business application type in the data processing request is the second business application type, then according to the data acquisition request, the data source is acquired from the associated data table, and the data source is sent to the terminal device.

[0097] Wherein, in step b4, according to the data acquisition request, the data source is acquired from the associated data table, and the data source is sent to the terminal device. Figure 5 Description of the illustrated embodiment.

[0098] Likewise, Figure 4 The execution subject of the illustrated embodiment may also be a second server, and the second server may receive the first alarm data and the second alarm data sent by the data processing device, and store the first alarm data and the second alarm data in the third alarm data table of the memory database. And send a control instruction, the first alarm data and the second alarm data to the second server to instruct the first server to receive the first alarm data and the second alarm data, and store the first alarm data in the first alarm data table in the data warehouse, and store the second alarm data in the second alarm data table in the data warehouse. Further, the second server can not only obtain the first alarm data and the second alarm data from the memory database, and determine the target operation according to the first time, the second time, the alarm release time and the alarm occurrence time, and perform the target operation on the second alarm data in the first server, but also obtain the first alarm data and the second alarm data from the first server, and determine the target operation according to the first time, the second time, the alarm release time and the alarm occurrence time, and perform the target operation on the second alarm data in the first server. Further, the second server can also execute Figure 8 Method steps b1 to b4.

[0099] Figure 7 Another application scenario diagram provided by the embodiment of the present application. Figure 7 As shown, in Figure 2 On the basis of, a control device 71 can be further added, and the control device 71 is connected to the first server, the second server and the data processing device respectively.

[0100] Figure 8 Based on the embodiments of the present application Figure 7 The architecture diagram of Figure 7 and Figure 8As shown, in some scenarios, the first terminal device can send a data query request through an application of the first business application type, and can also send a data acquisition request through an application of the second business application type. Similarly, the second terminal device can also send a data query request through an application of the first business application type, and send a data acquisition request through an application of the second business application type. Then, this embodiment can receive a request sent by the first terminal device or the second terminal device through a control device, and judge the received request to determine whether the request is a data acquisition request sent through an application of the second business application type or a data query request sent through an application of the first business application type.

[0101] And in Figure 7 Based on the application scenario, the data processing device 23 can also send the first alarm data and the second alarm data to the control device, and the control device stores the first alarm data and the second alarm data in the data warehouse, and stores the first alarm data and the second alarm data in the memory database.

[0102] In some embodiments, the function of the control device can also be integrated into the data processing device, that is, based on Figure 2 In the application scenario shown, the execution subject of the method is a data processing device, that is, the data processing device can read and write data in the data warehouse and the memory database.

[0103] Based on the above method embodiment, Figure 9 This is a schematic diagram of the structure of the data processing device provided in the embodiment of the present application. Figure 9 As shown, the data processing device includes: an acquisition module 91, a determination module 92 and an execution module 93; wherein the acquisition module 91 is used to acquire the first alarm data received at the first time and the second alarm data received at the second time; the first alarm data includes the alarm release time of the monitored object, and the second alarm data includes the alarm occurrence time of the monitored object; the determination module 92 is used to determine the target operation according to the first time, the second time, the alarm release time and the alarm occurrence time; the target operation is used to indicate deleting the second alarm data or storing the second alarm data; the execution module 93 is used to execute the target operation on the second alarm data.

[0104] In some embodiments, the determination module 92 determines the target operation based on the first time, the second time, the alarm cancellation time and the alarm occurrence time, including: if the first time is after the second time, and the alarm cancellation time is after the alarm occurrence time, then determining the target operation to store the second alarm data.

[0105] In some embodiments, the determination module 92 determines the target operation based on the first time, the second time, the alarm cancellation time and the alarm occurrence time, including: if the first time is before the second time and the alarm cancellation time is after the alarm occurrence time, then obtaining the business application type corresponding to the first alarm data; and determining the target operation based on the business application type corresponding to the first alarm data.

[0106] In some embodiments, the determination module 92 determines the target operation according to the business application type corresponding to the first alarm data, including: if the business application type corresponding to the first alarm data is the first business application type, determining the target operation is to delete the second alarm data.

[0107] In some embodiments, the determination module 92 determines whether to delete the second alarm data based on the business application type corresponding to the first alarm data, including: if the business application type corresponding to the first alarm data is the second business application type, then determining that the target operation is to set the state of the second alarm data to a first state, and the first state is used to indicate that the second alarm data is an alarm occurrence data for which the alarm has been cleared.

[0108] In some embodiments, the device also includes: a first receiving module 94, used to receive first alarm data at a first time, and to receive second alarm data at a second time; a storage module 95, used to store the first alarm data in a first alarm data table of a data warehouse, and to store the second alarm data in a second alarm data table of the data warehouse.

[0109] In some embodiments, the device also includes: a generation module 96, which generates an associated data table based on the first alarm data table and the second alarm data table, and the associated data table is used to provide a data source for the application corresponding to the second business application type; a storage module 95, which is also used to store the associated data table in a data warehouse.

[0110] In some embodiments, the device also includes: a second receiving module 97 and a sending module 98; the second receiving module 97 is also used to receive a data acquisition request sent by a terminal device through an application of the second business application type; the acquisition module 91 is also used to obtain the data source from the associated data table according to the data acquisition request; the sending module 98 is used to send the data source to the terminal device.

[0111] In some embodiments, the storage module 95 is further configured to store the first warning data and the second warning data into a third warning data table in the in-memory database; the third warning data table is used to provide data required for a data query request for an application corresponding to the first service application type.

[0112] In some embodiments, the apparatus further includes: the second receiving module 97 is further configured to receive a data query request sent by a terminal device through an application of the first service application type; the obtaining module 91 is further configured to obtain a data query result from the third warning data table according to the data query request; the sending module 98 is configured to send the data query result to the terminal device.

[0113] The data processing apparatus of this embodiment may be the control device in the above embodiment.

[0114] The data processing apparatus provided in the embodiments of the present application can be used to execute the technical solutions of the data processing method in the above embodiments, and its implementation principles and technical effects are similar, and will not be elaborated here.

[0115] It should be noted that it should be understood that the division of each module of the above apparatus is only a logical function division. In actual implementation, it can be fully or partially integrated into a physical entity, or physically separated. And these modules can all be implemented in the form of software called by a processing element; they can also all be implemented in hardware; they can also be partially implemented in the form of software called by a processing element and partially implemented in hardware. For example, the determination module 92 can be a separately established processing element, or can be integrated in a certain chip of the above apparatus. In addition, it can also be stored in the memory of the above apparatus in the form of program code, and called and executed by a certain processing element of the above apparatus to perform the functions of the above determination module 92. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together or can be independently implemented. Here, the processing element can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each of the above modules can be completed by the integrated logic circuit in the processor element or the instruction in the form of software.

[0116] Figure 10 It is a schematic structural diagram of an electronic device provided in the embodiments of the present application. As Figure 10 shown, the electronic device may include: a transceiver 101, a processor 102, and a memory 103.

[0117] The processor 102 executes the computer-executable instructions stored in the memory, enabling the processor 102 to execute the solutions in the above embodiments. The processor 102 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0118] The memory 103 is connected to the processor 102 through the system bus and completes the communication therebetween. The memory 103 is used to store computer program instructions.

[0119] The transceiver 101 can be used to receive data acquisition requests, return data sources, and return data query results.

[0120] The system bus can be a peripheral component interconnect (PCI) bus, an extended industry standard architecture (EISA) bus, etc. The system bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of simplicity, only a thick line is shown in the figure, but it does not mean that there is only one bus or one type of bus. The transceiver is used to implement the communication between the database access device and other computers (such as clients, read-write libraries, and read-only libraries). The memory may include a random access memory (RAM), and may also include a non-volatile memory.

[0121] The electronic device provided in the embodiments of the present application may be the control device in the above embodiments.

[0122] The embodiments of the present application also provide a chip for running instructions. The chip is used to execute the technical solutions of the data processing method in the above embodiments.

[0123] The embodiments of the present application also provide a computer-readable storage medium. Computer instructions are stored in the computer-readable storage medium. When the computer instructions are run on a computer, the computer is enabled to execute the technical solutions of the data processing method in the above embodiments.

[0124] The embodiments of the present application also provide a computer program product. The computer program product includes a computer program, which is stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium. When at least one processor executes the computer program, the technical solutions of the data processing method in the above embodiments can be implemented.

[0125] Other embodiments of the present application will be readily contemplated by those skilled in the art upon considering the specification and practicing the invention disclosed herein. The present application is intended to cover any variations, uses, or adaptations of the present application, which follow the general principles of the present application and include known common general knowledge or conventional technical means in the technical field not disclosed in the present application. The specification and examples are only regarded as exemplary, and the true scope and spirit of the present application are pointed out by the following claims.

[0126] It should be understood that the present application is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present application is only limited by the appended claims.

Claims

1. A data processing method, characterized in that, include: Acquire first alarm data received at a first time and second alarm data received at a second time; The first alarm data includes the alarm release time of the monitored object, and the second alarm data includes the alarm occurrence time of the monitored object; Determine a target operation according to the first time, the second time, the alarm release time and the alarm occurrence time; the target operation is used to indicate deleting the second alarm data or storing the second alarm data; performing the target operation on the second alarm data; The determining the target operation according to the first time, the second time, the alarm release time and the alarm occurrence time includes: If the first time is before the second time, and the alarm cancellation time is after the alarm occurrence time, obtaining the service application type corresponding to the first alarm data; If the business application type corresponding to the first alarm data is a first business application type, determining that the target operation is to delete the second alarm data; the first business application type is a data query application; If the business application type corresponding to the first alarm data is the second business application type, the target operation is determined to be setting the state of the second alarm data to the first state, and the first state is used to indicate that the second alarm data is the alarm occurrence data for which the alarm has been cleared; the second business application type is a data report analysis application.

2. The method according to claim 1, wherein The determining the target operation according to the first time, the second time, the alarm release time and the alarm occurrence time includes: If the first time is after the second time, and the alarm cancellation time is after the alarm occurrence time, then determining the target operation is to store the second alarm data.

3. The method according to claim 1, characterized in that, Before acquiring the first alarm data received at the first time and the second alarm data received at the second time, the method further includes: receiving first alarm data at a first time, and receiving second alarm data at a second time; The first alarm data is stored in a first alarm data table of a data warehouse, and the second alarm data is stored in a second alarm data table of the data warehouse.

4. The method according to claim 3, characterized in that, After storing the first alarm data in a first alarm data table and storing the second alarm data in a second alarm data table, the method further includes: Generate an associated data table according to the first alarm data table and the second alarm data table; the associated data table is used to provide a data source for an application corresponding to the second business application type; The associated data table is stored in the data warehouse.

5. The method according to claim 4, wherein After generating the associated data table according to the first alarm data table and the second alarm data table, the method further includes: Receiving a data acquisition request sent by a terminal device through an application of the second service application type; According to the data acquisition request, acquiring the data source from the associated data table; The data source is sent to the terminal device.

6. The method according to claim 1, characterized in that, Before acquiring the first alarm data received at the first time and the second alarm data received at the second time, the method further includes: The first alarm data and the second alarm data are stored in a third alarm data table of the memory database; the third alarm data table is used to provide data required for a data query request for an application corresponding to the first business application type.

7. The method according to claim 6, wherein After storing the first alarm data and the second alarm data in the third alarm data table, the method further includes: Receiving a data query request sent by a terminal device through an application of the first service application type; According to the data query request, obtaining a data query result from the third alarm data table; Send the data query result to the terminal device.

8. A data processing device, characterized in that, include: An acquisition module, used to acquire first alarm data received at a first time and second alarm data received at a second time; The first alarm data includes the alarm release time of the monitored object, and the second alarm data includes the alarm occurrence time of the monitored object; A determination module, configured to determine a target operation according to the first time, the second time, the alarm release time, and the alarm occurrence time; the target operation is used to indicate deleting the second alarm data or storing the second alarm data; An execution module, configured to execute the target operation on the second alarm data; The determination module is specifically configured to obtain the service application type corresponding to the first alarm data if the first time is before the second time and the alarm release time is after the alarm occurrence time; if the service application type corresponding to the first alarm data is the first service application type, determine that the target operation is to delete the second alarm data; The first business application type is a data query application; if the business application type corresponding to the first alarm data is a second business application type, determining that the target operation is to set the state of the second alarm data to a first state, the first state being used to indicate that the second alarm data is alarm occurrence data for which the alarm has been cleared; The second type of business application is data report analysis application.

9. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.

11. A computer program product, characterized in that, The invention comprises a computer program, which is used to implement the method according to any one of claims 1 to 7 when being executed by a processor.

Images