Monitoring operation and maintenance method, monitoring operation and maintenance system, edge computing equipment and storage medium

Abstract

The invention relates to a monitoring operation and maintenance method, a monitoring operation and maintenance system, edge computing equipment and a storage medium. According to the monitoring operation and maintenance method applied to the monitoring operation and maintenance system, the monitoring operation and maintenance system can comprise a server, a plurality of edge computing devices and a plurality of proxy devices, different edge computing devices are deployed in different regions, and at least one proxy device is deployed in each region. Therefore, each edge computing device can receive the first operation data collected by the proxy device deployed in the same region with the edge computing device, the received first operation data is sent to the server in real time, and the server stores the first operation data collected by each proxy device. Therefore, the purpose of realizing cross-regional operation and maintenance through the edge computing devices deployed in different regions is achieved.

Description

Technical Field

[0001] The present invention relates to the field of information technology, and in particular to a monitoring and operation and maintenance method, a monitoring and operation and maintenance system, an edge computing device and a storage medium. Background Art

[0002] Monitoring and operating business systems is the key to ensuring stable and efficient operation of the system. With the continuous development of business, the pressure and complexity faced by business systems are also increasing. Any performance bottleneck or failure may affect the user experience and the normal operation of the business, especially for cross-regional business systems, which may face more complex network delays, resource allocation and fault recovery challenges. Through monitoring and operation, the hardware resources, application performance, business indicators and other performance of the business system can be monitored in real time, so that potential problems can be discovered in time, and early warnings and processing can be carried out in advance to ensure the stability of the business system and reduce the risk of failure. Summary of the invention

[0003] The present invention provides a monitoring operation and maintenance method, a monitoring operation and maintenance system, an edge computing device and a storage medium to solve the deficiencies in the related art.

[0004] According to a first aspect of an embodiment of the present invention, a monitoring operation and maintenance method is provided, which is applied to a monitoring operation and maintenance system, wherein the monitoring operation and maintenance system includes a server, a plurality of edge computing devices, and a plurality of proxy devices, wherein different edge computing devices are deployed in different regions, and at least one proxy device is deployed in each region;

[0005] The method comprises:

[0006] The edge computing device receives first operation data collected by a proxy device deployed in the same region as the edge computing device;

[0007] The edge computing device sends the received first operation data to the server in real time, so that the server stores the first operation data collected by each proxy device.

[0008] According to a second aspect of an embodiment of the present invention, a monitoring and operation system is provided, the monitoring and operation system comprising a server, an edge computing device and an agent device, wherein one edge computing device and at least one agent device are deployed in each region; wherein:

[0009] The proxy device is used to collect first operation data generated during the operation of the business system, and upload the collected first operation data to an edge computing device deployed in the same region as the proxy device in real time;

[0010] The edge computing device is used to receive first operation data collected by a proxy device deployed in the same region as the edge computing device, and send the received first operation data to the server in real time;

[0011] The server is used to receive first operation data sent by the edge computing device, and store the first operation data received from the edge computing device through a first time series database.

[0012] According to a third aspect of an embodiment of the present invention, an edge computing device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the operations performed by the monitoring and operation method described in the first aspect above are implemented.

[0013] According to a fourth aspect of an embodiment of the present invention, a computer-readable storage medium is provided, on which a program is stored. When the program is executed by a processor, the operations performed by the monitoring and operation method described in the first aspect above are implemented.

[0014] According to a fifth aspect of an embodiment of the present invention, a computer program product is provided, wherein the computer program product includes a computer program, and when the computer program is executed by a processor, the operations performed by the monitoring and operation method described in the first aspect above are implemented.

[0015] According to the monitoring and operation method provided by an embodiment of the present invention, a monitoring and operation method applied to a monitoring and operation system is provided, wherein the monitoring and operation system may include a server, multiple edge computing devices and multiple proxy devices, different edge computing devices are deployed in different regions, and at least one proxy device is deployed in each region, so that each edge computing device can receive the first operation data collected by the proxy device deployed in the same region, thereby sending the received first operation data to the server in real time, and the server stores the first operation data collected by each proxy device, so as to achieve the purpose of cross-regional operation and maintenance through edge computing devices deployed in different regions.

[0016] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0018] Figure 1 It is a system architecture diagram of a monitoring operation and maintenance system according to an embodiment of the present invention.

[0019] Figure 2 The present invention is a flowchart of a monitoring operation and maintenance method according to an embodiment of the present invention.

[0020] Figure 3 The figure is a flowchart showing a data cleaning and processing process according to an embodiment of the present invention.

[0021] Figure 4 It is a schematic diagram showing a data timing situation according to an embodiment of the present invention.

[0022] Figure 5 The system block diagram of a monitoring operation and maintenance system according to an embodiment of the present invention is shown.

[0023] Figure 6 It is an interactive schematic diagram of a monitoring operation and maintenance method according to an embodiment of the present invention.

[0024] Figure 7 It is a schematic diagram of the structure of an edge computing device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0025] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0026] The present invention provides a monitoring operation and maintenance system, a monitoring operation and maintenance system, an edge computing device and a storage medium. Figure 1 , Figure 1 is a system architecture diagram of a monitoring operation and maintenance system according to an embodiment of the present invention. Figure 1 As shown in FIG, the monitoring and operation system includes three types of devices: a server, an edge computing device, and an agent. In each region, one edge computing device and at least one agent device can be deployed. Figure 1 As shown in FIG. 1 , each region from region 1 to region N is deployed with an edge computing device and multiple proxy devices. Figure 1 The system architecture shown realizes cross-regional monitoring and operation.

[0027] Optionally, the region may be a geographical area, or the region may be an Internet area, etc., but is not limited thereto.

[0028] Optionally, the geographical area may be an area divided based on geographical location, for example, a geographical area divided according to administrative area planning (such as a country, a city or a specific geographical boundary, etc.), a spatial area divided according to the function of each space in a building or certain large facilities (such as the spatial area division in large buildings such as office buildings, shopping centers, airports, etc., the spatial area division between different buildings in the same community, etc.), etc., but is not limited to this. The present invention does not limit the specific method of dividing the geographical area.

[0029] Optionally, the Internet area may be an area divided based on network structure, protocol or service distribution, for example, an Internet area divided according to the location of a data center, an Internet area divided according to the network coverage of an Internet service provider, an Internet area divided according to the distribution of computer rooms, etc., but not limited thereto.

[0030] Optionally, when dividing the regions, the location of each proxy device may be considered to ensure that the number of proxy devices deployed in each region is relatively balanced, thereby ensuring the data collection effect.

[0031] Optionally, the region is a geographical area, and the region to which the proxy device belongs can be determined according to the geographical area to which the proxy device's geographical location belongs; if the region is an Internet area, the region to which the proxy device belongs can be determined according to the network protocol, topology, data routing, service provider, etc. of the proxy device.

[0032] Optionally, after the area division is completed, proxy devices may be added or removed in the divided areas according to business needs to ensure that business needs can be met.

[0033] Optionally, an edge computing device may be deployed at the edge of each region, so as to provide services to various proxy devices deployed in the region through the edge computing device deployed at the edge of the region.

[0034] Optionally, the edge computing device may be an edge gateway, an edge server, a base station, etc., but is not limited thereto.

[0035] Optionally, the proxy device may be a load balancer, a gateway device, a dedicated hardware device deployed with a software agent having a data collection function, etc., but is not limited thereto.

[0036] Optionally, for Figure 1 The server in the system architecture shown and the edge server that can be used as an edge computing device can be one server, multiple servers, a server cluster, a cloud computing platform, etc., but are not limited to these.

[0037] Optionally, the edge computing device can communicate with the proxy device deployed in the area where it is located using wired or wireless communication methods, and the edge computing device and the server can communicate with each other using wired or wireless communication methods. For example, the edge computing device and the server can communicate through a dedicated network, or the edge computing device and the server can communicate through the Internet, but is not limited to this.

[0038] In some embodiments, the proxy device can be used to collect operation data generated by the business system during operation, and then upload the collected operation data as first operation data to an edge computing device deployed in the same region as the proxy device.

[0039] In some embodiments, the edge computing device can be used to receive first operation data collected by a proxy device deployed in the same area as the edge computing device, and send the received first operation data to the server in real time.

[0040] In some embodiments, the server can be used to receive first operating data sent by the edge computing device, and store the first operating data received from the edge computing device through a first time series database.

[0041] Through the monitoring and operation and maintenance system provided by the present invention, the first operation data collected by the proxy device deployed in the region can be collected and forwarded through edge computing devices deployed in different regions, so as to realize cross-regional system monitoring and operation and maintenance.

[0042] In some embodiments, the edge computing device may also be used to clean and process the first operation data received in the current processing cycle when the current time meets the preset processing cycle, obtain the second operation data, and send the second operation data to the server. Then, in some embodiments, the server may also modify or overwrite the corresponding first operation data stored in the first time series database based on the second operation data.

[0043] It should be noted that in some cases, there may be network restrictions between the edge computing device and the server. For example, when performing data transmission across the Internet, there may be network restrictions between the edge computing device and the server, which may lead to data transmission errors. The edge computing device performs data cleaning and processing on the first operation data received in the current processing cycle every preset processing cycle, so that the edge computing device can provide data fault tolerance, so as to ensure the accuracy of the data through the data fault tolerance provided by the edge computing device, thereby ensuring the accuracy of the operation data finally stored at the server.

[0044] Optionally, the preset processing cycle can be pre-configured according to business requirements, and different processing cycles can be configured for different types of businesses. For example, for businesses with high real-time requirements or more frequent monitoring, the processing cycle can be configured to a smaller cycle value, and for businesses with low real-time requirements or that can be monitored at longer intervals, the processing cycle can be configured to a larger cycle value. The present invention is not limited to this.

[0045] Optionally, different preset processing cycles can be deployed for different regions, and the edge computing device can perform data cleaning and processing every preset processing cycle according to the preset processing cycle corresponding to the region to which it belongs.

[0046] Optionally, for any edge computing device, it can maintain a timer, so as to monitor the time of data cleaning and processing through the timer. Optionally, the timing duration of the timer is the preset processing cycle. The edge computing device can reset the timer (i.e., restore the timing duration of the timer to the preset processing cycle) after each data cleaning and processing is completed, so as to start the countdown according to the timing duration of the timer. At the end of the countdown, it can be determined that the next data cleaning and processing is required.

[0047] In some embodiments, the edge computing device can use the second time series data to implement the storage of the first operating data. Then, in some embodiments, the edge computing device can generate marking information based on the first operating data that has completed data cleaning and processing after each completion of data cleaning and processing. The marking information is used to indicate the storage location of the first operating data that has completed data cleaning and processing in the second time series database.

[0048] It should be noted that the edge computing device generates tag information so that the edge computing device can determine the data processing location through the generated tag information, so that when the data is cleaned and processed next time, it can directly continue to process the unprocessed data from the location indicated by the tag information based on the recorded tag information, thereby ensuring the continuity and integrity of the data processing process.

[0049] In some embodiments, the monitoring and operation system may further include a terminal device. Optionally, the terminal device may be a user device deployed on the user side, such as a desktop computer, a portable computer, a laptop computer, a tablet computer, a smart phone, a smart watch, etc., but is not limited thereto. In more possible implementations, an agent device may also be considered as a terminal device, etc., and the present invention does not limit this.

[0050] In some embodiments, the terminal device may send a query request to the server based on the query operation of the user. For example, the user may control the terminal device to initiate a query request to the server through the World Wide Web (web) service, but is not limited thereto.

[0051] In some embodiments, the server may also be used to, in response to the query request, obtain first operation data corresponding to the query request from the first time series database, and return the first operation data corresponding to the query request to the terminal device. The first operation data corresponding to the query request may include first operation data that has been cleaned and processed and / or first operation data that has not been cleaned and processed.

[0052] In some embodiments, the terminal device may also be used to receive the first operating data returned by the server, and perform visual display based on the received first operating data.

[0053] Through the above embodiments, users can be provided with query and visualization functions of operation data so that users can understand the operation status of the business system, thereby timely discovering potential problems, and making early warnings and processing to ensure the stability of the business system and reduce the risk of failure.

[0054] Optionally, the monitoring and operation and maintenance system provided in the above embodiment can be implemented in a public cloud environment, in a private cloud environment, or in a hybrid cloud environment (i.e., a hybrid environment of public cloud and private cloud), and the present invention is not limited to this.

[0055] It should be noted that the above embodiment only briefly introduces the functions of each subject in the monitoring and operation and maintenance system. The monitoring and operation method based on the above monitoring and operation system is introduced below. In the process of introducing the monitoring and operation method, the functions of each subject in the monitoring and operation system will be introduced, and in the following embodiments, the optional implementation methods of various functions will be introduced in detail.

[0056] See also Figure 2 , Figure 2 1 is a flowchart of a monitoring and operation method according to an embodiment of the present invention, which can be applied to a monitoring and operation system including a server, multiple edge computing devices and multiple proxy devices, wherein different edge computing devices are deployed in different regions, and at least one proxy device is deployed in each region. Figure 2 As shown, the method may include the following steps:

[0057] Step 201: An edge computing device receives first operation data collected by a proxy device deployed in the same region as the edge computing device.

[0058] In some embodiments, the proxy device can collect the first operation data generated during the operation of the business system in real time, and transmit the first operation data to the edge computing device in the region to which it belongs in real time; the edge computing device can receive the first operation data transmitted in real time by the proxy device deployed in the same region.

[0059] Optionally, the proxy device can forward the collected data to the edge computing device in real time after collecting the first operation data, so the proxy device does not need to store the collected first operation data. In more possible implementations, a local time series database can also be deployed for the proxy device, so that the proxy device can store the collected first operation data through the locally deployed time series database for subsequent tracing.

[0060] Optionally, the time series database may be a database for storing, querying and analyzing data arranged in time sequence (i.e., time series data). In the time series database, the stored data may be arranged in time sequence according to the data timestamp, and the data timestamp may be used to indicate the data collection time, but is not limited thereto, and may also be used to indicate the data sending time, etc.

[0061] Optionally, the local time series database deployed for the proxy device may be Prometheus, but is not limited thereto.

[0062] Optionally, the first operating data may include system health monitoring data, application performance monitoring data, log monitoring data, dependent service monitoring data and other performance data generated during the system operation, but is not limited to this. The first operating data may also include business data generated during the operation of the business system, etc. The present invention does not limit the data type of the first operating data.

[0063] Among them, system health monitoring data may include central processing unit (CPU) usage, memory usage, disk usage, etc., but not limited to this. Application performance monitoring data may include response time, throughput, transaction success rate, etc., but not limited to this. Log monitoring data may include application log monitoring data, security log monitoring data, access log monitoring data, etc., but not limited to this. Dependent service monitoring data may include external application programming interface (Application Programming Interface, API) call data, message queue performance data, etc., but not limited to this.

[0064] Step 202: The edge computing device sends the received first operation data to the server in real time, so that the server stores the first operation data collected by each proxy device.

[0065] In some embodiments, the edge computing device can forward the received first operating data in real time to send the received first operating data to the server in real time; the server can receive the first operating data sent by the edge computing device in real time, thereby storing the received first operating data.

[0066] In some embodiments, the server may store the first operating data via a first time series database.

[0067] Optionally, the first time series database may be a local time series database of the server, so that the server can store, query and analyze data.

[0068] Optionally, the first time series database may be a database for storing, querying, and analyzing data arranged in chronological order (i.e., time series data). In the first time series database, the stored data may be arranged in chronological order according to the data timestamp, and the data timestamp may be used to indicate the data collection time, but is not limited thereto, and may also be used to indicate the data sending time or receiving time, etc.

[0069] Optionally, the first time series database may be Prometheus, but is not limited thereto.

[0070] Through the above embodiments, the real-time collection and uploading of the first operation data can be realized through the proxy device, and the edge computing device can forward the first operation data uploaded by the proxy device in real time to the server in real time. The server can store the received data for query, so that the collection and storage of multi-regional operation data can be realized through the real-time data flow, so as to realize cross-regional monitoring and operation and maintenance.

[0071] In some embodiments, when the edge computing device receives the first operation data uploaded in real time by the proxy device in the region to which it belongs, in addition to transmitting the first operation data to the server in real time, it can also store the received first operation data.

[0072] In some embodiments, the edge computing device may store the second operating data through a second time series database.

[0073] Optionally, the second time series database may be a local time series database of the edge computing device, so that the edge computing device can store, query and analyze data.

[0074] Optionally, the second time series database may be a database for storing, querying, and analyzing data arranged in chronological order (i.e., time series data). In the second time series database, the stored data may be arranged in chronological order according to the data timestamp, and the data timestamp may be used to indicate the data collection time, but is not limited thereto, and may also be used to indicate the data sending time or receiving time, etc.

[0075] Optionally, the first time series database and the second time series database may be time series databases of the same type, that is, the second time series database may also be Prometheus, but not limited thereto, the first time series database and the second time series database may also be time series databases of different types.

[0076] Optionally, the edge computing device can also provide data fault tolerance. In some embodiments, the edge computing device can perform data cleaning and processing every preset processing cycle, thereby uploading the cleaned and processed operating data to the server to modify or overwrite the first operating data stored in the server.

[0077] In some embodiments, when the current time satisfies a preset processing cycle, the edge computing device can clean and process the first operating data received in the current processing cycle to obtain second operating data, and then send the second operating data to the server so that the server can modify or overwrite the corresponding first operating data stored based on the second operating data.

[0078] In some embodiments, when the edge computing device performs data cleaning and processing on the first operation data received in the current processing cycle, it can be implemented by the following steps:

[0079] Step 1: Based on a pre-configured filtering algorithm, the first operation data received in the current processing cycle is filtered to obtain the operation data to be processed.

[0080] In one possible implementation, at least one target filtering algorithm can be determined from multiple pre-configured filtering algorithms based on the data type of the first operating data received in the current processing cycle, so that the first operating data received in the current processing cycle can be filtered based on the at least one target filtering algorithm.

[0081] Optionally, the preconfigured filtering algorithm may refer to a code precompiled into the edge computing device for implementing data cleaning, but is not limited thereto. Optionally, the filtering algorithm may be precompiled into the firmware, chip or other dedicated hardware of the edge computing device, or the filtering algorithm may be preinstalled in the operating system of the edge computing device in the form of a service, etc., but is not limited thereto.

[0082] Optionally, when data cleaning is needed, the edge computing device can call a filtering algorithm that is pre-compiled into firmware, chips, or other dedicated hardware, or pre-installed into an operating system, to clean the data by running the filtering algorithm.

[0083] It should be noted that, for the pre-configured multiple filtering algorithms, each filtering algorithm may include a series of filtering parameters for performing data screening in the first operation data. Different filtering algorithms may include different filtering parameters, thereby ensuring that when data screening is implemented through different filtering algorithms, different data can be obtained through screening through different filtering algorithms, that is, different operation data to be processed obtained through processing by different filtering algorithms are different.

[0084] In addition, it should be noted that, generally speaking, the processing processes of different filtering algorithms will not affect each other, so multiple filtering algorithms can be run in parallel, but not limited to this, and multiple filtering algorithms can also be run in serial to achieve step-by-step filtering of data.

[0085] Optionally, the pre-configured multiple filtering algorithms may be added, modified or deleted as needed, etc., which is not limited in the present invention.

[0086] Step 2: Based on a pre-configured processing algorithm, the operation data to be processed is processed to obtain processed operation data.

[0087] In a possible implementation, at least one target processing algorithm may be determined from a plurality of preconfigured processing algorithms based on the data type of the operating data to be processed, so that the operating data to be processed may be processed based on the at least one target processing algorithm.

[0088] Optionally, the preconfigured processing algorithm may refer to a code precompiled into the edge computing device for implementing data processing, but is not limited thereto. Optionally, the processing algorithm may be precompiled into the firmware, chip or other dedicated hardware of the edge computing device, or the processing algorithm may be preinstalled in the operating system of the edge computing device in the form of a service, etc., but is not limited thereto.

[0089] Optionally, when data processing is needed, the edge computing device can call a processing algorithm that is pre-compiled into firmware, chips, or other dedicated hardware, or pre-installed into an operating system, to process the data by running the processing algorithm.

[0090] It should be noted that, for the pre-configured multiple processing algorithms, each processing algorithm can be a code compiled according to the corresponding processing rules, so that the processing of the input data can be realized through the processing rules corresponding to each processing algorithm. Optionally, the input data corresponding to different processing algorithms can be different or the same. It should be emphasized that for multiple processing algorithms with the same input data, their processing rules are different, so that even if the processing is based on the same input data, different output data (that is, the running data after the processing is completed) can be obtained through different calculation processing methods.

[0091] In addition, it should be noted that, generally speaking, the processing processes of different processing algorithms will not affect each other, so multiple processing algorithms can be run in parallel, but not limited to this, and multiple processing algorithms can also be run in serial to achieve step-by-step processing of data.

[0092] Optionally, the pre-configured multiple processing algorithms may be added, modified or deleted as needed, etc., which is not limited in the present invention.

[0093] Step 3: convert the format of the processed operation data to obtain second operation data.

[0094] In a possible implementation, the processed operation data is format converted according to the storage format required by the first time series database used by the server to ensure that the format of the second operation data finally obtained meets the storage format requirements of the first time series database.

[0095] It should be noted that, in the first time series database, data is stored in a specific format, and different data can be stored in different format types (ie, storage formats).

[0096] Taking Prometheus as the first time series database as an example, in Prometheus, data is stored and exposed in a specific format. Generally speaking, the main data format types of Prometheus are counter, gauge, histogram and summary. Among them, the counter type indicator can be used to represent a monotonically increasing value, usually used to represent the number of occurrences of an event, such as the number of Hypertext Transfer Protocol (HTTP) requests, the number of errors, etc.; the gauge type indicator can be used to represent a value that can increase or decrease, usually used to represent the current state, such as the current temperature, memory usage, the current number of active connections, etc.; the histogram type indicator can be used to record the distribution of values, such as response time distribution, request size distribution, etc.; the summary type indicator can be used to record the statistical information of a specific value (such as response time), such as the total count, sum, quantile, etc.

[0097] It should be noted that although different types of Prometheus indicators all use the time series format to store data, their data storage formats are different. Therefore, you can consider converting the format of the processed running data according to the storage format required by different types of Prometheus indicators to ensure that the final second running data meets the data storage format requirements of Prometheus.

[0098] In addition, it should be noted that the above-mentioned format conversion process can also be called a data adaptation process, and the format conversion of the operating data can be implemented through an adapter to obtain second operating data that is adapted to the storage format required by the first time series database.

[0099] In some embodiments, after receiving the second operation data, the server may modify or overwrite the corresponding first operation data stored in the first time series database based on the second operation data. It should be noted that the corresponding first operation data stored in the first time series database may be data collected at the same time as the second operation data sent this time.

[0100] See also Figure 3 , Figure 3 FIG. 1 is a flow chart showing a data cleaning and processing process according to an embodiment of the present invention. Figure 3As shown, for the first operating data stored in the second time series database, it can be filtered by a filter. For example, it can be processed by a plurality of filtering algorithms such as algorithm A, algorithm B, algorithm C and newly added algorithms pre-configured in the filter, so that the output is used as the input of the processor; the input can be processed in some relatively simple ways by the processor. For example, the input can be processed in parallel by the pre-configured processing program A, processing program B and newly added processing program in the processor, so that the output is used as the input of the adapter; taking the first time series database as Prometheus as an example, the data format conversion can be realized according to the four format types of Counter, Gauge, Histogram and Summary required by Prometheus, so that the final output can be used as the second operating data to be sent to the server.

[0101] Through the above embodiments, batch processing of data can be achieved to filter out some useless data or data that contributes little to the monitoring and operation process in advance, so that the server does not need to store these useless data or data that contributes little to the monitoring and operation process, thereby reducing the storage pressure of the server. In addition, processing processes such as calculation processes with small computational workloads and format conversion processes can be transferred to edge computing devices to reduce the processing pressure of the server and increase the processing speed of the server.

[0102] It should be noted that the second operating data is obtained by cleaning and processing the first operating data. Therefore, compared with the first operating data, the second operating data may include fewer data types. For example, some useless data in the first operating data may be cleaned out through data cleaning. Alternatively, the second operating data may include more data types. For example, some new operating data may be calculated through data processing. Alternatively, the data types included in the second operating data may be consistent with the data types included in the first operating data.

[0103] In some embodiments, after completing the above-mentioned data cleaning and processing process, the edge computing device can also generate marking information based on the first running data that has completed data cleaning and processing. The marking information can be used to indicate the storage location of the first running data that has completed data cleaning and processing in the second time series database.

[0104] Optionally, the generation of the marking information may be achieved by marking an offset, and the marking position of the offset may be the storage position of the end position of the first running data that has completed data cleaning and processing in the second time series database.

[0105] It should be noted that each edge computing device in the monitoring and operation system can provide data fault tolerance, but for any edge computing device, not all first operation data sent by the proxy device to the edge computing device need to be cleaned and processed. Optionally, relevant technical personnel can configure different business systems according to business needs to configure whether to enable the fault tolerance function for the business system. For business systems configured to enable the fault tolerance function, the edge computing device can clean and process the first operation data collected therefrom, while for business systems that do not enable the fault tolerance function, the edge computing device does not need to clean and process the first operation data collected therefrom. Therefore, for the first operation data stored in the first time series database of the server, all of them can be first operation data that have not been cleaned and processed, or all of them can be first operation data that have been cleaned and processed, or they can include both first operation data that have been cleaned and processed and first operation data that have not been cleaned and processed.

[0106] In some embodiments, a user may initiate a query request through a terminal device, and the terminal device may send a query request to a server to request viewing of relevant operating data of a business system.

[0107] Optionally, the terminal device may send a query request to the server via a web service, but is not limited thereto.

[0108] In some embodiments, in response to receiving a query request sent by a terminal device, the server may obtain first operating data corresponding to the query request from a first time series database, and return the first operating data corresponding to the query request to the terminal device that sent the query request.

[0109] Optionally, for a business system that does not enable the data fault tolerance function, the first operating data acquired by the server is the first operating data that has not been cleaned and processed.

[0110] Optionally, for a business system with data fault tolerance enabled, if data cleaning and processing for the time zone to be queried by the query request have been completed, the first operating data obtained by the server is the first operating data that has been cleaned and processed; if data cleaning and processing for the time zone to be queried by the query request have not been completed, the server may query a portion of the data from the time zone where data cleaning and processing have been completed, and query another portion of the data from the time zone where data cleaning and processing have not been completed, so as to obtain all the operating data to be queried. At this time, the first operating data obtained by the server includes both the first operating data that has been cleaned and processed, and the first operating data that has not been cleaned and processed.

[0111] In some embodiments, the terminal device may receive the first operating data returned by the server based on the query request, and perform a visual display based on the received first operating data.

[0112] It should be noted that the above embodiment mainly introduces the query process for operating data. In more possible implementation methods, the query request may also involve some persistent data, such as configuration data, etc. For these persistent data, the server can store them through a relational database. Therefore, when the server obtains the data corresponding to the query request, in addition to obtaining the first operating data corresponding to the query request from the first time series database, it may also obtain the persistent data corresponding to the query request from the relational database, thereby returning these two parts of data together to the terminal device.

[0113] See also Figure 4 , Figure 4 is a schematic diagram showing a data timing situation according to an embodiment of the present invention, such as Figure 4 As shown, the proxy device collects real-time data, the first operating data stored in the second time series database of the edge computing device is synchronized with the data collection time of the proxy device, and the data stored in the first time series database of the server may include both the part that has been covered by the second time series database and the part that has not yet been covered by the second operating data.

[0114] In some embodiments, the terminal device may receive the first operating data and the persistent data returned by the server based on the query request, and perform a visual display based on the received first operating data and the persistent data.

[0115] It should be noted that the present invention does not limit the method of visual display of data. It can adopt various visual display methods such as time series graphs, pie charts, bar charts, heat maps, dashboards, stacked graphs, scatter plots, indicator tables, etc., but is not limited to this. The visual display of data can also be achieved in a user-defined manner, and the present invention does not limit this.

[0116] See also Figure 5 , Figure 5 is a system block diagram of a monitoring operation and maintenance system according to an embodiment of the present invention. Figure 5As shown, an edge computing device and multiple proxy devices can be deployed in computer room 1, an edge computing device and multiple proxy devices can be deployed in computer room 2, and a server can be deployed in computer room 1. Optionally, the proxy device in computer room 1 can communicate unidirectionally with the edge computing device in computer room 1, and the edge computing device in computer room 1 can implement data storage through local Prometheus; the proxy device in computer room 2 can communicate unidirectionally with the edge computing device in computer room 2, and the edge computing device in computer room 2 can implement data storage through local Prometheus; the edge computing device in computer room 1 can communicate bidirectionally with the server through a dedicated network line, and the edge computing device in computer room 2 can communicate bidirectionally with the server through the Internet, and the server can implement data storage through local Prometheus, and the server can provide a web server to meet the query requirements of the front end.

[0117] The following takes the interaction between an edge computing device and a proxy device within a region, and the interaction between the edge computing device and a server as an example to further illustrate the monitoring and operation method provided by the present invention.

[0118] See also Figure 6 , Figure 6 is an interactive schematic diagram of a monitoring operation and maintenance method according to an embodiment of the present invention, such as Figure 6 As shown, the method may include the following steps:

[0119] Step 601, the proxy device collects data and uploads the data to the edge computing device in real time;

[0120] Step 602: The edge computing device stores the real-time data in a second time series database and sends the data to the server in real time;

[0121] Step 603, the server stores the real-time data in the first time series database;

[0122] Step 604: The edge computing device cleans and processes the data in the current processing cycle stored in the second time series database every preset processing cycle;

[0123] Step 605, the edge computing device sends the cleaned and processed data to the server;

[0124] Step 606: The server modifies or overwrites the data stored in the first time series database based on the cleaned and processed data.

[0125] It should be noted that the above embodiment only briefly introduces the process of data collection, uploading and storage. The optional implementation methods of each process can be found in the previous text and will not be repeated here. In addition, the introduction of more subsequent processes can also be found in the previous text and will not be repeated here.

[0126] The present invention also provides an edge computing device, see Figure 7 , Figure 7 is a schematic diagram of the structure of an edge computing device according to an embodiment of the present invention. Figure 7 As shown, the edge computing device includes a processor 710, a memory 720 and a network interface 730. The memory 720 is used to store computer instructions that can be run on the processor 710. The processor 710 is used to implement the monitoring operation and maintenance method provided by any embodiment of the present invention when executing the computer instructions. The network interface 730 is used to implement input and output functions. In more possible implementations, the edge computing device may also include other hardware, which is not limited by the present invention.

[0127] The present invention also provides a computer-readable storage medium, which can be in various forms. For example, in different examples, the computer-readable storage medium can be: RAM (Random Access Memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard disk drive), solid state drive, any type of storage disk (such as optical disk, DVD, etc.), or similar storage medium, or a combination thereof. In particular, the computer-readable medium can also be paper or other suitable medium capable of printing programs. A computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the monitoring and operation method provided by any embodiment of the present invention is implemented.

[0128] The present invention also provides a computer program product, including a computer program, which implements the monitoring and operation method provided by any embodiment of the present invention when the computer program is executed by a processor.

[0129] It should be understood by those skilled in the art that one or more embodiments of the present specification may be provided as methods, devices, electronic products, computer-readable storage media, or computer program products. Therefore, one or more embodiments of the present specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, one or more embodiments of the present specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0130] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the embodiment corresponding to the computing device, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0131] The above specific embodiments of this specification are described. Other embodiments are within the scope of the present invention. In some cases, the actions or steps recorded in the present invention can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the process depicted in the accompanying drawings does not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0132] The embodiments of the subject matter and functional operations described in this specification may be implemented in the following: digital electronic circuits, tangibly embodied computer software or firmware, computer hardware including the structures disclosed in this specification and their structural equivalents, or a combination of one or more of them. The embodiments of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on a tangible non-temporary program carrier to be executed by a display device of the product specification or to control the operation of a display device of the product specification. Alternatively or additionally, the program instructions may be encoded on an artificially generated propagation signal, such as a machine-generated electrical, optical or electromagnetic signal, which is generated to encode information and transmit it to a suitable receiver device for execution by a display device of the product specification. The computer storage medium may be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of one or more of them.

[0133] The processes and logic flows described in this specification can be performed by one or more programmable computers executing one or more computer programs to perform corresponding functions by operating on input data and generating output. The processes and logic flows can also be performed by special purpose logic circuits, such as FPGAs (field programmable gate arrays) or ASICs (application-specific integrated circuits), and the apparatus can also be implemented as special purpose logic circuits.

[0134] Computers suitable for executing computer programs include, for example, general and / or special microprocessors, or any other type of central processing unit. Typically, the central processing unit will receive instructions and data from a read-only memory and / or a random access memory. The basic components of a computer include a central processing unit for implementing or executing instructions and one or more memory devices for storing instructions and data. Typically, the computer will also include one or more large-capacity storage devices for storing data, such as magnetic disks, magneto-optical disks, or optical disks, or the computer will be operably coupled to this large-capacity storage device to receive data from it or to transmit data to it, or both. However, the computer does not necessarily have such a device. In addition, the computer can be embedded in another device, such as a mobile phone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or a portable storage device such as a universal serial bus (USB) flash drive, to name a few.

[0135] Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including, for example, semiconductor memory devices (e.g., EPROM, EEPROM and flash memory devices), magnetic disks (e.g., internal hard disks or removable disks), magneto-optical disks, and CD ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuitry.

[0136] Although this specification includes many specific implementation details, these should not be interpreted as limiting the scope of any invention or the scope of protection claimed, but are mainly used to describe the features of the specific embodiments of specific inventions. Certain features described in multiple embodiments in this specification may also be implemented in combination in a single embodiment. On the other hand, the various features described in a single embodiment may also be implemented separately in multiple embodiments or in any suitable sub-combination. In addition, although features may work in certain combinations as described above and even initially claim protection, one or more features from the claimed combination may be removed from the combination in some cases, and the claimed combination may point to a sub-combination or a variation of a sub-combination.

[0137] Similarly, although operations are depicted in a particular order in the accompanying drawings, this should not be understood as requiring that these operations be performed in the particular order shown or performed sequentially, or requiring that all illustrated operations be performed to achieve the desired results. In some cases, multitasking and parallel processing may be advantageous. In addition, the separation of various system modules and components in the above-described embodiments should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product, or packaged into multiple software products.

[0138] Thus, specific embodiments of the subject matter have been described. Other embodiments are within the scope of the present invention. In some cases, the actions described in the present invention can be performed in a different order and still achieve the desired results. In addition, the processing depicted in the drawings does not necessarily require the specific order or sequential order shown to achieve the desired results. In some implementations, multitasking and parallel processing may be advantageous.

[0139] Those skilled in the art will readily appreciate other embodiments of the present specification after considering the specification and practicing the invention claimed herein. The present specification is intended to cover any variations, uses or adaptations of the present specification that follow the general principles of the present specification and include common knowledge or customary techniques in the art that are not claimed in the present specification. That is, the present specification is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes may be made without departing from the scope thereof.

[0140] The above description is only an optional embodiment of this specification and is not intended to limit this specification. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of this specification should be included in the scope of protection of this specification.

[0141] In the present invention, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance. The term "plurality" refers to two or more than two, unless otherwise clearly defined.

[0142] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the disclosure disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. The description and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0143] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A monitoring operation and maintenance method, applied to a monitoring operation and maintenance system, characterized in that: The monitoring and operation system includes a server, multiple edge computing devices and multiple proxy devices, wherein different edge computing devices are deployed in different regions, and at least one proxy device is deployed in each region; The method comprises: The edge computing device receives first operation data collected by a proxy device deployed in the same region as the edge computing device; The edge computing device sends the received first operation data to the server in real time, so that the server stores the first operation data collected by each proxy device.

2. The method according to claim 1, characterized in that After the edge computing device receives the first operation data collected by the proxy device deployed in the same region as the edge computing device, the method further includes: storing the received first operation data; When the current time meets the preset processing cycle, the first operation data received in the current processing cycle is cleaned and processed to obtain second operation data; The second operating data is sent to the server so that the server modifies or overwrites the stored corresponding first operating data based on the second operating data.

3. The method according to claim 2, characterized in that When the edge computing device performs data cleaning and processing on the first operation data received in the current processing cycle, the method includes: Based on a pre-configured filtering algorithm, filtering the first operation data received in the current processing cycle to obtain the operation data to be processed; Based on a pre-configured processing algorithm, the operation data to be processed is processed to obtain processed operation data; The format of the processed operation data is converted to obtain the second operation data.

4. The method according to claim 3, characterized in that The filtering of the first operation data received in the current processing cycle based on the pre-configured filtering algorithm includes: Determining at least one target filtering algorithm from a plurality of pre-configured filtering algorithms based on the data type of the first operating data received in the current processing cycle; The first operation data received in the current processing cycle is filtered based on the at least one target filtering algorithm.

5. The method according to claim 3, characterized in that: The processing of the to-be-processed operation data based on the pre-configured processing algorithm includes: Determining at least one target processing algorithm from a plurality of pre-configured processing algorithms based on the data type of the operating data to be processed; The operation data to be processed is processed based on the at least one target processing algorithm.

6. The method according to claim 3, characterized in that The server is used to store the operation data through the first time series database, and the format conversion of the processed operation data includes: The format of the processed operation data is converted according to the storage format required by the first time series database.

7. The method according to claim 2, characterized in that The edge computing device stores the operation data through the second time series database, and the edge computing device cleans and processes the first operation data received in the current processing cycle to obtain the second operation data. The method further includes: Marking information is generated based on the first running data that has completed data cleaning and processing, where the marking information is used to indicate a storage location of the first running data that has completed data cleaning and processing in the second time series database.

8. A monitoring and operation system, characterized in that: The monitoring and operation system includes a server, an edge computing device and an agent device, and one edge computing device and at least one agent device are deployed in each region; wherein, The proxy device is used to collect first operation data generated during the operation of the business system, and upload the collected first operation data to an edge computing device deployed in the same region as the proxy device in real time; The edge computing device is used to receive first operation data collected by a proxy device deployed in the same region as the edge computing device, and send the received first operation data to the server in real time; The server is used to receive first operation data sent by the edge computing device, and store the first operation data received from the edge computing device through a first time series database.

9. The system according to claim 8, characterized in that The edge computing device is further configured to clean and process the first operation data received in the current processing cycle to obtain second operation data when the current time meets the preset processing cycle, and send the second operation data to the server; The server is further configured to modify or overwrite corresponding first operation data stored in the first time series database based on the second operation data.

10. The system according to claim 9, characterized in that The edge computing device, when used to clean and process the first operation data received in the current processing cycle, is used to: Based on a pre-configured filtering algorithm, filtering the first operation data received in the current processing cycle to obtain the operation data to be processed; Based on a pre-configured processing algorithm, the operation data to be processed is processed to obtain processed operation data; The format of the processed operation data is converted to obtain the second operation data.

11. The system according to claim 9, characterized in that The edge computing device is further used to store the first operation data received from the proxy device through a second time series database; The edge computing device is also used to perform data cleaning and processing on the first operating data received in the current processing cycle to obtain the second operating data, and then generate marking information based on the first operating data that has completed data cleaning and processing, and the marking information is used to indicate the storage location of the first operating data that has completed data cleaning and processing in the second time series database.

12. The system according to claim 9, characterized in that The monitoring and operation and maintenance system also includes terminal equipment; The terminal device is used to send a query request to the server based on a query operation of the user; The server is further configured to, in response to the query request, obtain first operation data corresponding to the query request from the first time series database, and return the first operation data corresponding to the query request to the terminal device; wherein the first operation data corresponding to the query request includes the first operation data that has been cleaned and processed and / or the first operation data that has not been cleaned and processed; The terminal device is further used to receive the first operation data returned by the server and perform visual display based on the received first operation data.

13. An edge computing device, characterized in that: The edge computing device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the operations performed by the monitoring and operation method as described in any one of claims 1 to 7 when executing the computer program.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program, and when the program is executed by the processor, the operations performed by the monitoring and operation method according to any one of claims 1 to 7 are implemented.

Images