Monitoring data collection system and method in cloudy environment and monitoring management center

Abstract

The application provides a monitoring data collection system, method and monitoring management center in a multi-cloud environment. The system comprises: a monitoring management center, at least two different types of cloud platforms, a monitoring data collection end corresponding to each cloud platform and an object storage service server deployed under each cloud platform; each monitoring data collection end is used for collecting monitoring data of the corresponding cloud platform, and reporting the monitoring data to the monitoring management center according to a standard protocol; the monitoring management center is used for calling an application program interface (API) provided by the object storage service server after receiving the monitoring data, and pushing the monitoring data into the object storage service server; and the object storage service server is used for saving the monitoring data of each cloud platform by using an object storage service. The application can realize effective collection of monitoring data in a multi-cloud environment.

Description

TECHNICAL FIELD

[0001] One or more embodiments of the present application relate to the container technology in the field of communication, in particular to a monitoring data collection system and method in a multi-cloud environment and a monitoring management center. BACKGROUND

[0002] Multi-cloud refers to using multiple public cloud platforms, that is, using two or more different cloud vendors and utilizing their advantages to meet business needs.

[0003] With the rapid development of multi-cloud business, it is increasingly important to uniformly and effectively monitor and manage computing, storage, network, security and other services in a multi-cloud environment. At present, there is a lack of independent running state monitoring capability in a multi-cloud environment, and there is no accurate resource account, and the resource use is extensive. After a business failure, there is a lack of effective monitoring data for positioning and post-mortem operations. At the same time, business failures can only be handled after the fact, and there is a lack of corresponding early warning mechanism. Therefore, it is necessary to provide a convenient, efficient, secure and storage-expandable monitoring data collection method in a multi-cloud environment. SUMMARY

[0004] One or more embodiments of the present application describe a monitoring data collection system and method in a multi-cloud environment and a monitoring management center, which can realize effective collection of monitoring data in a multi-cloud environment.

[0005] According to a first aspect, a monitoring data collection system in a multi-cloud environment is provided, comprising: a monitoring management center, at least two different types of cloud platforms, a monitoring data collection end corresponding to each cloud platform deployed in each cloud platform, and an object storage service server;

[0006] Each monitoring data collection end is configured to collect monitoring data of the corresponding cloud platform and report the monitoring data to the monitoring management center according to a standard protocol;

[0007] The monitoring management center is configured to, after receiving the monitoring data, call an application programming interface (API) provided by the object storage service server and push the monitoring data to the object storage service server;

[0008] The object storage service server is configured to save the monitoring data of each cloud platform using the object storage service.

[0009] The object storage service server is further configured to manage the monitoring data in a decentralized manner and retain the managed monitoring data for a preset first time period.

[0010] Each monitoring data collection end is further configured to, before reporting the monitoring data to the monitoring management center, perform:

[0011] The monitoring data collection end collects monitoring data of the corresponding cloud platform every second predetermined time period;

[0012] According to the unified interface protocol, the collected monitoring data is converted into a standard message format, and each piece of monitoring data is labeled, wherein the label of each piece of monitoring data includes a cloud platform, a monitoring object, a UUID, and a timestamp;

[0013] The labeled monitoring data is asynchronously saved in a local database for subsequent asynchronous calling of the labeled monitoring data from the local database.

[0014] The system further includes a Redis database;

[0015] The monitoring management center and the server of the object storage service have an API, and the monitoring management center and the Redis database also have an API;

[0016] The monitoring management center is further configured to perform:

[0017] After receiving the monitoring data, and before calling the application program interface API provided by the server of the object storage service, the labels of the received monitoring data are parsed according to a standard protocol;

[0018] The monitoring management center calls the API between the monitoring management center and the Redis database, and saves the labels of the monitoring data in the Redis database;

[0019] The monitoring management center regularly finds the labels of the monitoring data pushed in the previous period from the Redis database;

[0020] The monitoring management center traverses the monitoring data pushed by each monitoring data collection end of each cloud platform, and determines whether the monitoring data is missing according to the labels of the monitoring data;

[0021] If not missing, after reaching the reporting condition, the API between the monitoring management center and the server of the object storage service is called, and the monitoring data is pushed to the server of the object storage service;

[0022] If missing, the retransmission interface of the monitoring data collection end of the corresponding cloud platform is called to obtain the missing monitoring data.

[0023] According to a second aspect, a monitoring management center is provided, which includes:

[0024] A first interface processing module is configured to be connected to monitoring data collection ends of at least two different types of cloud platforms, and to receive monitoring data uploaded by each monitoring data collection end;

[0025] The second interface processing module is configured to connect with the server of the object storage service, call an application program interface (API) provided by the server of the object storage service, and push the monitoring data into the server of the object storage service.

[0026] Further comprising a detection module and a third interface processing module.

[0027] The detection module is configured to parse tags of each piece of monitoring data received by the first interface processing module according to a standard protocol, find the tags of the monitoring data pushed in a previous period from the Redis database through the third interface processing module at a timing, traverse the monitoring data pushed by each monitoring data collection terminal of each cloud platform, and determine whether the monitoring data is missing according to the tags of the monitoring data. If the monitoring data is not missing, the second interface processing module is triggered to push the monitoring data into the server of the object storage service after a reporting condition is met. If the monitoring data is missing, a retransmission interface of the monitoring data collection terminal of the corresponding cloud platform is called to obtain the missing monitoring data.

[0028] The third interface processing module is configured to connect with the Redis database, call an API between the third interface processing module and the Redis database after the detection module completes the parsing, and save the tags of the monitoring data in the Redis database.

[0029] According to a third aspect, a monitoring data collection method in a multi-cloud environment is provided. For at least two different types of cloud platforms, a corresponding monitoring data collection terminal is deployed for each cloud platform. The method comprises:

[0030] Each monitoring data collection terminal collects monitoring data of the corresponding cloud platform and reports the monitoring data to a monitoring management center according to a standard protocol.

[0031] The monitoring management center calls an application program interface (API) provided by a server of an object storage service after receiving the monitoring data, and pushes the monitoring data into the server of the object storage service.

[0032] The server of the object storage service saves the monitoring data of each cloud platform by using an object storage service.

[0033] Before each monitoring data collection terminal reports the monitoring data to the monitoring management center, the method further comprises:

[0034] The monitoring data collection terminal collects the monitoring data of the corresponding cloud platform at a predetermined second time interval.

[0035] According to a unified interface protocol, the collected monitoring data is converted into a standard message format, and each piece of monitoring data is labeled, wherein the label of each piece of monitoring data comprises a cloud platform, a monitoring object, a UUID, and a timestamp;

[0036] The labeled monitoring data is asynchronously saved in a local database for subsequent asynchronous calling of the labeled monitoring data from the local database.

[0037] After receiving the monitoring data and before calling an application program interface (API) provided by a server of an object storage service, the method further comprises:

[0038] The monitoring management center parses the labels of the received monitoring data according to a standard protocol;

[0039] The monitoring management center calls an API between the monitoring management center and a Redis database, and saves the labels of the monitoring data in the Redis database;

[0040] The monitoring management center regularly finds the labels of the monitoring data pushed in a previous period from the Redis database;

[0041] The monitoring management center traverses the monitoring data pushed by the monitoring data collection end of each cloud platform, and determines whether the monitoring data is missing according to the labels of the monitoring data;

[0042] If the monitoring data is not missing, after reaching a reporting condition, the application program interface (API) provided by the server of the object storage service is called and the monitoring data is pushed into the server of the object storage service;

[0043] If the monitoring data is missing, a retransmission interface of the monitoring data collection end of the corresponding cloud platform is called to obtain the missing monitoring data.

[0044] According to a fourth aspect, a computing device is provided, comprising a memory and a processor, the memory storing executable code, and the processor executing the executable code to implement the method of any of the embodiments.

[0045] The monitoring data collection system, method, and monitoring management center in the multi-cloud environment provided by the embodiments of the present application can at least achieve the following beneficial effects:

[0046] 1. The problem of non-uniform standards of monitoring resources of various cloud platforms is solved, facilitating subsequent establishment of resource expansion and contraction and recycling mechanisms.

[0047] 2. The independent operation state monitoring capability of each cloud platform is improved, facilitating the establishment of an early warning mechanism and solving the problem of only being able to handle business failures after the fact.

[0048] 3、The monitoring management center only saves the reporting monitoring data tags in the Redis database, which saves storage space and facilitates subsequent monitoring data missing and supplement work.

[0049] 4、With the help of the massive, low-cost, and high-persistence capabilities of object storage services, the monitoring data of each cloud platform is stored in the object storage, which greatly reduces the storage space requirements of the monitoring management center.

[0050] 5、With the help of the characteristics of object storage decentralization, different permissions have different monitoring log ranges, which prompts the security of monitoring logs and reduces the risk of monitoring data leakage. BRIEF DESCRIPTION OF DRAWINGS

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiment or prior art description. Obviously, the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0052] Figure 1 is a structural schematic diagram of a monitoring data collection system in a multi-cloud environment in an embodiment of the present application.

[0053] Figure 2 is a structural schematic diagram of a monitoring data collection system in a multi-cloud environment in another embodiment of the present application.

[0054] Figure 3 is a structural schematic diagram of a monitoring management center in an embodiment of the present application.

[0055] Figure 4 is a structural schematic diagram of a monitoring management center in another embodiment of the present application.

[0056] Figure 5 is a flowchart of a monitoring data collection method in a multi-cloud environment in an embodiment of the present application.

[0057] Figure 6 is a flowchart of a monitoring data collection method in a multi-cloud environment in another embodiment of the present application. DETAILED DESCRIPTION

[0058] The scheme provided by the present application will be described below in combination with the drawings.

[0059] It should be noted that the terms used in the embodiments of the present application are merely for the purpose of describing specific embodiments and are not intended to limit the present application. The singular forms "a", "an" and "the" used in the embodiments of the present application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0060] It should be understood that the term "and / or" used herein is merely a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, the character " / " herein generally represents an "or" relationship between the front and rear associated objects.

[0061] An embodiment of the present application provides a monitoring data collection system in a multi-cloud environment. Referring to Figure 1 , the system comprises a monitoring management center, at least two different types of cloud platforms, a monitoring data collection end corresponding to the cloud platform and an object storage service server deployed under each cloud platform;

[0062] Each monitoring data collection end is configured to collect monitoring data of the corresponding cloud platform and report the monitoring data to the monitoring management center according to a standard protocol;

[0063] The monitoring management center is configured to, after receiving the monitoring data, call an application program interface (API) provided by the object storage service server and push the monitoring data to the object storage service server;

[0064] The object storage service server is configured to save the monitoring data of each cloud platform by using an object storage service.

[0065] It can be seen that the monitoring data collection system in the multi-cloud environment provided by the embodiment of the present application can provide a unified monitoring data acquisition method for different types of cloud platforms, and by setting a monitoring data collection end on each cloud platform side, setting a monitoring management center and integrating an object storage service into the system, the problem of non-uniform standards of monitoring resources of each cloud platform can be solved, and the subsequent establishment of resource expansion and contraction and recycling mechanisms is facilitated. The monitoring data collection system in the multi-cloud environment provided by the embodiment of the present application improves the independent operation state monitoring capability of each cloud platform, facilitates the establishment of an early warning mechanism, and solves the problem of only being able to handle business failures after the fact.

[0066] In Figure 1In an embodiment of the system of the application, the server of the object storage service is further configured to manage the monitoring data in a decentralized manner and retain the managed monitoring data for a preset first time period. In this way, the system of the application stores the monitoring data of each cloud platform in the object storage by virtue of the massive, low-cost and high-persistence capability of the object storage service, thereby greatly reducing the requirement for the storage space of the monitoring management center. In addition, by virtue of the decentralized feature of the object storage, different permissions have different ranges of monitoring data, which prompts the security of the monitoring data and monitoring log and reduces the risk of leakage of the monitoring data.

[0067] In an embodiment of the system of the application, the monitoring data collection end can first store the collected monitoring data in a local database asynchronously, so as to report asynchronously after reaching the reporting condition. At this time, each monitoring data collection end is further configured to perform the following before reporting the monitoring data to the monitoring management center:

[0068] Collect the monitoring data of the corresponding cloud platform every predetermined second time period;

[0069] Convert the collected monitoring data into a standard message format according to a unified interface protocol, and then label each piece of monitoring data, wherein the label of each piece of monitoring data includes a cloud platform, a monitoring object, a universally unique identifier (UUID) and a timestamp;

[0070] Save the labeled monitoring data in a local database asynchronously for subsequent asynchronous calling of the labeled monitoring data from the local database.

[0071] In actual business implementation, the problem of missing monitoring data often occurs due to network failure or transmission error, etc. To solve this problem, in an embodiment of the application, the monitoring management center can detect the monitoring data, detect the monitoring data pushed in the last reporting period, and re-pull the missing monitoring data. Specifically, to solve the problem of missing monitoring data, based on the above-mentioned method of labeling the monitoring data by the monitoring data collection end, referring to Figure 2 , the monitoring data collection system in a multi-cloud environment further includes a Redis database;

[0072] The monitoring management center and the server of the object storage service have an API for calling, and the monitoring management center and the Redis database also have an API for calling;

[0073] The monitoring management center is further configured to perform the following:

[0074] After receiving the monitoring data, and before calling the application program interface (API) provided by the server of the object storage service, the labels of the received monitoring data are parsed according to a standard protocol;

[0075] The monitoring management center calls the API between the Redis database and the object storage service, and saves the labels of the monitoring data in the Redis database;

[0076] The monitoring management center regularly finds the labels of the monitoring data pushed in a previous period from the Redis database;

[0077] The monitoring management center traverses the monitoring data pushed by the monitoring data collection end of each cloud platform, and determines whether the monitoring data is missing according to the labels of the monitoring data;

[0078] If the monitoring data is not missing, the API between the monitoring management center and the server of the object storage service is called after a reporting condition is reached, and the monitoring data is pushed to the server of the object storage service;

[0079] If the monitoring data is missing, a retransmission interface of the monitoring data collection end of the corresponding cloud platform is called to obtain the missing monitoring data.

[0080] According to the above method and the monitoring management center, Figure 2 the monitoring management center only saves the labels of the reported monitoring data in the Redis database, which saves storage space and facilitates subsequent monitoring data missing detection and repair work.

[0081] In an embodiment of the present application, a monitoring management center is further provided, which comprises: Figure 1 and Figure 3 The monitoring management center comprises:

[0082] The first interface processing module 301 is configured to be connected with the monitoring data collection end of at least two different types of cloud platforms, and receives the monitoring data uploaded by each monitoring data collection end;

[0083] The second interface processing module 302 is configured to be connected with the server of the object storage service, call the application program interface (API) provided by the server of the object storage service, and push the monitoring data to the server of the object storage service.

[0084] According to the above monitoring management center, Figure 2 and Figure 4 In an embodiment of the present application, the monitoring management center further comprises a detection module 401 and a third interface processing module 402.

[0085] The detection module 401 is configured to parse the labels of each monitoring data received by the first interface processing module 301 according to a standard protocol; the third interface processing module 402 is configured to find the labels of the monitoring data pushed in the previous period from the Redis database at a time; the monitoring data pushed by each monitoring data collection end of each cloud platform is traversed, and whether the monitoring data is missing is determined according to the label of the monitoring data; if not, the second interface processing module 302 is triggered to execute the pushing of the monitoring data into the server of the object storage service after the reporting condition is reached; if yes, the retransmission interface of the monitoring data collection end of the corresponding cloud platform is called to obtain the missing monitoring data.

[0086] The third interface processing module 402 is configured to be connected with the Redis database, and after the detection module 401 completes the parsing, the third interface processing module 402 calls the API between the Redis database, and saves the label of the monitoring data in the Redis database.

[0087] Referring to Figure 5 In an embodiment of the present application, a monitoring data collection method in a multi-cloud environment is also provided, which is for at least two different types of cloud platforms, and a corresponding monitoring data collection end is deployed for each cloud platform; the method further comprises:

[0088] Step 501: Each monitoring data collection end collects the monitoring data of the corresponding cloud platform, and reports the monitoring data to the monitoring management center according to a standard protocol.

[0089] Step 503: After receiving the monitoring data, the monitoring management center calls the application program interface API provided by the server of the object storage service, and pushes the monitoring data into the server of the object storage service.

[0090] Step 505: The server of the object storage service saves the monitoring data of each cloud platform by using the object storage service.

[0091] In an embodiment of the present application, before step 501, further comprising:

[0092] Every second predetermined second time period, the monitoring data collection end collects the monitoring data of the corresponding cloud platform;

[0093] According to a unified interface protocol, the collected monitoring data is converted into a standard message format, and then each monitoring data is labeled, wherein the label of each monitoring data comprises a cloud platform, a monitoring object, a UUID and a timestamp;

[0094] The labeled monitoring data is saved in a local database asynchronously, so as to be called from the local database asynchronously subsequently.

[0095] In one embodiment of the method, between step 501 and step 503, i.e. after the monitoring management center receives the monitoring data, and before calling the application program interface API provided by the server of the object storage service, the method further comprises:

[0096] The monitoring management center parses the labels of the received monitoring data according to a standard protocol;

[0097] The monitoring management center calls the API between the Redis database and saves the labels of the monitoring data in the Redis database;

[0098] The monitoring management center regularly finds the labels of the monitoring data pushed in the previous period from the Redis database;

[0099] The monitoring management center traverses the monitoring data pushed by the monitoring data collection end of each cloud platform, and judges whether the monitoring data is missing according to the label of the monitoring data;

[0100] If not missing, after reaching the reporting condition, the application program interface API provided by the server of the object storage service is called and the monitoring data is pushed into the server of the object storage service;

[0101] If missing, the retransmission interface of the monitoring data collection end of the corresponding cloud platform is called to obtain the missing monitoring data.

[0102] The following will illustrate one implementation of the method by a specific example. Referring to Figure 6 The method comprises:

[0103] Step 601: For the cloud platform corresponding to the monitoring data collection end (i.e. the cloud platform on the side), the monitoring data collection end collects the monitoring data of the cloud platform every five minutes.

[0104] Step 603: For each collected monitoring data, the monitoring data collection end converts the collected monitoring data into a standard message format according to a unified interface protocol, wherein each monitoring data is labeled in the manner of "cloud platform + monitoring object + UUID + timestamp".

[0105] Step 605: The monitoring data collection end judges whether the number of the collected monitoring data exceeds the limit, if not, step 609 is executed, if yes, step 607 is executed.

[0106] Step 607: The monitoring data collection end splits the labeled monitoring data to avoid reporting failure.

[0107] Step 609: The monitoring data acquisition end saves the tagged monitoring data obtained after this collection in the local database, and deletes the monitoring data of three days ago on the cloud platform at regular intervals, so as to save the local storage space.

[0108] Step 611: After the monitoring data acquisition end reaches the reporting condition, the monitoring data reporting interface between the monitoring data acquisition end and the monitoring management center is called, and the tagged monitoring data read from the local database is sent to the monitoring management center.

[0109] Step 613: After the monitoring management center receives the monitoring data, the label of the received monitoring data is parsed, and the label of the monitoring data is stored in the Redis database.

[0110] Step 615: The monitoring management center regularly traverses the labels of the monitoring data pushed by each cloud platform from the Redis database, finds the labels of the monitoring data pushed yesterday, and judges whether the monitoring data is missing according to the push timestamp in the label. If not, step 619 is executed, and if yes, step 617 is executed.

[0111] Step 617: The monitoring management center calls the retransmission interface of the monitoring data acquisition end of the corresponding cloud platform to obtain the missing monitoring data.

[0112] Step 619: After reaching the reporting condition, the monitoring management center calls the application program interface API provided by the server of the object storage service, and pushes the monitoring data to the server of the object storage service.

[0113] Step 621: The server of the object storage service manages the monitoring data in a decentralized manner, and retains the managed monitoring data for a preset first time period.

[0114] The monitoring data acquisition system, method and monitoring management center provided by various embodiments of the application can at least achieve the following beneficial effects:

[0115] 1. The problem of non-uniform standards of monitoring resources of various cloud platforms is solved, and subsequent resource expansion and contraction and recycling mechanisms are facilitated.

[0116] 2. The independent operation state monitoring capability of each cloud platform is improved, the early warning mechanism is facilitated, and the business failure aftertreatment disadvantage is solved.

[0117] 3. The monitoring management center only saves the reporting monitoring data label in the Redis database, which saves storage space and facilitates subsequent monitoring data missing and supplementing work.

[0118] 4. With the help of the massive, low-cost, high-persistent ability of the object storage service, the monitoring data of each cloud platform is stored in the object storage, which greatly reduces the requirement for the storage space of the monitoring management center.

[0119] 5. With the help of the characteristics of the object storage, different permissions have different monitoring log ranges, which prompts the security of the monitoring log and reduces the risk of monitoring data leakage.

[0120] It should be noted that the above devices are usually implemented on a server side, and can be arranged on independent servers, or some or all of the devices can be arranged on the same server. The server can be a single server or a server cluster composed of multiple servers, and the server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system. The above devices can also be implemented on a computer terminal with strong computing power.

[0121] An embodiment of the present application provides a computer readable storage medium, which stores a computer program, and when the computer program is executed in a computer, the computer executes the method in any one of the embodiments of the specification.

[0122] An embodiment of the present application provides a computing device, comprising a memory and a processor, wherein the memory stores executable code, and when the processor executes the executable code, the method in any one of the embodiments of the specification is implemented.

[0123] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the device of the embodiments of the present application. In other embodiments of the specification, the above device can include more or fewer components than the illustration, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0124] Each embodiment of the present application adopts a progressive manner for description, and the same or similar parts between each embodiment can be referred to each other. Each embodiment focuses on the difference from other embodiments. Especially for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the related parts can be referred to the part of the method embodiment.

[0125] Those skilled in the art should realize that in one or more of the above examples, the functions described in the present application can be realized by hardware, software, a plug-in or any combination thereof. When realized by software, these functions can be stored in a computer readable medium or transmitted as one or more instructions or codes on a computer readable medium.

[0126] The above detailed description of the specific embodiments of the present application is provided for the purpose of further explaining the objects, technical solutions and advantages of the present application, and it should be understood that the above description is only a specific embodiment of the present application and is not used to limit the protection scope of the present application, and any modification, equivalent replacement, improvement, etc. made on the basis of the technical solutions of the present application shall be included in the protection scope of the present application.

Claims

1. A monitoring data collection system in a multi-cloud environment, characterized by, The system comprises a monitoring management center, at least two cloud platforms of different types, a monitoring data collection terminal corresponding to each cloud platform and a server of an object storage service deployed under each cloud platform; Each monitoring data collection terminal is configured to collect monitoring data of the corresponding cloud platform and report the monitoring data to the monitoring management center according to a standard protocol; The monitoring management center is configured to call an application program interface (API) provided by the server of the object storage service after receiving the monitoring data and push the monitoring data into the server of the object storage service; The server of the object storage service is configured to save the monitoring data of each cloud platform by using the object storage service; Each monitoring data collection terminal is further configured to perform the following operations before reporting the monitoring data to the monitoring management center: The monitoring data collection terminal collects monitoring data of the corresponding cloud platform every second predetermined time period; The collected monitoring data is converted into a standard message format according to a unified interface protocol, and each piece of monitoring data is labeled, wherein the label of each piece of monitoring data comprises a cloud platform, a monitoring object, a UUID and a timestamp; The labeled monitoring data is saved in a local database asynchronously, so as to be called from the local database asynchronously in the future; The system further comprises a Redis database; The monitoring management center and the server of the object storage service are connected by an API, and the monitoring management center and the Redis database are also connected by an API; The monitoring management center is further configured to perform the following operations: After receiving the monitoring data and before calling the API provided by the server of the object storage service, the labels of the received monitoring data are parsed according to the standard protocol; The monitoring management center calls the API between the monitoring management center and the Redis database and saves the labels of the monitoring data in the Redis database; The monitoring management center regularly searches the Redis database for the labels of the monitoring data pushed in the previous period; The monitoring management center traverses the monitoring data pushed by each monitoring data collection terminal of each cloud platform and determines whether the monitoring data is missing according to the labels of the monitoring data; If the monitoring data is not missing, the API between the monitoring management center and the server of the object storage service is called and the monitoring data is pushed into the server of the object storage service after a reporting condition is met; If the monitoring data is missing, a retransmission interface of the monitoring data collection terminal of the corresponding cloud platform is called to obtain the missing monitoring data.

2. The system of claim 1, wherein, The server of the object storage service is further configured to manage the monitoring data in a manner of power and domain division and retain the managed monitoring data for a preset first time period.

3. A monitoring management center characterized by, The monitoring management center comprises: A first interface processing module configured to be connected with the monitoring data collection terminals of the at least two cloud platforms of different types and receive the monitoring data uploaded by each monitoring data collection terminal; A second interface processing module configured to be connected with the server of the object storage service, call an application program interface (API) provided by the server of the object storage service and push the monitoring data into the server of the object storage service. Further comprising: a detection module and a third interface processing module; The detection module is configured to parse the tags of the monitoring data received by the first interface processing module according to a standard protocol; the third interface processing module is configured to find the tags of the monitoring data pushed in a previous period from the Redis database at a timing; the monitoring data pushed by the monitoring data collection end of each cloud platform is traversed, and whether the monitoring data is missing is determined according to the tags of the monitoring data; if not, the second interface processing module is triggered to execute pushing the monitoring data into the server of the object storage service after a reporting condition is reached; if yes, a retransmission interface of the monitoring data collection end of the corresponding cloud platform is called to obtain the missing monitoring data; The third interface processing module is configured to be connected with the Redis database, and after the detection module completes the parsing, the third interface processing module calls an API between the Redis database, and saves the tags of the monitoring data in the Redis database.

4. A method for monitoring data collection in a multi-cloud environment, the method comprising: receiving a request for a data collection task; determining a data collection task based on the request; and executing the data collection task. For at least two different types of cloud platforms, a corresponding monitoring data collection end is deployed for each cloud platform; the method comprises: Each monitoring data collection end collects the monitoring data of the corresponding cloud platform, and reports the monitoring data to the monitoring management center according to a standard protocol; The monitoring management center calls an application program interface API provided by the server of the object storage service after receiving the monitoring data, and pushes the monitoring data into the server of the object storage service; The server of the object storage service saves the monitoring data of each cloud platform by using the object storage service; Before each monitoring data collection end reports the monitoring data to the monitoring management center, the method further comprises: The monitoring data collection end collects the monitoring data of the corresponding cloud platform once every predetermined second time period; According to a unified interface protocol, the collected monitoring data is converted into a standard message format, and then each piece of monitoring data is labeled, wherein the tag of each piece of monitoring data comprises a cloud platform, a monitoring object, a UUID and a timestamp; The labeled monitoring data is saved asynchronously in a local database for subsequent asynchronous calling of the labeled monitoring data from the local database; After receiving the monitoring data and before calling the application program interface API provided by the server of the object storage service, the method further comprises: The monitoring management center parses the tags of the received monitoring data according to a standard protocol; The monitoring management center calls an API between the Redis database, and saves the tags of the monitoring data in the Redis database; The monitoring management center finds the tags of the monitoring data pushed in a previous period from the Redis database at a timing; The monitoring management center traverses the monitoring data pushed by the monitoring data collection end of each cloud platform, and determines whether the monitoring data is missing according to the tags of the monitoring data; If not, the application program interface API provided by the server of the object storage service is called and the monitoring data is pushed into the server of the object storage service after a reporting condition is reached; If missing, call the retransmission interface of the monitoring data collection end of the corresponding cloud platform to obtain the missing monitoring data. If missing, call the retransmission interface of the monitoring data collection end of the corresponding cloud platform to obtain the missing monitoring data.

Images