A virtual data center backup method and device based on a cloud management platform

Abstract

The application discloses a virtual data center backup method based on a cloud management platform, which provides a fine-grained backup mechanism and can backup the resource and storage of a container in a virtual data center based on the cloud management platform, so as to meet the fine-grained backup demand of a user. Moreover, the backup mechanism synchronizes and backs up files based on the file path of a container storage volume on a node in the cloud management platform, does not depend on the storage volume backup mechanism of a storage manufacturer and is suitable for the backup of a fine-grained storage volume. In addition, the application further provides a virtual data center backup device based on the cloud management platform, equipment and a readable storage medium, and the technical effects thereof correspond to the above method.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a virtual data center backup method, apparatus, device, and readable storage medium based on a cloud management platform. Background Technology

[0002] Currently, most backup mechanisms in Kubernetes clusters are full-scale backups of virtual machines or physical machines, or backups specific to the Kubernetes cluster itself. However, in practical applications, users often have fine-grained backup needs, such as backing up only a portion of the resources and storage within their own virtual data center.

[0003] Furthermore, most current container storage volume backups rely on backup devices provided by storage server vendors. Different storage server vendors have different mechanisms, all of which are on the storage server side, making it impossible to perform backups uniformly at the cloud management platform level.

[0004] It is evident that how to implement a fine-grained backup solution on a cloud management platform for a Kubernetes cluster is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of this application is to provide a virtual data center backup method, apparatus, device, and readable storage medium based on a cloud management platform, to solve the current problem that fine-grained backup cannot be achieved on a cloud management platform. The specific solution is as follows:

[0006] Firstly, this application provides a virtual data center backup method based on a cloud management platform, comprising:

[0007] Based on the backup request, identify the container applications in the virtual data center that need to be backed up;

[0008] The configuration information of the container application is obtained from the underlying Kubernetes cluster, and the configuration information is stored in the object storage server.

[0009] The storage volume corresponding to the container application is determined based on the configuration information, and the mount path of the storage volume is obtained; the storage data of the container application is synchronized to the object server based on the mount path.

[0010] Preferably, determining the container application to be backed up in the virtual data center based on the backup request includes:

[0011] Based on the backup request, determine the target virtual data center and identify the container applications to be backed up within the target virtual data center.

[0012] Preferably, determining the container application to be backed up in the virtual data center based on the backup request includes:

[0013] Based on the backup request, identify the container applications to be backed up in the virtual data center and determine the target backup time;

[0014] Accordingly, obtaining the configuration information of the container application from the underlying Kubernetes cluster and storing the configuration information in the object storage server includes:

[0015] When the target backup time is reached, the configuration information of the container application is obtained from the underlying Kubernetes cluster and stored in the object storage server.

[0016] Preferably, obtaining the configuration information of the container application from the underlying Kubernetes cluster and storing the configuration information in an object storage server includes:

[0017] The configuration information of the container application is obtained from the underlying Kubernetes cluster, and a YAML file is generated based on the configuration information. A target directory is created on the object storage server, and the YAML file is stored in the target directory. The target directory includes the following information: the identification information of the virtual data center, timestamp, application resource type, and file name.

[0018] Preferably, synchronizing the storage data of the container application to the object server according to the mount path includes:

[0019] The rclone synchronization tool is used to synchronize the storage data of the container application to the object server according to the mount path.

[0020] Preferred options also include:

[0021] Based on the recovery request, identify the container applications in the virtual data center that need to be recovered;

[0022] The configuration information of the container application is obtained from the object storage server and written to the underlying Kubernetes cluster.

[0023] Based on the configuration information, the storage volume corresponding to the container application is determined. When the storage volume is in a bound state, the storage data of the container application in the object server is synchronized to the mount path of the storage volume.

[0024] Preferably, the step of obtaining the configuration information of the container application from the object storage server and writing the configuration information into the underlying Kubernetes cluster includes:

[0025] The configuration information of the container application is obtained from the object storage server to obtain a YAML file; the YAML file is converted into a JSON object and the JSON object is written to the underlying Kubernetes cluster.

[0026] Secondly, this application provides a virtual data center backup device based on a cloud management platform, comprising:

[0027] Request parsing module: Used to determine the container applications to be backed up in the virtual data center based on the backup request;

[0028] Configuration information backup module: used to obtain the configuration information of the container application from the underlying Kubernetes cluster and store the configuration information to the object storage server;

[0029] Storage data backup module: used to determine the storage volume corresponding to the container application according to the configuration information, and obtain the mount path of the storage volume; and synchronize the storage data of the container application to the object server according to the mount path.

[0030] Thirdly, this application provides a virtual data center backup device based on a cloud management platform, comprising:

[0031] Memory: Used to store computer programs;

[0032] Processor: Used to execute the computer program to implement the steps of the virtual data center backup method based on the cloud management platform as described above.

[0033] Fourthly, this application provides a readable storage medium for storing a computer program, which, when executed by a processor, is used to implement the steps of the virtual data center backup method based on a cloud management platform as described above.

[0034] This application provides a virtual data center backup method based on a cloud management platform, comprising: determining the container application to be backed up in the virtual data center according to a backup request; obtaining the configuration information of the container application from the underlying Kubernetes cluster and storing the configuration information in an object storage server; determining the storage volume corresponding to the container application according to the configuration information and obtaining the mount path of the storage volume; and synchronizing the storage data of the container application to the object server according to the mount path.

[0035] As can be seen, this method provides a fine-grained backup mechanism that can back up resources and storage at the container application level in a virtual data center based on a cloud management platform, enabling targeted backups and meeting users' small-granularity backup needs. Furthermore, this backup mechanism synchronizes and backs up files based on the file paths of container storage volumes on nodes within the cloud management platform, independent of storage vendor's storage volume backup mechanisms, making it suitable for small-granularity storage volume backups.

[0036] In addition, this application also provides a virtual data center backup device, equipment and readable storage medium based on a cloud management platform, the technical effects of which correspond to the above methods, and will not be described in detail here. Attached Figure Description

[0037] To more clearly illustrate the technical solutions of the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0038] Figure 1 A flowchart illustrating the backup process in Embodiment 1 of a virtual data center backup method based on a cloud management platform provided in this application;

[0039] Figure 2 A flowchart illustrating the recovery process in Embodiment 1 of a virtual data center backup method based on a cloud management platform provided in this application;

[0040] Figure 3 A schematic diagram of the backup process in Embodiment 2 of the virtual data center backup method based on a cloud management platform provided in this application;

[0041] Figure 4 A schematic diagram of the recovery process in Embodiment 2 of the virtual data center backup method based on a cloud management platform provided in this application;

[0042] Figure 5 This application provides a functional block diagram of an embodiment of a virtual data center backup device based on a cloud management platform. Detailed Implementation

[0043] To enable those skilled in the art to better understand the present application, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. Obviously, the described embodiments are merely some embodiments of the present application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0044] Currently, backup mechanisms in Kubernetes clusters are generally designed for backups of individual virtual machines, individual physical machines, or the entire Kubernetes cluster. This granularity is too large to meet users' fine-grained backup needs. Furthermore, current container storage volume backups typically rely on backup devices provided by storage server vendors. Different vendors have different backup mechanisms, and all backups are performed on the storage server itself, making it impossible to achieve unified backup at the cloud management platform level.

[0045] To address this issue, this application provides a virtual data center backup method, apparatus, device, and readable storage medium based on a cloud management platform. It can back up resources and storage at the container application level in the virtual data center based on the cloud management platform, and synchronize and back up files based on the file paths of the container storage volume on the node, without relying on the storage volume backup mechanism of the storage vendor.

[0046] The following describes an embodiment of a virtual data center backup method based on a cloud management platform provided in this application. (See also...) Figure 1 Example 1 is implemented based on a cloud management platform and includes the following steps:

[0047] S101. Based on the backup request, identify the container applications to be backed up in the virtual data center;

[0048] S102. Obtain the configuration information of the container application from the underlying Kubernetes cluster and store the configuration information in the object storage server.

[0049] S103. Determine the storage volume corresponding to the container application based on the configuration information and obtain the mount path of the storage volume; synchronize the storage data of the container application to the object server based on the mount path.

[0050] Backups of container applications involve two processes: resource backup and storage backup. Resource backup primarily refers to backing up the container application's configuration information, while storage backup primarily refers to backing up the container application's actual stored data.

[0051] When performing resource backups, users can directly select the container application they want to back up in the virtual data center on the cloud management platform, or they can first select a target virtual data center, and then further select the container application to be backed up within the selected target virtual data center, ultimately generating and issuing a corresponding backup request. Then, in this embodiment, the backup request is parsed to determine the target virtual data center and the container application to be backed up within the target virtual data center. The configuration information of the container application is obtained from the underlying Kubernetes cluster, read and recorded in YAML format, and finally stored in the object storage server backend of the cloud management platform.

[0052] Specifically, the object storage server can be the Minio (an object storage service released under the Apache License v2.0) object storage server. After obtaining the configuration information, it can be compressed into a compressed file before being stored on the object storage server to improve efficiency. Furthermore, after successfully storing the configuration information on the object storage server, a corresponding backup record can be generated on the cloud management platform.

[0053] As a preferred implementation, users can further specify the backup time when issuing a backup request on the cloud management platform, such as executing immediately or on a scheduled basis. When executing the target backup time, the resource backup operation is performed only when the target backup time is reached, that is, the configuration information of the container application is obtained from the underlying Kubernetes cluster and stored in the object storage server.

[0054] When performing storage backups, since the storage used in Kubernetes is ultimately mounted in the folder of the corresponding node of the container, the cloud management platform in this embodiment will locate the folder corresponding to the storage volume and then synchronize the corresponding volume content to the object storage server backend of the cloud management platform. As a specific implementation method, a synchronization tool, such as rclone (an open-source command-line synchronization tool primarily for cloud storage data synchronization), can be used to synchronize the container application's storage data to the object server.

[0055] The backup process has been described above. In practical applications, the main purpose of backup is for recovery. The recovery process, corresponding to the backup process described above, is described below. Figure 2 As shown, the main steps include:

[0056] S201. Based on the recovery request, identify the container applications to be recovered in the virtual data center;

[0057] S202. Obtain the configuration information of the container application from the object storage server and write the configuration information to the underlying Kubernetes cluster.

[0058] S203. Determine the storage volume corresponding to the container application based on the configuration information. When the storage volume is in a bound state, synchronize the storage data of the container application in the object server to the mount path of the storage volume.

[0059] Corresponding to the backup process, the recovery process of container applications mainly includes resource recovery and storage recovery. Resource recovery refers to the recovery of configuration information, while storage recovery refers to the recovery of actual stored data.

[0060] When performing resource recovery, the object storage interface is called to obtain the configuration information of the container application to be recovered, which is converted into data in the format corresponding to the Kubernetes interface. The Kubernetes interface is then called to recreate the corresponding resources in the underlying Kubernetes cluster and generate the corresponding recovery record in the cloud management platform.

[0061] After all resources are restored, perform storage recovery. Locate the node location and folder path where the container storage volume was created and saved. Use the node location and folder path to locate the storage volume location, restore the stored data on object storage, and overwrite the corresponding files.

[0062] In summary, this embodiment provides a virtual data center backup method based on a cloud management platform, applicable to a Kubernetes-based cloud management platform. Backup and recovery of resources and data are essential functions within a cloud management platform, and customers also require backup functionality for virtual data center resources within the cloud management platform. To address this need, this embodiment implements a fine-grained backup solution for virtual data centers and container applications within them. This improves backup efficiency and allows for targeted backups.

[0063] Since the embodiments only perform fine-grained backups of some resources and the storage volumes under those resources, this embodiment provides a storage volume backup mechanism that achieves backup by backing up the mount path. This mechanism is fast, convenient, flexible, and can be uniformly managed on a cloud management platform without relying on storage server vendors.

[0064] With this backup solution, cloud management platform users can manually or periodically back up container applications in the virtual data center, and quickly restore the corresponding container applications in the virtual data center based on the backup files.

[0065] The following is a detailed description of Embodiment 2 of the virtual data center backup method based on a cloud management platform provided in this application. Embodiment 2 is based on Embodiment 1 mentioned above and will be elaborated on in terms of its specific implementation in practical applications.

[0066] Example 2 is applied to a cloud management platform, which integrates Minio object storage and rclone synchronization tool during deployment.

[0067] The backup process in Example 2 is as follows: Figure 3 As shown, it mainly includes:

[0068] S301. The user selects the virtual data center to be backed up in the cloud management platform, and then selects the container application to be backed up within the selected virtual data center, including but not limited to the following types: stateless workload, stateful workload, task, scheduled task, normal configuration, and encrypted configuration. The user can then further choose to back up immediately or schedule a backup. The cloud management platform records the container application to be backed up and the backup time, generates a backup task, and saves it in the database.

[0069] S302. When the user-defined backup time is reached, the cloud management platform determines the container application to be backed up. Based on the resource classification under the virtual data center, it calls the corresponding underlying Kubernetes interface for each container application to obtain the configuration information of the current container application and saves it in the cloud management platform as a YAML file.

[0070] S303. For virtual data centers that need to be backed up, the cloud management platform creates a corresponding file directory in the object storage server at the back end of the cloud management platform. The specific file template format can be: Virtual data center name - timestamp / resource type / corresponding resource file.

[0071] S304 The cloud management platform calls the object storage interface to save the obtained YAML-formatted configuration information to file storage.

[0072] S305. Once all resources have been backed up, the cloud management platform begins storage backup. It iterates through the storage volume information under the corresponding virtual data center, locates the list of mounted storage volumes, and finds the node information and mount path of each storage volume.

[0073] S306. After determining the mount path of the storage volume, the cloud management platform uses the rclone tool to synchronize the files corresponding to the mount path to the specified directory of the object storage service server in the backend of the cloud management platform. The specified directory here does not necessarily have to be the newly created file directory mentioned above, as long as there is a corresponding relationship between the two directories.

[0074] S307. Once all container applications have been backed up, the cloud management platform will generate a corresponding backup success record and can send notifications based on information such as the email address set by the user in the cloud management platform.

[0075] The recovery process in Example 2 is as follows Figure 4 As shown, it mainly includes:

[0076] S401. The user selects the container application to be restored in the cloud management platform, selects the restoration time, and the cloud management platform generates a restoration task.

[0077] S402. After the user-specified recovery time is reached, the cloud management platform determines the container application to be recovered, calls the object storage interface to query the corresponding file information in the object storage server, and calls the interface to obtain the file information in the cloud management platform.

[0078] S403, the cloud management platform parses and obtains the file information, reads the file information in sequence, and converts the YAML format file information into the corresponding JSON object.

[0079] S404. Based on the JSON object obtained in step 3, parse out the corresponding resource name, version, namespace, and other information in the underlying Kubernetes. Based on this information, the cloud management platform first checks whether the data exists in the platform. If not, it directly calls the creation interface in the cloud management platform to create it; otherwise, it calls the update interface in the cloud management platform to update it.

[0080] S405. After all resources are restored, storage recovery begins. The cloud management platform iterates through the JSON objects obtained in S403 to find the corresponding storage volume information. Once it finds that all backed-up storage volumes are in a bound state, it begins restoring the new storage volume.

[0081] S406. Since all storage volumes have been restored at this point, the storage volumes are now mounted to the docker folder on the corresponding node. The corresponding folder is located by the node on which the storage volume is mounted and the corresponding storage volume name. After finding the corresponding folder and path, the cloud management platform uses the rclone command to set the synchronization target path to the corresponding folder path on the current node and the source path to the backup file on the Minio storage for synchronization.

[0082] S407. After all container applications are successfully restored, a successful restoration record is generated, and notifications can be sent based on information such as the email address set by the user in the cloud management platform.

[0083] As can be seen, the virtual data center backup method based on a cloud management platform provided in this embodiment offers a backup and recovery mechanism for Kubernetes resources and storage based on object storage within the cloud management platform. Through this mechanism, users can quickly back up and restore resources at the container application level and the virtual data center level within the cloud management platform. Furthermore, this embodiment does not rely on the storage volume backup mechanism of storage vendors. The storage volume backup mechanism in this embodiment synchronizes and backs up files based on the file paths of container storage volumes on nodes within the cloud management platform, eliminating the need for storage on the storage server side, making it suitable for backing up small-granularity storage volumes.

[0084] The following describes a virtual data center backup device based on a cloud management platform provided in an embodiment of this application. The virtual data center backup device based on a cloud management platform described below and the virtual data center backup method based on a cloud management platform described above can be referred to and correspond to each other.

[0085] like Figure 5 As shown, the virtual data center backup device based on a cloud management platform in this embodiment includes:

[0086] Request parsing module 501: Used to determine the container applications to be backed up in the virtual data center based on the backup request;

[0087] Configuration information backup module 502: used to obtain the configuration information of container applications from the underlying Kubernetes cluster and store the configuration information to the object storage server;

[0088] Storage data backup module 503: used to determine the storage volume corresponding to the container application based on the configuration information and obtain the mount path of the storage volume; based on the mount path, synchronize the storage data of the container application to the object server.

[0089] The virtual data center backup device based on a cloud management platform in this embodiment is used to implement the aforementioned virtual data center backup method based on a cloud management platform. Therefore, the specific implementation of this device can be found in the embodiment section of the virtual data center backup method based on a cloud management platform described above. For example, the request parsing module 501, the configuration information backup module 502, and the storage data backup module 503 are respectively used to implement steps S101, S102, and S103 in the aforementioned virtual data center backup method based on a cloud management platform. Therefore, its specific implementation can be referred to the description of the corresponding embodiments, and will not be elaborated here.

[0090] Furthermore, since the virtual data center backup device based on the cloud management platform in this embodiment is used to implement the aforementioned virtual data center backup method based on the cloud management platform, its function corresponds to the function of the above method, and will not be repeated here.

[0091] In addition, this application also provides a virtual data center backup device based on a cloud management platform, including:

[0092] Memory: Used to store computer programs;

[0093] Processor: Used to execute computer programs to implement the steps of the virtual data center backup method based on the cloud management platform as described above.

[0094] Finally, this application provides a readable storage medium for storing a computer program that, when executed by a processor, is used to implement the steps of the virtual data center backup method based on a cloud management platform as described above.

[0095] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section.

[0096] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0097] The solution provided in this application has been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A virtual data center backup method based on a cloud management platform, characterized in that, include: Based on the backup request, identify the container applications in the virtual data center that need to be backed up; The configuration information of the container application is obtained from the underlying Kubernetes cluster, and the configuration information is stored in the object storage server. The storage volume corresponding to the container application is determined based on the configuration information, and the mount path of the storage volume is obtained. Based on the mount path, the storage data of the container application is synchronized to the object storage server; Based on the recovery request, identify the container applications in the virtual data center that need to be recovered; The configuration information of the container application is obtained from the object storage server and written to the underlying Kubernetes cluster. The storage volume corresponding to the container application is determined based on the configuration information. When the storage volume is in a bound state, the storage data of the container application in the object storage server is synchronized to the mount path of the storage volume. The step of determining the container applications to be backed up in the virtual data center based on the backup request includes: Based on the backup request, identify the container applications to be backed up in the virtual data center and determine the target backup time; Accordingly, obtaining the configuration information of the container application from the underlying Kubernetes cluster and storing the configuration information in the object storage server includes: When the target backup time is reached, the configuration information of the container application is obtained from the underlying Kubernetes cluster and stored in the object storage server.

2. The method as described in claim 1, characterized in that, The step of determining the container applications to be backed up in the virtual data center based on the backup request includes: Based on the backup request, determine the target virtual data center and identify the container applications to be backed up within the target virtual data center.

3. The method as described in claim 1, characterized in that, The step of obtaining the configuration information of the container application from the underlying Kubernetes cluster and storing the configuration information in the object storage server includes: The configuration information of the container application is obtained from the underlying Kubernetes cluster, and a YAML file is generated based on the configuration information. A target directory is created on the object storage server, and the YAML file is stored in the target directory. The target directory includes the following information: the identification information of the virtual data center, timestamp, application resource type, and file name.

4. The method as described in claim 1, characterized in that, The step of synchronizing the storage data of the container application to the object storage server according to the mount path includes: The rclone synchronization tool is used to synchronize the storage data of the container application to the object storage server according to the mount path.

5. The method as described in claim 1, characterized in that, The step of obtaining the configuration information of the container application from the object storage server and writing the configuration information into the underlying Kubernetes cluster includes: The configuration information of the container application is obtained from the object storage server to obtain a YAML file; the YAML file is converted into a JSON object and the JSON object is written to the underlying Kubernetes cluster.

6. A virtual data center backup device based on a cloud management platform, characterized in that, include: Request parsing module: Used to determine the container applications to be backed up in the virtual data center based on the backup request; Used to identify container applications in the virtual data center to be backed up based on backup requests, and to determine the target backup time; Configuration information backup module: used to obtain the configuration information of the container application from the underlying Kubernetes cluster and store the configuration information to the object storage server; used to obtain the configuration information of the container application from the underlying Kubernetes cluster and store the configuration information to the object storage server when the target backup time is reached. Storage data backup module: used to determine the storage volume corresponding to the container application based on the configuration information, and obtain the mount path of the storage volume; Based on the mount path, the storage data of the container application is synchronized to the object storage server; The determination module is used to determine the container applications to be restored in the virtual data center based on the recovery request; The configuration information writing module is used to obtain the configuration information of the container application from the object storage server and write the configuration information into the underlying Kubernetes cluster. The storage data synchronization module is used to determine the storage volume corresponding to the container application based on the configuration information, and when the storage volume is in a bound state, synchronize the storage data of the container application in the object storage server to the mount path of the storage volume.

7. A virtual data center backup device based on a cloud management platform, characterized in that, include: Memory: Used to store computer programs; Processor: for executing the computer program to implement the steps of the virtual data center backup method based on a cloud management platform as described in any one of claims 1-5.

8. A readable storage medium, characterized in that, The readable storage medium is used to store a computer program, which, when executed by a processor, is used to implement the steps of the virtual data center backup method based on a cloud management platform as described in any one of claims 1-5.

Images