Disk concurrent backup method, system and device based on cloud platform and medium

Abstract

The invention discloses a disk concurrent backup method, system and device based on a cloud platform and a medium, and belongs to the technical field of data backup. Obtaining to-be-backed-up disk information; creating the disk snapshot to be backed up; creating a new disk according to the snapshot information and mounting the new disk to the proxy client; reading a new disk file system structure mounted on the proxy client, and generating a disk bitmap file marking a disk data block; deactivating the new disk volume group through an LVM tool command and modifying the disk sector by using a dd command; the proxy client reads disk data and writes the disk data into the backup server through the new disk bitmap file; according to the disk concurrent backup method, system and device based on the cloud platform and the medium, concurrent backup of multiple disks is supported, resource waste is reduced, the common disk device ID and volume group conflict problem in the disk concurrent backup process is solved, and backup efficiency is improved.

Description

Technical Field

[0001] The present invention belongs to the field of data backup technology, and specifically relates to a disk concurrent backup method, system, device and medium based on a cloud platform. Background Art

[0002] The growing development of cloud computing and storage technologies is suitable for scenarios requiring efficient concurrent backup, ensuring the security and reliability of enterprise data. They are also used in the disaster recovery construction of enterprise cloud platforms to avoid losses caused by business interruptions due to emergencies. However, the existing disk concurrent method wastes resources seriously and has low backup efficiency, especially when there is a disk device ID conflict problem during the concurrent backup process. Therefore, it is necessary to develop a new cloud platform-based disk concurrent backup method, system, device and medium to solve the existing problems. Summary of the Invention

[0003] The purpose of the present invention is to provide a cloud platform-based disk concurrent backup method, system, device and medium to solve the above-mentioned problems.

[0004] To achieve the above object, the present invention provides the following technical solution: a disk concurrent backup method based on a cloud platform, comprising the following steps: Step 1: Create one or more virtual machines on the cloud platform and install the agent, i.e., the proxy client, to interact with the cloud platform API. Step 2: The proxy client calls the cloud platform disk list interface to obtain information about multiple disks to be backed up; Step 3: The proxy client calls the cloud platform snapshot interface to create snapshots of multiple disks to be backed up; Step 4: The proxy client calls the cloud platform disk interface to create a snapshot disk based on the snapshot information. The snapshot disk is a disk created based on the snapshot. Step 5: The proxy client calls the cloud platform's mount interface to mount the new disk to the proxy client. The proxy client generates a disk bitmap file that marks the disk data blocks by reading the file system structure of the new disk mounted on the proxy client. The disk bitmap file locates valid data locations based on the disk file system structure and marks them in the file, generating a valid data bitmap. Each record in the file represents a block of data on the disk, and the data block on the disk is useful, not useless (unused space). Step 6: The proxy client deactivates the disk for which the bitmap file has been generated, deactivates the new disk volume group using the LVM tool command, and uses the dd command to modify the disk sectors. Step 7: The proxy client reads the disk data through the new disk bitmap file and writes it to the backup server.

[0005] The present invention further provides a disk concurrent backup system based on a cloud platform, the system comprising: Configuration module, used to configure the proxy client; The disk information acquisition module is used to obtain the disk information to be backed up; A snapshot creation module, configured to create a snapshot of the disk to be backed up; A mounting module, configured to create a new disk according to the snapshot information and mount the new disk to the proxy client; A disk bitmap file generation module is used to read the file system structure of the new disk mounted on the proxy client and generate a disk bitmap file that marks the disk data blocks; Deactivation module, used by LVM tool commands to deactivate the new disk volume group and use dd command to modify disk sectors; The write module is used to proxy the client to read data and write it to the backup server through the new disk bitmap file.

[0006] The present invention further provides a disk concurrent backup device based on a cloud platform, comprising: a memory for storing non-transitory computer-readable instructions; and A processor is used to run the computer-readable instructions, so that when the computer-readable instructions are executed by the processor, the above-mentioned cloud platform-based concurrent disk backup method is implemented.

[0007] The present invention further provides a computer-readable storage medium for storing non-transitory computer-readable instructions. When the non-transitory computer-readable instructions are executed by a computer, the computer executes the above-mentioned cloud platform-based concurrent disk backup method.

[0008] This cloud platform-based concurrent disk backup method, system, device and medium support concurrent backup of multiple disks, reduce resource waste, and focus on the key step of modifying disk data block sectors after mounting the disk to solve the common disk device ID and volume group conflict problems in the concurrent disk backup process, improve backup efficiency, and perform concurrent backup of cloud platform disks, thereby improving backup efficiency and reducing resource waste. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 Schematic diagram of the process of the present invention. DETAILED DESCRIPTION

[0010] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0011] The present invention provides Figure 1 A method for concurrent backup of disks based on a cloud platform as shown in includes: an agent client, a backup server; Cloud platforms refer to common ones such as OpenStack, EasyStack, ZTE Cloud, and China Resources Cloud; The backup server can be a physical machine or a virtual machine, used to store backup data; The proxy service is an intermediate entity between the proxy client and the cloud platform and backup server, used to process sending and receiving requests.

[0012] The proxy client refers to the virtual machine on the cloud platform where the proxy service is installed.

[0013] The specific steps are as follows: Step 1: Configure one or more virtual machines on the cloud platform to install an agent, namely the agent client 1 in the figure, for interacting with the cloud platform API interface; Step 2: The proxy client 1 calls the cloud platform disk list information interface to obtain the disks Disk 1 and Disk 2 to be backed up; the call includes calling the cloud platform resful disk list information interface through an HTTP request; Step 3: The proxy client 1 calls the cloud platform snapshot interface to create snapshot 1 and snapshot 2 for disk 1 and disk 2 respectively; creating snapshot 1 and snapshot 2 includes: calling the cloud platform resful creation interface through http request, creating snapshot 1 and snapshot 2 respectively Step 4: Proxy client 1 calls the cloud platform's new disk creation interface to create snapshot disk 1 and snapshot disk 2 based on snapshot 1 and snapshot 2 respectively; Step 5: Proxy client 1 calls the cloud platform mounting interface to mount snapshot disk 1 and snapshot disk 2 to proxy client 1. Mounting includes: calling the cloud platform resful mounting interface through an HTTP request to mount snapshot disk 1 and snapshot disk 2 to proxy client 1. Step 6: The proxy client 1 reads and analyzes the metadata of the file system on the mounted snapshot disk 1 and snapshot disk 2 to generate disk bitmap files 1 and bitmap files 2 for marking the validity positions of the disk data blocks; Step 7: The proxy client 1 deactivates the snapshot disk 1 and the snapshot disk 2 for which the bitmap files have been generated, and modifies the sector data blocks mounted on the snapshot disk 1 and the snapshot disk 2 on the proxy client 1 using the dd command. Step 8: Proxy client 1 concurrently reads the data from newly created snapshot disk 1 and snapshot disk 2 through disk bitmap file 1 and bitmap file 2 and writes the data to the backup server.

[0014] The present invention further provides a disk concurrent backup system based on a cloud platform, the system comprising: Create a new module for creating a new proxy client; The disk information acquisition module is used to obtain the disk information to be backed up; A snapshot creation module, configured to create a snapshot of the disk to be backed up; A mounting module, configured to create a snapshot disk according to the snapshot information and mount the snapshot disk to the proxy client; A disk bitmap file generation module is used to read the file system structure of the snapshot disk mounted on the proxy client and generate a disk bitmap file that marks the disk data blocks; Deactivation module, used by LVM tool commands to deactivate snapshot volume groups and modify disk sectors using the dd command; The write module is used to proxy the client to read data and write it to the backup server through the new disk bitmap file.

[0015] The present invention further provides a disk concurrent backup device based on a cloud platform, comprising: a memory for storing non-transitory computer-readable instructions; and A processor is used to run the computer-readable instructions, so that when the computer-readable instructions are executed by the processor, the above-mentioned cloud platform-based concurrent disk backup method is implemented.

[0016] The present invention further provides a computer-readable storage medium for storing non-transitory computer-readable instructions. When the non-transitory computer-readable instructions are executed by a computer, the computer executes the above-mentioned cloud platform-based concurrent disk backup method.

[0017] Finally, it should be noted that the above is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A concurrent disk backup method based on a cloud platform, characterized by: include: Create a new proxy client; Get the disk information to be backed up; Creating a snapshot of the disk to be backed up; Creating a snapshot disk according to the snapshot information and mounting the snapshot disk to the proxy client; Read the file system structure of the snapshot disk mounted on the proxy client and generate a disk bitmap file that marks the disk data blocks; Deactivate the snapshot disk and modify the disk sectors; The proxy client reads the snapshot disk data and writes it to the backup server through the disk bitmap file of the snapshot disk.

2. The cloud platform-based concurrent disk backup method according to claim 1, characterized in that: The creating of a new proxy client includes: creating at least one proxy client in the cloud platform.

3. The cloud platform-based concurrent disk backup method according to claim 2, characterized in that: The proxy client is a virtual machine in the cloud platform where the proxy service is installed.

4. The cloud platform-based concurrent disk backup method according to claim 1, characterized in that: Deactivating the snapshot disk includes deactivating the snapshot disk volume group through an LVM tool command.

5. The cloud platform-based concurrent disk backup method according to claim 1, characterized in that: When the number of disks to be backed up is greater than two: Creating snapshots of the disks to be backed up respectively; Create new snapshots according to the snapshot information and mount the new snapshots to the proxy client; Read the new snapshot file system structure mounted on the proxy client and generate a disk bitmap file that marks the disk data blocks; Deactivate the snapshot disk and modify the disk sectors respectively; The proxy client reads the snapshot disk data and writes it to the backup server through the disk bitmap file of the snapshot disk.

6. The cloud platform-based concurrent disk backup method according to claim 1, characterized in that: The modifying of the sector data includes modifying the sector data by using a dd command.

7. The cloud platform-based concurrent disk backup method according to claim 1, characterized in that: The backup server is a physical machine or a virtual machine.

8. A concurrent disk backup system based on a cloud platform, comprising: Create a new module for creating a new proxy client; The disk information acquisition module is used to obtain the disk information to be backed up; A snapshot creation module, configured to create a snapshot of the disk to be backed up; A mounting module, configured to create a snapshot disk according to the snapshot information and mount the snapshot disk to the proxy client; A disk bitmap file generation module is used to read the file system structure of the snapshot disk mounted on the proxy client and generate a disk bitmap file marking the disk data blocks; Deactivate the module used to snapshot disks and modify disk sectors; The write module is used to proxy the client to read disk data and write it to the backup server through the disk bitmap file of the snapshot disk.

9. A disk concurrent backup device based on a cloud platform, comprising: a memory for storing non-transitory computer-readable instructions; as well as A processor is used to run the computer-readable instructions, so that when the computer-readable instructions are executed by the processor, the cloud platform-based concurrent disk backup method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium for storing non-transitory computer-readable instructions, which, when executed by a computer, enables the computer to execute the cloud platform-based concurrent disk backup method according to any one of claims 1 to 7.

Images