Synchronous remote mirroring method and system, and medium and device

Abstract

Provided in the present invention are a synchronous remote mirroring method and system, and a medium and a device. The method comprises: dividing the current mirror image according to blocks at a source end, and performing a differential operation with a base mirror image according to a page unit, so as to obtain block differential information; storing the block differential information in differential data, and uploading the differential data to a domain data server; establishing a quick clone for the base mirror image at a target end; a virtual machine using a mirror image index at the target end, wherein an empty mirror image is stored in the mirror image index; when the mirror image is used at the target end, determining whether there is a missing page, and if there is a missing page, sending a missing page data request to the domain data server, modifying the mirror image index on the basis of feedback information, and at the same time, determining whether an adjacent page to the missing page is missing; and pulling the remaining data into the quick clone at the target end, and modifying the mirror image index. The present invention can reduce the response time of a user using a mirror image, the network resources consumed when compressed data is transmitted, and the redundant data in a storage system.

Description

Remote synchronous mirroring method, system, medium and device Technical Field

[0001] The present invention relates to the technical field of remote synchronous mirroring, and in particular to a remote synchronous mirroring method, system, medium and device. Background Art

[0002] In cloud computing systems, users need to use their own customized images in different regions to complete specific business, so they need to have corresponding image data in different regions, which puts forward requirements such as bandwidth ratio, storage space ratio, and response time.

[0003] Traditional methods compress the image, transfer it via a dedicated channel, and then decompress and restore it, or boot a virtual machine using the transferred image. Due to the large amount of compressed data, compression and decompression operations impact services. Transferring compressed files limits bandwidth usage, lengthening the time it takes for the image to be usable, impacting service response times. Furthermore, the source node becomes a bottleneck when transferring data to multiple domains.

[0004] In cloud computing systems, image data is the foundation of business applications. As customer businesses expand and their services spread to multiple domains, the same images need to be shared across domains, and the amount of image data required for business expansion continues to increase. Large numbers of images need to be transmitted to different domains using domain-level channels, which are expensive and require large amounts of data. Storing redundant data for the same image in storage systems on different domains leads to excessive costs and creates a burden. The mirroring of image data from the source node domain to the target domain affects the business I / O flow of the original domain node, impacting the user experience and requiring businesses to wait for the copy to complete before proceeding. The key to resolving business expansion bottlenecks is to meet user needs while avoiding large amounts of data transmission and the need for off-site backup.

[0005] Patent document CN105208104A (application number: CN201510530745.3) discloses a remote mirroring data consistency detection method and device. The method comprises: at a first remote mirroring data synchronization time point, using a first polling log to record the data change of local data from the first remote mirroring synchronization time point to a second remote mirroring synchronization time point; at a second remote mirroring data synchronization time point, stopping recording the data change of local data in the first polling log and starting to record the synchronous data transmission status of the local data from the second remote mirroring data synchronization time point using the first polling log; at a third remote mirroring data synchronization time point, determining whether the transmission process is successful based on the synchronous data transmission status of the local data recorded in the first polling log; if not, determining that the remote mirroring data is inconsistent with the local data. However, this patent fails to solve existing technical problems and fails to meet the requirements of the present invention.

[0006] Summary of the Invention

[0007] In view of the defects in the prior art, the present invention aims to provide a remote synchronous mirroring method, system, medium and device.

[0008] The remote synchronous mirroring method provided by the present invention is characterized by comprising:

[0009] Step 1: Split the current image into blocks on the source side, and perform differential operations with the base image in page units to obtain block differential information;

[0010] Step 2: Save the block differential information in the differential data as metadata and upload it to the domain data server;

[0011] Step 3: Create a quick clone of the backplane image on the target end;

[0012] Step 4: Use the image index on the target virtual machine, and store an empty image in the image index;

[0013] Step 5: When using mirroring on the target side, determine whether there is a page fault. If so, send a page fault data request to the domain data server, and modify the mirror index based on the feedback information from the domain data server. At the same time, determine whether the adjacent pages of the faulty page are also faulty, so as to request data of multiple adjacent faulty pages at the same time.

[0014] Step 6: Pull the remaining data into the quick clone on the target side and modify the mirror index.

[0015] Preferably, the step 2 includes: performing a differential operation based on a preset data differential algorithm, and the data differential algorithm includes diff, bsDiff, Xdelta, RTPatch, and ExeDiff.

[0016] Preferably, step 5 includes: when using the mirror at the target end, determining whether there is a page fault, and if so, sending a page fault data request to the domain data server in a synchronous or asynchronous manner with a high priority, and modifying the mirror index based on feedback information from the domain data server;

[0017] The step 6 includes: pulling the remaining data into the fast clone in a synchronous or asynchronous manner according to the normal priority at the target end, and modifying the mirror index.

[0018] Preferably, the modifying the mirror index based on the feedback information of the domain data server includes:

[0019] If the feedback information includes data corresponding to the missing page, the data is written into the backplane mirror fast clone, and the mirror index is pointed to the page information corresponding to the fast clone of the missing page;

[0020] If the feedback information indicates that the data corresponding to the missing page is not found in the domain data server, the mirror index is pointed to the page information corresponding to the missing page in the backplane mirror.

[0021] The remote synchronous mirroring system provided by the present invention includes:

[0022] Module M1: Splits the current image into blocks at the source end, and performs differential operations with the baseboard image in page units to obtain block differential information;

[0023] Module M2: saves the block differential information in the differential data as metadata and uploads it to the domain data server;

[0024] Module M3: Creates a fast clone of the backplane image on the target side;

[0025] Module M4: Using an image index on the target virtual machine, an empty image is stored in the image index;

[0026] Module M5: When using mirroring on the target side, it determines whether there is a page fault. If so, it sends a page fault data request to the domain data server, modifies the mirror index based on the feedback information from the domain data server, and determines whether the adjacent pages of the missing page are also missing, so as to request data of multiple adjacent missing pages at the same time.

[0027] Module M6: Pull the remaining data into the fast clone on the target side and modify the mirror index.

[0028] Preferably, the module M2 includes: performing a differential operation based on a preset data differential algorithm, and the data differential algorithm includes diff, bsDiff, Xdelta, RTPatch, and ExeDiff.

[0029] Preferably, the module M5 includes: when using the mirror at the target end, determining whether there is a page fault, and if so, sending a page fault data request to the domain data server in a synchronous or asynchronous manner with a high priority, and modifying the mirror index based on feedback information from the domain data server;

[0030] The module M6 includes: pulling the remaining data into the fast clone in a synchronous or asynchronous manner according to the normal priority at the target end, and modifying the mirror index.

[0031] Preferably, the modifying the mirror index based on the feedback information of the domain data server includes:

[0032] If the feedback information includes data corresponding to the missing page, the data is written into the backplane mirror fast clone, and the mirror index is pointed to the page information corresponding to the fast clone of the missing page;

[0033] If the feedback information indicates that the data corresponding to the missing page is not found in the domain data server, the mirror index is pointed to the page information corresponding to the missing page in the backplane mirror.

[0034] According to the computer-readable storage medium storing a computer program provided by the present invention, the steps of the remote synchronous mirroring method are implemented when the computer program is executed by a processor.

[0035] The electronic device provided by the present invention includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps of the remote synchronous mirroring method are implemented.

[0036] Compared with the prior art, the present invention has the following beneficial effects:

[0037] (1) The present invention uploads the mirrored differential data information to a dedicated server. The mirrored differential dedicated server is independent of the business and is convenient for expansion.

[0038] (2) An image index is added when a virtual machine accesses an image. When virtual machines in multiple domains start an image, they do not need to copy all images and can start quickly.

[0039] (3) The present invention can reduce the response time of users using mirroring, reduce the network resources consumed when compressing data transmission, and reduce the redundant data in the storage system. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Other features, objects and advantages of the present invention will become more apparent upon reading the detailed description of non-limiting embodiments with reference to the following drawings:

[0041] FIG1 is a schematic diagram of dividing the current image into multiple blocks at the source end;

[0042] FIG2 is a schematic diagram of saving block difference information between the current image and the backplane image shown in FIG1 to differential data at the source end;

[0043] Figure 3 is a schematic diagram of uploading differential data;

[0044] FIG4 is a schematic diagram of establishing a fast clone of a backplane image at a target end;

[0045] FIG5 is a schematic diagram of using a mirror index on a target virtual machine;

[0046] FIG6 is a schematic diagram of a method for handling a missing page when using a mirror on the target side;

[0047] FIG7 is a schematic diagram of writing downloaded data into a backplane image for rapid cloning;

[0048] FIG8 is a schematic diagram of pointing a mirror index to page information corresponding to a fast clone of a corresponding page. DETAILED DESCRIPTION

[0049] The present invention will be described in detail below with reference to specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those skilled in the art, several changes and improvements can be made without departing from the scope of the present invention. These all fall within the scope of protection of the present invention.

[0050] Example 1:

[0051] The present invention provides a remote synchronous mirroring method, the main contents of which are:

[0052] Step 1: The source side splits the current image into blocks, as shown in Figure 1.

[0053] Step 2: The source performs a page-by-page differential operation with the backplane image to obtain block differential information. Specifically, this differential operation is performed based on a pre-defined data differential algorithm, such as diff, bsDiff, Xdelta, RTPatch, or ExeDiff. For example, consider two books. Compare the first page of the first book with the first page of the second book to obtain a difference. Then, compare the second page of the first book with the second page of the second book to obtain another difference. This continues in this manner.

[0054] Step 3: Save the block differential information in the differential data as metadata, as shown in Figure 2.

[0055] Step 4: Upload the differential data to the domain data server, as shown in Figure 3.

[0056] Step 5: The target side creates a fast clone of the backplane image, as shown in Figure 4. This can be achieved using any existing fast cloning method or software, such as Clonezilla or hierarchical snapshot cloning.

[0057] Step 6: The target virtual machine uses the image index, which stores an empty image, as shown in Figure 5.

[0058] Step 7: When the target end uses the mirror, a missing page is found, as shown in Figure 6.

[0059] Step 8: Page fault processing is to send a page fault data request to the domain data server, and modify the mirror index based on the feedback information of the domain data server, and at the same time determine whether the adjacent pages of the faulty page are also faulty pages, so as to request data of multiple adjacent faulty pages at the same time.

[0060] Step 9: Write the downloaded data to the backplane image for quick cloning, as shown in Figure 7.

[0061] Step 10: Point the mirror index to the page information corresponding to the quick clone of the page, as shown in Figure 8.

[0062] Step 11: If the data is not found in the data server, the mirror index is pointed to the page information corresponding to the page in the backplane mirror.

[0063] Step 12: The target side pulls the remaining data into the quick clone and modifies the mirror index.

[0064] When using mirroring on the target side, determine whether there is a page fault. If so, send a page fault data request to the domain data server in a synchronous or asynchronous manner with high priority, and modify the mirror index based on the feedback information from the domain data server.

[0065] On the target side, pull the remaining data into the fast clone synchronously or asynchronously with normal priority, and modify the mirror index.

[0066] The modifying of the mirror index based on the feedback information of the domain data server includes:

[0067] If the feedback information includes data corresponding to the missing page, the data is written into the backplane mirror fast clone, and the mirror index is pointed to the page information corresponding to the fast clone of the missing page;

[0068] If the feedback information indicates that the data corresponding to the missing page is not found in the domain data server, the mirror index is pointed to the page information corresponding to the missing page in the backplane mirror.

[0069] The present invention provides a computer-readable storage medium storing a computer program, wherein the computer program implements the steps of the remote synchronous mirroring method when executed by a processor.

[0070] The present invention provides an electronic device comprising a memory, a processor and a computer program stored in the memory and operable on the processor, wherein the computer program implements the steps of the remote synchronous mirroring method when executed by the processor.

[0071] Example 2:

[0072] The present invention also provides a remote synchronous mirroring system, which can be implemented by executing the process steps of the remote synchronous mirroring method. That is, those skilled in the art can understand the remote synchronous mirroring method as a preferred implementation of the remote synchronous mirroring system.

[0073] The remote synchronous mirroring system provided by the present invention includes: a module M1: dividing the current image into blocks at the source end, and performing a differential operation with the baseboard image in page units to obtain block differential information; a module M2: storing the block differential information in differential data in the form of metadata, and uploading it to a domain data server; a module M3: establishing a rapid clone of the baseboard image at the target end; a module M4: using a mirror index on the target end virtual machine, wherein an empty image is stored in the mirror index; a module M5: when using the mirror at the target end, determining whether there is a missing page, and if so, sending a missing page data request to the domain data server, and modifying the mirror index based on feedback information from the domain data server, while determining whether adjacent pages of the missing page are also missing pages, so as to simultaneously request data of multiple adjacent missing pages; and a module M6: pulling the remaining data into the rapid clone at the target end, and modifying the mirror index.

[0074] The module M2 includes: performing differential operations based on a preset data differential algorithm, where the data differential algorithms include diff, bsDiff, Xdelta, RTPatch, and ExeDiff.

[0075] The module M5 includes: when using the mirror at the target end, determining whether there is a page fault, and if so, sending a page fault data request to the domain data server in a synchronous or asynchronous manner with a high priority, and modifying the mirror index based on feedback information from the domain data server;

[0076] The module M6 includes: pulling the remaining data into the fast clone in a synchronous or asynchronous manner according to the normal priority at the target end, and modifying the mirror index.

[0077] The method of modifying the mirror index based on the feedback information of the domain data server includes: if the feedback information includes data corresponding to the missing page, writing the data into the baseboard mirror quick clone, and pointing the mirror index to the page information corresponding to the quick clone of the missing page; if the feedback information indicates that the data corresponding to the missing page is not found in the domain data server, pointing the mirror index to the page information corresponding to the missing page in the baseboard mirror.

[0078] Those skilled in the art will appreciate that, in addition to implementing the system, device, and various modules provided by the present invention in purely computer-readable program code, it is entirely possible to implement the same program in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, embedded microcontrollers, and the like by logically programming the method steps. Therefore, the system, device, and various modules provided by the present invention can be considered a hardware component, and the modules included therein for implementing various programs can also be considered structures within the hardware component; the modules for implementing various functions can also be considered both software programs for implementing the method and structures within the hardware component.

[0079] The above describes specific embodiments of the present invention. It should be understood that the present invention is not limited to the specific embodiments described above, and those skilled in the art may make various changes or modifications within the scope of the claims, which do not affect the essence of the present invention. The embodiments of this application and the features in the embodiments may be combined with each other in any manner unless there is a conflict.

Claims

1. A remote synchronous mirroring method, characterized in that: include: Step 1: At the source end, the current image is divided into blocks, and a differential operation is performed with the baseboard image in page units to obtain block differential information; Step 2: Save the block difference information in the differential data as metadata and upload it to the domain data server; Step 3: Create a quick clone of the backplane image on the target end; Step 4: Use the image index on the target virtual machine, and store an empty image in the image index; Step 5: When using the mirror on the target side, determine whether there is a missing page. If so, send a missing page data request to the domain data server, and modify the mirror index based on the feedback information of the domain data server. At the same time, determine whether the adjacent pages of the missing page are also missing pages, so as to request the data of multiple adjacent missing pages at the same time. Step 6: Pull the remaining data into the quick clone on the target side and modify the mirror index.

2. The remote synchronous mirroring method according to claim 1, characterized in that: The step 2 includes: performing a differential operation based on a preset data differential algorithm, wherein the data differential algorithm includes diff, bsDiff, Xdelta, RTPatch, and ExeDiff.

3. The remote synchronous mirroring method according to claim 1, characterized in that: The step 5 comprises: when using the mirror at the target end, determining whether there is a missing page, if so, sending a missing page data request to the domain data server in a synchronous or asynchronous manner with a high priority, and modifying the mirror index based on feedback information from the domain data server; The step 6 includes: pulling the remaining data into the fast clone in a synchronous or asynchronous manner according to the normal priority at the target end, and modifying the mirror index.

4. The remote synchronous mirroring method according to any one of claims 1 to 3, characterized in that: The step of modifying the mirror index based on the feedback information from the domain data server includes: If the feedback information includes data corresponding to the missing page, the data is written into the backplane mirror fast clone, and the mirror index is pointed to the page information corresponding to the fast clone of the missing page; If the feedback information indicates that the data corresponding to the missing page is not found in the domain data server, the mirror index is pointed to the page information corresponding to the missing page in the backplane mirror.

5. A remote synchronous mirroring system, characterized in that: include: Module M1: splits the current image into blocks at the source end, and performs differential operations with the baseboard image in page units to obtain block differential information; Module M2: save the block difference information in the differential data as metadata and upload it to the domain data server; Module M3: Create a fast clone of the backplane image on the target end; Module M4: using an image index on the target virtual machine, in which an empty image is stored; Module M5: When using the mirror at the target end, determine whether there is a missing page. If so, send a missing page data request to the domain data server, modify the mirror index based on the feedback information of the domain data server, and determine whether the adjacent pages of the missing page are also missing pages, so as to request the data of multiple adjacent missing pages at the same time; Module M6: Pull the remaining data into the fast clone on the target side and modify the image index.

6. The remote synchronous mirroring system according to claim 5, characterized in that: The module M2 includes: performing a differential operation based on a preset data differential algorithm, and the data differential algorithm includes diff, bsDiff, Xdelta, RTPatch, and ExeDiff.

7. The remote synchronous mirroring system according to claim 5, characterized in that: The module M5 includes: when using the mirror at the target end, determining whether there is a missing page, if so, sending a missing page data request to the domain data server in a synchronous or asynchronous manner with a high priority, and modifying the mirror index based on the feedback information of the domain data server; The module M6 includes: pulling the remaining data into the fast clone in a synchronous or asynchronous manner according to the normal priority at the target end, and modifying the mirror index.

8. The remote synchronous mirroring system according to any one of claims 5 to 7, characterized in that: The step of modifying the mirror index based on the feedback information from the domain data server includes: If the feedback information includes data corresponding to the missing page, the data is written into the backplane mirror fast clone, and the mirror index is pointed to the page information corresponding to the fast clone of the missing page; If the feedback information indicates that the data corresponding to the missing page is not found in the domain data server, the mirror index is pointed to the page information corresponding to the missing page in the backplane mirror.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the remote synchronous mirroring method according to any one of claims 1 to 4 are implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the computer program is executed by a processor, the steps of the remote synchronous mirroring method according to any one of claims 1 to 4 are implemented.

Images