A Continuity Verification Method and System during Data Backup

The method and system for data backup continuity verification address data inconsistency and resource inefficiencies by implementing data block sequencing and index-based association, ensuring efficient and secure data backup processes.

CN120144368BActive Publication Date: 2025-07-15CHONGQING ABBOTT TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510622583.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-05-15
Publication Date
2025-07-15
Estimated Expiration
2045-05-15

AI Technical Summary

Technical Problem

During the data backup process, there are problems such as discontinuity, missing data and high backup costs, especially data backup instability and high cost due to unbalanced bandwidth resource allocation and mismatch in storage resources.

Method used

By splitting the original data in the main server, a data block sequence is generated, and transmitting it to the backup server according to the bandwidth resource allocation results, the data block index is used for association and comparison, and received messages are generated for continuous verification to ensure the integrity and continuity of the backup data.

Benefits of technology

Improves the efficiency and security of data backup, reduces backup time, saves bandwidth resources, reduces backup costs, and improves storage resource utilization through shared idle storage capacity areas.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120144368B_ABST
    Figure CN120144368B_ABST
Patent Text Reader

Abstract

The present application provides a method and system for continuous verification during data backup. The method includes: splitting the original data in the primary server to obtain a sequence of original data blocks; allocating bandwidth resources to the data blocks in the sequence of original data blocks, and transmitting the sequence of original data blocks to the backup server for backup according to the bandwidth resource allocation result. The backup server associates the received data blocks according to the data block index to obtain a sequence of backup data blocks; generating a received message based on the sequence of backup data blocks and feeding it back to the primary server; the primary server parses the received message and compares the sequence of backup data blocks with the sequence of original data blocks according to the parsing result to perform continuous verification. By directly comparing whether the sequence of backup data blocks is the same as the sequence of original data blocks, the present application can determine whether the original data in the backup server is consistent with the primary server in a short time, improving the efficiency of continuous verification during data backup.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical field of data storage, and particularly to a method and system for continuous verification during data backup. Background Art

[0002] With the rapid development of network technology, more and more data is stored in network servers, forming a highly centralized storage of data in the network environment, which greatly simplifies data management. However, at the same time, the security of data is also facing a severe test. Any reason that causes data to be incomplete, damaged or even lost will result in irreparable and immeasurable losses.

[0003] As a data security technology, data disaster recovery (DR) is a means to avoid data loss. Data disaster recovery is a technical system that can ensure the security and continuity of business data by establishing off-site data backup and recovery methods to cope with events such as natural disasters, equipment failures, human errors, and network attacks. However, during the data backup process, problems such as data loss, discontinuity, and hijacking may occur, and the data backup may also be unstable due to issues such as uneven bandwidth resource allocation. In addition, due to the incomplete matching of storage resources during data backup, a large amount of storage resources are idle, increasing the backup cost of enterprises. Summary of the Invention

[0004] In view of the above-mentioned disadvantages of the prior art, the purpose of this application is to provide a method and system for continuous verification during data backup to solve the technical problems existing in the prior art.

[0005] To achieve the above purpose and other related purposes, this application provides a method for continuous verification during data backup, including the following steps:

[0006] In response to a data backup request, split the original data in the primary server to obtain a sequence of original data blocks; wherein, the sequence of original data blocks includes multiple data blocks;

[0007] Allocate bandwidth resources to the data blocks in the sequence of original data blocks;

[0008] According to the bandwidth resource allocation result, transmit the sequence of original data blocks to the backup server for backup, and the backup server associates the received data blocks according to the data block index to obtain a sequence of backup data blocks; wherein, the data block index contains the position information of the data block in the sequence of original data blocks;

[0009] Generate a received message according to the sequence of backup data blocks and feedback the received message to the primary server;

[0010] The master server parses the received message, compares the backup data block sequence with the original data block sequence according to the parsing result of the received message, and verifies the continuity of the data backup result of the original data according to the comparison result; wherein, when the backup data block sequence is the same as the original data block sequence, the data backup result of the original data is continuous; when the backup data block sequence is different from the original data block sequence, the data backup result of the original data is discontinuous.

[0011] Optionally, the process of allocating bandwidth resources to the data blocks in the original data block sequence includes:

[0012] Generate a bandwidth resource allocation matrix based on the data volume of the data block, the memory occupancy rate of the data block, and the data utilization rate of the data block , there is: ; In the formula, represents the data volume of the th data block in the original data block sequence, represents the memory occupancy rate of the th data block in the original data block sequence, represents the data utilization rate of the th data block in the original data block sequence, , represents the total number of data blocks in the original data block sequence, and are positive integers; wherein, the memory occupancy rate of the data block represents the ratio of the running memory capacity occupied by all data in the data block when running in the master server to the total running memory capacity of the master server, and the data utilization rate of the data block represents the ratio of the total number of runs of all data in the data block in the master server to the total number of runs of all data in the original data block sequence in the master server within a preset unit time;

[0013] Normalize each column of the bandwidth resource allocation matrix to obtain a matrix , there is: ; wherein, , , , , , , is a positive integer;

[0014] Calculate the contribution degree of the data volume, the contribution degree of the memory occupancy rate, and the contribution degree of the data utilization rate according to the matrix , there is:

[0015] In the formula, represents the contribution degree of the data volume corresponding to the th data block in the original data block sequence, represents the contribution degree of the memory occupancy rate corresponding to the th data block in the original data block sequence, represents the contribution degree of the data utilization rate corresponding to the th data block in the original data block sequence, is a preset constant;

[0016] Perform bandwidth resource allocation on the data blocks in the original data block sequence according to the contribution degree .

[0017] Optionally, the process of performing bandwidth resource allocation on the data blocks in the original data block sequence further includes:

[0018] Obtain the th communication link node on the communication link corresponding to the primary server and the backup server; where is a natural number;

[0019] According to the total bandwidth resource of the primary server and the backup server , the bandwidth weight of the th communication link node, calculate the bandwidth resource of the th communication link node, there is: ;

[0020] When the th data block in the original data block sequence arrives at the th communication link node, according to the corresponding contribution degree weight , allocate the bandwidth resource of the th communication link node to the th data block; where , ; In the formula, represents the contribution degree weight of the data volume corresponding to the th data block in the original data block sequence, represents the contribution degree weight of the memory occupancy rate corresponding to the th data block in the original data block sequence, represents the contribution degree weight of the data utilization rate corresponding to the th data block in the original data block sequence.

[0021] Optionally, the method further includes:

[0022] Partition the storage space of the backup server according to a pre-determined or real-time data structure to obtain multiple storage capacity areas;

[0023] Express each storage capacity area in terms of column storage capacity and row storage capacity, and calculate the storage utilization rate of the th storage capacity area in the backup server during the th backup time period , there is:

[0024] In the formula, represents the storage utilization rate of the th storage capacity area in the backup server during the th backup time period , is a positive integer; represents the total number of data blocks in the backup data block sequence, and , represents the total number of data blocks in the original data block sequence, and are positive integers; represents the column storage capacity weight corresponding to the th storage capacity area during the th backup time period ; represents the column storage capacity occupied by the th data block in the backup data block sequence in the th storage capacity area during the th backup time period ; represents the column storage capacity of the th storage capacity area during the th backup time period ; represents the row storage capacity weight corresponding to the th storage capacity area during the th backup time period ; represents the row storage capacity occupied by the th data block in the backup data block sequence in the th storage capacity area during the th backup time period ; represents the th storage capacity area during the th backup time period The row storage capacity of , ;

[0025] exist Less than When The backup server in the backup time period Storage capacity area Free storage capacity area ,have: ;in, Indicates The backup server in the backup time period Storage capacity area The preset storage utilization, Indicates The backup server in the backup time period Storage capacity area of idle column storage capacity, Indicates The backup server in the backup time period Storage capacity area Idle row storage capacity;

[0026] Free storage capacity Shared as a shared storage capacity area.

[0027] Optionally, when the backup data block sequence is different from the original data block sequence, the method further includes:

[0028] Obtain data blocks where there are differences between the backup data block sequence and the original data block sequence, and record them as missing data blocks;

[0029] According to the bandwidth resource allocation result of the missing data block, the missing data block is retransmitted to the backup server, and according to the data block index corresponding to the missing data block, the missing data block is embedded into the backup data block sequence to obtain an updated backup data block sequence;

[0030] Generate a retransmission message according to the updated backup data block sequence, and feed back the retransmission message to the primary server;

[0031] Parsing the retransmitted message by the main server, and comparing the updated backup data block sequence with the original data block sequence according to the parsing result of the retransmitted message, and verifying the continuity of the data backup result of the original data according to the comparison result;

[0032] When the updated backup data block sequence is the same as the original data block sequence, the data backup result of the original data is continuous, and the data backup for the current backup time period is aborted;

[0033] When the updated backup data block sequence is different from the original data block sequence, continue to search for missing data blocks for retransmission until the last updated backup data block sequence is the same as the original data block sequence.

[0034] Optionally, the process of splitting the original data in the primary server includes:

[0035] Compare the first original data with the second original data, and determine the different data and the same data between the first original data and the second original data, and perform data splitting based on the different data and / or the same data; wherein, the first original data and the second original data are respectively the original data in the primary server under two adjacent backup time periods;

[0036] Alternatively, obtain the data type of the original data in the server, and split the original data in the primary server according to the data type, so that the data inside each data block in the original data block sequence belongs to the same data type.

[0037] Optionally, the process of splitting the original data in the primary server further includes:

[0038] The electronic data generated by the target user, the target user includes enterprises;

[0039] Obtain the enterprise information of the enterprise, the enterprise information includes: enterprise credit code information, enterprise organization code information and / or enterprise industrial and commercial registration number information;

[0040] Generate an encryption character and a decryption character according to the enterprise information, encrypt the electronic data corresponding to the enterprise by using the encryption character, and perform data splitting on the corresponding encrypted data as the original data in the primary server; and transmit the decryption character to the backup server, and after the backup server receives the data block transmitted by the primary server, decrypt it by using the decryption character.

[0041] Optionally, the method further includes:

[0042] Compress the data blocks in the original data block sequence by using a pre-determined or real-time determined compression method, and transmit the compressed data blocks to the backup server for backup;

[0043] And, after the backup server receives the data blocks transmitted by the primary server, decompress the compressed data blocks according to the decompression method corresponding to the compression method.

[0044] Optionally, the method further includes:

[0045] Divide the servers preset for storing data into a primary server and a backup server, and set the primary server and the backup server at different geographical locations, and the geographical location distance between the primary server and the backup server is greater than or equal to a preset distance;

[0046] Configure the storage space of the primary server, and divide the storage space of the primary server into a fixed storage space and a temporary storage space;

[0047] Add the original data to the fixed storage space for permanent storage, and add the original data to the temporary storage space for temporary caching;

[0048] Compare the original data temporarily cached in the current backup time period with the original data temporarily cached in the previous backup time period in the temporary storage space, and use the original data with differences as the data to be backed up;

[0049] Split the data to be backed up, and add the sequence of original data blocks obtained by data splitting to the temporary storage space for caching;

[0050] Sort and encode all data blocks in the original data block sequence according to the chronological order of data block generation time, and generate a data block index according to the sorting result and the encoding result; and,

[0051] When the backup data block sequence is the same as the original data block sequence, delete the original data temporarily cached in the previous backup time period and the sequence of original data blocks temporarily cached in the current backup time period from the temporary storage space.

[0052] The present application also provides a continuity verification system during data backup, and the system includes:

[0053] A data splitting module, configured to split the original data in the primary server in response to a data backup request to obtain a sequence of original data blocks; wherein, the sequence of original data blocks includes a plurality of data blocks;

[0054] A bandwidth allocation module, configured to allocate bandwidth resources to the data blocks in the sequence of original data blocks;

[0055] A backup transmission module, configured to transmit the original data block sequence to a backup server for backup according to the bandwidth resource allocation result, and associate the received data blocks with the data block index through the backup server to obtain a backup data block sequence; wherein, the data block index includes the position information of the data block in the original data block sequence;

[0056] A message module, configured to generate a received message according to the backup data block sequence and feedback the received message to the main server;

[0057] A continuity verification module, configured to parse the received message through the main server, compare the backup data block sequence with the original data block sequence according to the received message parsing result, and perform continuity verification on the data backup result of the original data according to the comparison result; wherein, when the backup data block sequence is the same as the original data block sequence, the data backup result of the original data is continuous; when the backup data block sequence is different from the original data block sequence, the data backup result of the original data is discontinuous.

[0058] As described above, the present application provides a method and system for continuous verification during data backup, which has the following beneficial effects: The present application splits the original data in the primary server to obtain a sequence of original data blocks; where the sequence of original data blocks includes multiple data blocks; then, bandwidth resources are allocated to the data blocks in the sequence of original data blocks, and according to the bandwidth resource allocation result, the sequence of original data blocks is transmitted to the backup server for backup, and the backup server associates the received data blocks according to the data block index to obtain a sequence of backup data blocks; where the data block index contains the position information of the data block in the sequence of original data blocks; then a received message is generated according to the sequence of backup data blocks and fed back to the primary server; at the same time, the primary server parses the received message and compares the sequence of backup data blocks with the sequence of original data blocks according to the parsing result of the received message, and verifies the continuity of the data backup result of the original data according to the comparison result; when the sequence of backup data blocks is the same as the sequence of original data blocks, the data backup result of the original data is continuous; when the sequence of backup data blocks is different from the sequence of original data blocks, the data backup result of the original data is discontinuous. It can be seen that when continuously verifying the data backup result in the backup server, by splitting the original data into multiple data blocks for backup, compared with directly comparing the original data between the primary server and the backup server, by directly comparing whether the sequence of backup data blocks is the same as the sequence of original data blocks, it is possible to determine whether the original data in the backup server is consistent with the primary server in a shorter time, improving the efficiency of continuous verification during the data backup process. At the same time, when the backup server does not receive all the data blocks in the sequence of original data blocks, only the missing data blocks need to be re-supplemented and transmitted, so there is no need to re-transmit all the original data, which not only reduces the data backup time and improves the data backup efficiency, but also ensures that the backup data in the backup server is complete and continuous. Moreover, the present application transmits the sequence of original data blocks to the backup server for backup according to the bandwidth resource allocation result, which can stably transmit the data blocks to the greatest extent, not only saving the bandwidth resources used by the original data in the primary server during the backup process, but also avoiding problems such as data loss and discontinuity caused by network fluctuations. In addition, by encrypting the data before splitting the data, the present application can increase the security and confidentiality of the data backup process and avoid the risk of information leakage caused by data hijacking. Moreover, by sharing the idle storage capacity area of the backup server as a shared storage capacity area, the present application can not only improve the utilization rate of the storage resources in the backup server, but also further reduce the data backup cost of the enterprise by sharing the idle storage capacity area and charging corresponding fees. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1Schematic flowchart of the continuity verification method during data backup provided by an embodiment of the present application;

[0060] Figure 2 Schematic diagram of data splitting according to data types provided by an embodiment of the present application;

[0061] Figure 3 Schematic diagram of data splitting according to data splitting points provided by an embodiment of the present application;

[0062] Figure 4 Schematic diagram of re - transmitting missing data blocks provided by an embodiment of the present application;

[0063] Figure 5 Schematic diagram of the hardware structure of the continuity verification system during data backup provided by an embodiment of the present application. Detailed implementation manners

[0064] The following uses specific examples to illustrate the implementation manners of the present application. Those skilled in the art can easily understand other advantages and effects of the present application from the content disclosed in this specification. The present application can also be implemented or applied through other different specific implementation manners. Various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that, without conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0065] It should be noted that the diagrams provided in this embodiment only illustrate the basic concept of the present application in a schematic manner. Therefore, only the components related to the present application are shown in the diagrams, rather than being drawn according to the number, shape, and size of the components during actual implementation. The types, quantities, and proportions of the actual components during implementation can be arbitrarily changed, and the component layout type may also be more complex.

[0066] In an exemplary embodiment of the present application, please refer to Figure 1 As shown, a continuity verification method during data backup is provided, including the following steps:

[0067] S110. In response to a data backup request, split the original data in the primary server to obtain an original data block sequence; wherein, the original data block sequence includes multiple data blocks. In some examples, the data backup request can be generated by the primary server when a manager or staff member actively initiates data backup, or can be generated by the primary server when reaching a preset or real - time set backup time period.

[0068] S120. Allocate bandwidth resources to the data blocks in the original data block sequence;

[0069] S130, according to the bandwidth resource allocation result, transmit the original data block sequence to the backup server for backup, and associate the received data blocks by the backup server according to the data block index to obtain the backup data block sequence; wherein, the data block index includes the position information of the data block in the original data block sequence.

[0070] S140, generate a received message according to the backup data block sequence, and feedback the received message to the primary server. In some examples, the received message may be formed by the indexes of all data blocks in the backup data block sequence.

[0071] S150, parse the received message by the primary server, compare the backup data block sequence with the original data block sequence according to the parsing result of the received message, and verify the continuity of the data backup result of the original data according to the comparison result; wherein, when the backup data block sequence is the same as the original data block sequence, the data backup result of the original data is continuous; when the backup data block sequence is different from the original data block sequence, the data backup result of the original data is discontinuous.

[0072] In some exemplary embodiments, the process of data splitting for the original data in the primary server may include: obtaining the data type of the original data in the server, and splitting the original data in the primary server according to the data type, so that the data within each data block in the original data block sequence belongs to the same data type. As an example, Figure 2As shown in the figure, the original data block sequence obtained after splitting the original data S1 includes data blocks K10, K11, K12, and K13. Among them, all the data inside data block K10 belong to the same data type, all the data inside data block K11 belong to the same data type, all the data inside data block K12 belong to the same data type, and all the data inside data block K13 belong to the same data type. Among them, the data types of data blocks K10, K11, K12, and K13 can be the same or different, and the specific situation can be selected according to the actual application scenario, and no specific limitation is made here. For example, when all the data in the original data S1 belong to the same data type, in order to reduce the data transmission volume of the original data S1 during data backup, the original data S1 can be split into data blocks K10, K11, K12, and K13, and the data types of data blocks K10, K11, K12, and K13 are the same. Another example is that when all the data in the original data S1 include four data types, the original data S1 can be split into data blocks K10, K11, K12, and K13, and each of data blocks K10, K11, K12, and K13 corresponds to one data type. Among them, before the main server transfers the data blocks in the original data block sequence to the backup server, it will first feedback the corresponding data splitting method to the backup server so that the backup server can perform data merging after receiving the data blocks. It can be seen from this that the present application splits the original data in the main server according to the data type, and more data splitting schemes can be obtained according to the actual scenario, and the application range is wider.

[0073] In some exemplary embodiments, the process of splitting the original data in the main server may further include: comparing the first original data with the second original data, determining the difference data between the first original data and the second original data, and determining the same data between the first original data and the second original data, and performing data splitting based on the difference data and / or the same data; where the first original data and the second original data are the original data in the main server under two adjacent backup time periods respectively. In this embodiment or other embodiments, the specific duration of the backup time period can be flexibly set by the enterprise according to different backup requirements, and the total duration of a single backup time period needs to meet the requirement that the corresponding data can be completely backed up. As an example, such as Figure 3As shown, the first original data S2 and the second original data S3 belong to the original data in the primary server under two adjacent backup time periods. For example, the first original data S2 can be the original data in the primary server in the second backup time period, and the second original data S3 can be the original data in the primary server in the third backup time period. Specifically, when splitting the data, the first original data S2 and the second original data S3 can be compared first to find the different data between the first original data S2 and the second original data S3, and the same data between the first original data S2 and the second original data S3, and then the data splitting can be performed based on the different data and / or the same data. As Figure 3 shown, the original data block sequence obtained after splitting the first original data S2 includes data blocks K20, K21, K12, and K23. The original data block sequence obtained after splitting the second original data S3 includes data blocks K30, K31, K32, K33, K34, and K35. Among them, the original data contained in data block K20 is the same as that in data block K30, the original data contained in data block K21 is the same as that in data block K31, the original data contained in data block K22 is the same as that in data block K33, and the original data contained in data block K23 is the same as that in data block K34. The original data contained in data blocks K32 and K35 belongs to the different data between the first original data and the second original data. Among them, before the primary server transfers the data blocks in the original data block sequence to the backup server, it will first feedback the corresponding data splitting method to the backup server so that the backup server can perform data merging after receiving the data blocks. Thus, it can be seen that by determining the same data and different data in two adjacent backup time periods, and then performing data splitting based on the different data and / or the same data, since the backup server already has the original data in the previous backup time period, at this time, only the data blocks corresponding to the original data with differences need to be transmitted to the backup server for backup, which can not only back up all the original data through the backup server to ensure the continuity and integrity of the original data after backup; but also save the communication traffic used in the backup process of the original data, reduce the cost of the enterprise in data backup; at the same time, it also speeds up the backup storage efficiency of the original data and shortens the backup storage time of the original data.

[0074] According to the above description, in some exemplary embodiments, the process of splitting the original data in the primary server may further include: generating electronic data generated by a target user, where the target user includes an enterprise; then obtaining the enterprise information of the enterprise, and the enterprise information includes: enterprise credit code information, enterprise organization code information, and / or enterprise industrial and commercial registration number information; generating an encryption character and a decryption character according to the enterprise information, encrypting the electronic data corresponding to the enterprise by using the encryption character, and using the corresponding encrypted data as the original data in the primary server for data splitting; and transmitting the decryption character to the backup server, and after the backup server receives the data block transmitted by the primary server, decrypting it by using the decryption character. As some examples, when generating the encryption character and the decryption character according to the enterprise information, existing encryption and decryption algorithms can be used to complete, and the encryption and decryption algorithms are not specifically limited here. For example, the code log data, software operation data, etc. presented in electronic form during software development by a software enterprise can be encrypted and used as the original data, or the program code data, product parameter data, etc. presented in electronic form during industrial product manufacturing by a manufacturing enterprise can be encrypted and used as the original data, or the financial data, contract data, etc. presented in electronic form by a software enterprise, a manufacturing enterprise, or other enterprises can be encrypted and used as the original data. It can be seen that by encrypting the electronic data generated by the enterprise with the encryption character and then using the corresponding encrypted data as the original data in the primary server for data splitting, it can be ensured that when backing up the electronic data generated by the enterprise, even if there is a communication hijacking or other situations on the communication transmission link, the core data of the enterprise will not be directly leaked, thereby ensuring the data privacy and security of the enterprise during data backup storage. At the same time, by separately setting the encryption character and the decryption character on the primary server and the backup server, the security during data transmission can be further increased. In addition, using the enterprise information to generate the encryption character and the decryption character can ensure the uniqueness of the corresponding encryption character and decryption character and increase the difficulty of password cracking.

[0075] In some exemplary embodiments, the process of allocating bandwidth resources to the data blocks in the original data block sequence may include: generating a bandwidth resource allocation matrix based on the data volume of the data block, the memory occupancy rate of the data block, and the data utilization rate of the data block , there is:

[0076] ; in the formula, represents the data volume of the th data block in the original data block sequence, represents the memory occupancy rate of the th data block in the original data block sequence, represents the data utilization rate of the th data block in the original data block sequence, , represents the total number of data blocks in the original data block sequence, and are positive integers; wherein, the memory occupancy rate of a data block represents the ratio of the running memory capacity occupied by all the data in the data block during operation in the primary server to the total running memory capacity of the primary server, and the data utilization rate of a data block represents the ratio of the total number of runs of all the data in the data block in the primary server within a preset unit time to the total number of runs of all the data in the original data block sequence in the primary server; the preset unit time includes but is not limited to one day, one week, one month, etc.

[0077] Normalize each column of the bandwidth resource allocation matrix to obtain the matrix , and there is: ; wherein, , , , , , , are positive integers;

[0078] Calculate the contribution degree of the data volume, the contribution degree of the memory occupancy rate, and the contribution degree of the data utilization rate according to the matrix , and there is: In the formula, represents the contribution degree of the data volume corresponding to the -th data block in the original data block sequence, represents the contribution degree of the memory occupancy rate corresponding to the -th data block in the original data block sequence, represents the contribution degree of the data utilization rate corresponding to the -th data block in the original data block sequence, is a preset constant;

[0079] Allocate bandwidth resources to the data blocks in the original data block sequence according to the contribution degree .

[0080] It can be seen from this that by calculating the corresponding contribution degrees respectively based on the data volume, the memory occupancy rate, and the data utilization rate of the data blocks in the original data block sequence, and then allocating bandwidth resources to the data blocks in the original data block sequence according to the contribution degree, the allocation can be carried out according to the principle that the higher the contribution degree, the more bandwidth resources, so that when the original data block sequence is transmitted to the backup server for backup according to the bandwidth resource allocation result, the data blocks with high contribution degrees can be preferentially transmitted using limited bandwidth resources and preferentially backed up.

[0081] In some exemplary embodiments, the process of allocating bandwidth resources to data blocks in the original data block sequence may further include: obtaining the th communication link node on the communication link corresponding to the primary server and the backup server; where is a natural number; according to the total bandwidth resources of the primary server and the backup server and the bandwidth weight of the th communication link node , calculate the bandwidth resources of the th communication link node , there is: ; when the th data block in the original data block sequence arrives at the th communication link node, according to the corresponding contribution degree weight , allocate the bandwidth resources of the th communication link node to the th data block; where , ; in the formula, represents the contribution degree weight of the data volume corresponding to the th data block in the original data block sequence, represents the contribution degree weight of the memory occupancy rate corresponding to the th data block in the original data block sequence, represents the contribution degree weight of the data utilization rate corresponding to the th data block in the original data block sequence. It can be seen that allocating the bandwidth resources in the communication link node according to the contribution degree weight of the data blocks in the original data block sequence can not only maximize the utilization of the bandwidth resources in the communication link node, but also enable the data blocks with higher contribution degrees to obtain more bandwidth resources, so that when the original data block sequence is transmitted to the backup server for backup according to the bandwidth resource allocation result, it can preferentially ensure that the data blocks with high contribution degrees can be transmitted and backed up more stably, and the data blocks can be transmitted stably to the greatest extent, avoiding problems such as data loss and discontinuity caused by network fluctuations. At the same time, by allocating the bandwidth resources in the communication link node, it is possible to configure appropriate bandwidth resources for the original data in the primary server during the backup process, avoiding shortages or surpluses of bandwidth resources.

[0082] In some exemplary embodiments, the continuity verification method during data backup may further include: partitioning the storage space of the backup server into multiple storage capacity areas according to a pre-determined or real-time data structure. The data structure may be a linear structure or a non-linear structure. The linear structure includes, but is not limited to, linked lists, stacks, queues, etc., and the non-linear structure includes, but is not limited to, trees, graphs, etc. Then, represent each storage capacity area by column storage capacity and row storage capacity, and calculate the storage utilization rate of the th storage capacity area in the backup server during the th backup time period , there is:

[0083] In the formula, represents the storage utilization rate of the th storage capacity area in the backup server during the th backup time period, is a positive integer; represents the total number of data blocks in the backup data block sequence, and , , represents the total number of data blocks in the original data block sequence, and are positive integers; represents the column storage capacity weight corresponding to the th storage capacity area during the th backup time period; represents the column storage capacity occupied by the th data block in the backup data block sequence in the th storage capacity area during the th backup time period; represents the column storage capacity of the th storage capacity area during the th backup time period; represents the row storage capacity weight corresponding to the th storage capacity area during the th backup time period; represents the row storage capacity occupied by the th data block in the backup data block sequence in the th storage capacity area during the th backup time period; represents the th backup time period, the th data block in the backup data block sequence in the th storage capacity area occupied row storage capacity; represents the th backup time period, the a storage capacity area of the row storage capacity; where , .

[0084] At less than , calculate the idle storage capacity area of the th backup time period in the backup server for the th storage capacity area , there is: ; where ; where represents the preset storage utilization rate of the th backup time period in the backup server for the th storage capacity area , represents the idle column storage capacity of the th backup time period in the backup server for the th storage capacity area , represents the idle row storage capacity of the th backup time period in the backup server for the th storage capacity area ; where the preset storage utilization rate of the storage capacity area The specific value of can be set or selected according to the actual situation. For example, for the th storage capacity area in the backup server , the maximum storage utilization rate of the th storage capacity area can be used as the preset storage utilization rate of the th storage capacity area . Specifically, if the total storage utilization rate of the th storage capacity area is , and the system storage utilization rate to ensure the normal operation of the th storage capacity area is , then the maximum storage utilization rate of the th storage capacity area is .

[0085] Use the idle storage capacity area as a shared storage capacity area for sharing.

[0086] As some examples, for instance, when enterprise E transfers its original data in primary server A to backup server B for backup, and there are multiple idle storage capacity areas in backup server B after completing the relevant data backup, then at this time, enterprise E can use the idle storage capacity areas in backup server B as shared storage capacity areas and share them externally. If enterprise F needs to back up its original data in primary server A1, and the storage space occupied by backing up the original data in server A1 is less than or equal to the storage space corresponding to the idle storage capacity areas in backup server B, then at this time, enterprise F can pay fees to enterprise E, and after enterprise F obtains the backup authorization permission from enterprise E, it can back up its original data in primary server A1 to the idle storage capacity areas in backup server B. Among them, enterprise E and enterprise F can be affiliated companies or non - affiliated companies. For example, enterprise E and enterprise F are two affiliated companies, enterprise E is the parent company, and enterprise F is a subsidiary of enterprise E. In some examples, if there are multiple idle storage capacity areas in backup server B, all the idle storage capacity areas in backup server B can be associated to form corresponding idle storage spaces. Thus, it can be seen that by sharing the idle storage capacity areas of the backup server as shared storage capacity areas, not only can the utilization rate of storage resources in the backup server be improved, but also enterprise E can recover part of the storage resource cost and further reduce the data backup cost of enterprise E by sharing the idle storage capacity areas in backup server B and charging corresponding fees.

[0087] According to the above description, in some exemplary embodiments, when the backup data block sequence is different from the original data block sequence, the continuity verification method during data backup may further include: obtaining the data blocks where the backup data block sequence and the original data block sequence are different, denoted as missing data blocks; according to the bandwidth resource allocation result of the missing data blocks, re - transferring the missing data blocks to the backup server, and embedding the missing data blocks into the backup data block sequence according to the data block indexes corresponding to the missing data blocks to obtain an updated backup data block sequence; generating a re - transmission message according to the updated backup data block sequence and feeding back the re - transmission message to the primary server; parsing the re - transmission message by the primary server, comparing the updated backup data block sequence with the original data block sequence according to the parsing result of the re - transmission message, and verifying the continuity of the data backup result of the original data according to the comparison result; when the updated backup data block sequence is the same as the original data block sequence, the data backup result of the original data is continuous, and the data backup during the current backup time period is aborted; when the updated backup data block sequence is different from the original data block sequence, continue to find the missing data blocks for re - transmission until the last updated backup data block sequence is the same as the original data block sequence. In some examples, the re - transmission message may be formed by the indexes of all data blocks in the updated backup data block sequence. As an example, such asFigure 4 As shown, when the original data block sequence P includes data blocks K40, K41, K42, K43, and K44, and the backup data block sequence P1 includes data blocks K40, K41, K43, and K44, according to the comparison result of the original data block sequence P and the backup data block sequence P1, it can be known that the missing data block in the backup data block sequence P1 is data block K42. At this time, the backup server can generate a retransmission message based on the data block indexes of data blocks K40, K41, K43, and K44 in the backup data block sequence P1, and then feedback the retransmission message to the primary server for parsing. The primary server traverses the data block index corresponding to the missing data block K42 according to the parsing result of the retransmission message, and re-transmits data block K42 to the backup server according to the bandwidth resource allocation result of data block K42, and obtains the updated backup data block sequence, denoted as backup data block sequence P2. At the same time, the backup server generates a retransmission message again based on the data block indexes of data blocks K40, K41, K42, K43, and K44 in the backup data block sequence P1, and then feedbacks the retransmission message to the primary server for parsing again. The primary server traverses the data block index corresponding to the missing data block according to the parsing result of the retransmission message. Since the original data block sequence P is the same as the backup data block sequence P2, the backup data in the backup server is now consistent with the original data in the primary server. At this time, it can be determined that the data backup result of the backup server for the original data is continuous, and the data backup for the current backup time period is terminated, waiting for the primary server to perform data backup for the next backup time period. Thus, when the backup data block sequence is different from the original data block sequence, only the different data blocks need to be found as the missing data blocks, and then the primary server re-transmits the missing data blocks to the backup server. Compared with re-transmitting all data blocks in the current backup time period, it can not only save the communication traffic in the backup process, reduce the enterprise's cost in data backup, but also improve the backup storage efficiency and shorten the backup storage time.

[0088] According to the above description, in some exemplary embodiments, the continuity verification method during data backup may further include: compressing the data blocks in the original data block sequence using a compression method determined in advance or in real time, and transmitting the compressed data blocks to a backup server for backup; and, after the backup server receives the data blocks transmitted by the primary server, decompressing the compressed data blocks according to the decompression method corresponding to the compression method. It can be seen that, compared with directly transmitting uncompressed data blocks, since the storage space occupied by the compressed data blocks is smaller than that before compression, by transmitting the compressed data blocks, not only can the backup storage efficiency be improved and the backup storage time be shortened, but also the storage space occupied by the data blocks on the primary server and / or the backup server during the backup process can be reduced.

[0089] According to the above description, in some exemplary embodiments, the continuity verification method during data backup may further include: dividing the servers pre-set for storing data into a primary server and a backup server, and setting the primary server and the backup server at different geographical locations, and the geographical distance between the primary server and the backup server is greater than or equal to a preset distance; configuring the storage space of the primary server, and dividing the storage space of the primary server into a fixed storage space and a temporary storage space; adding the original data to the fixed storage space for permanent storage, and adding the original data to the temporary storage space for temporary caching; comparing the original data temporarily cached in the current backup time period with the original data temporarily cached in the previous backup time period in the temporary storage space, and using the original data with differences as the data to be backed up; splitting the data to be backed up, and adding the original data block sequence obtained by the data splitting to the temporary storage space for caching; sorting and encoding all the data blocks in the original data block sequence in the order of the data block generation time, and generating a data block index according to the sorting result and the encoding result; and, when the backup data block sequence is the same as the original data block sequence, deleting the original data temporarily cached in the previous backup time period and the original data block sequence temporarily cached in the current backup time period from the temporary storage space.

[0090] As an example, the primary server and the backup server can be of the same type or different types of servers. An enterprise can make corresponding selections according to different backup requirements, which will not be elaborated here in detail. If an enterprise selects different types of servers as the primary server and the backup server, the storage space capacity of the backup server needs to be larger than that of the primary server so that the backup server can fully back up the original data. At the same time, the number of backup servers can be set according to the actual situation. For example, when the primary server and the backup server are of the same type of server, two backup servers can be set, and the geographical distance between these two backup servers is equal to the geographical distance between any one of the backup servers and the primary server. Among them, the preset distance can be set according to the actual situation, and no specific numerical limit is set here. For example, the preset distance can be set to 50 kilometers, or it can be set to 200 kilometers, or it can also be set to 500 kilometers. For example, for the primary server A, there is a corresponding backup server B, and under the condition that the preset distance is set to 50 kilometers, the geographical distance between the primary server A and the backup server B is 70 kilometers.

[0091] As another example, the fixed storage space and the temporary storage space in the primary server can be set according to the actual situation, which will not be specifically limited here. For example, 50% of the storage space of the primary server can be used as the fixed storage space, and the other 50% of the storage space can be used as the temporary storage space; or 70% of the storage space of the primary server can be used as the fixed storage space, and the other 30% of the storage space can be used as the temporary storage space; or 85% of the storage space of the primary server can be used as the fixed storage space, and the other 15% of the storage space can be used as the temporary storage space. In addition, when configuring the storage space of the primary server, it can be configured once or multiple times. For example, when the fixed storage space is not enough, but there is idle space in the temporary storage space, the storage space of the primary server can be configured again to reduce the capacity of the temporary storage space and increase the capacity of the fixed storage space. Similarly, when there is idle space in the fixed storage space, but the temporary storage space is not enough, the storage space of the primary server can be configured again to reduce the capacity of the fixed storage space and increase the capacity of the temporary storage space. Therefore, the storage space allocation and the number of configurations when configuring the storage space of the primary server can be determined according to the actual situation, and will not be elaborated here.

[0092] It can be seen that by using the primary server to permanently store the electronic data generated by an enterprise during the production and operation process, and using the backup server for backup storage at the same time, dual storage of the original data can be achieved, strengthening the enterprise's data storage work. By setting the primary server and the backup server in different geographical locations, the probability of problems occurring simultaneously in the primary server and the backup server can be reduced; and since the backup server makes a complete backup of the original data, even if data loss or inaccessibility occurs after a failure of the primary server, the enterprise can recover the data through the backup server, thus not affecting the normal operation of the enterprise. At the same time, during the backup transmission process, only the original data that differs between the current backup time period and the previous backup time period is used as the data to be backed up. Then, the data to be backed up is split, and the data blocks corresponding to the data to be backed up are transmitted to the backup server. Compared with directly transmitting all the original data or the data blocks of all the original data, this method can not only ensure that the backup server can back up all the original data, but also save the communication traffic used by the original data during the backup process, reduce the enterprise's cost in data backup, speed up the backup storage efficiency of the original data, and shorten the backup storage time of the original data. And after the primary server completes the backup storage of the original data for the current backup time period, the original data temporarily cached for the current backup time period and the data blocks obtained during the data splitting for the previous backup time period can also be deleted from the temporary storage space, so as to release the temporary storage space of the primary server and reduce the occupation of the storage space of the primary server due to the data backup task. Among them, data such as the original data block sequence and the contribution degree of the data blocks in the original data block sequence and their processing processes can be completed in the temporary storage space. Therefore, after the primary server completes the backup storage of the original data for the current backup time period, the original data block sequence, the contribution degree of the data blocks in the original data block sequence, etc. can also be synchronously deleted.

[0093] In summary, the present application provides a method for continuous verification during data backup. By splitting the original data in the primary server, an original data block sequence is obtained; where the original data block sequence includes multiple data blocks; then, bandwidth resources are allocated to the data blocks in the original data block sequence, and according to the bandwidth resource allocation result, the original data block sequence is transmitted to the backup server for backup, and the backup server associates the received data blocks according to the data block index to obtain a backup data block sequence; where the data block index contains the position information of the data block in the original data block sequence; then, a reception message is generated according to the backup data block sequence and fed back to the primary server; at the same time, the primary server parses the reception message, and according to the reception message parsing result, the backup data block sequence is compared with the original data block sequence, and the continuity of the data backup result of the original data is verified according to the comparison result; when the backup data block sequence is the same as the original data block sequence, the data backup result of the original data is continuous; when the backup data block sequence is different from the original data block sequence, the data backup result of the original data is discontinuous. It can be seen that when continuously verifying the data backup result in the backup server, by splitting the original data into multiple data blocks for backup, compared with directly comparing the original data between the primary server and the backup server, by directly comparing whether the backup data block sequence is the same as the original data block sequence, it is possible to determine whether the original data in the backup server is consistent with the primary server in a shorter time, improving the efficiency of continuous verification during the data backup process. At the same time, when the backup server does not receive all the data blocks in the original data block sequence, only the missing data blocks need to be re-supplemented and transmitted, so there is no need to re-transmit all the original data, which not only reduces the data backup time and improves the data backup efficiency, but also ensures that the backup data in the backup server is complete and continuous. Moreover, according to the bandwidth resource allocation result, the original data block sequence is transmitted to the backup server for backup, which can stably transmit the data blocks to the greatest extent, not only saving the bandwidth resources used by the original data in the primary server during backup, but also avoiding problems such as data loss and discontinuity caused by network fluctuations. In addition, by encrypting the data before splitting it, the security and confidentiality of the data backup process can be increased, avoiding the risk of information leakage when data hijacking occurs. Moreover, by using the idle storage capacity area of the backup server as a shared storage capacity area for sharing, not only can the utilization rate of the storage resources in the backup server be improved, but also enterprises can further reduce the data backup cost of the enterprise by sharing the idle storage capacity area and charging corresponding fees.

[0094] In another exemplary embodiment of the present application, as Figure 5 shown, a system for continuous verification during data backup is further provided, including:

[0095] A data splitting module 510, configured to split the original data in the primary server in response to a data backup request, so as to obtain a sequence of original data blocks; wherein, the sequence of original data blocks includes a plurality of data blocks;

[0096] A bandwidth allocation module 520, configured to allocate bandwidth resources to the data blocks in the sequence of original data blocks;

[0097] A backup transmission module 530, configured to transmit the sequence of original data blocks to the backup server for backup according to the bandwidth resource allocation result, and the backup server associates the received data blocks according to the data block index to obtain a sequence of backup data blocks; wherein, the data block index includes the position information of the data block in the sequence of original data blocks;

[0098] A message module 540, configured to generate a received message according to the sequence of backup data blocks and feedback the received message to the primary server;

[0099] A continuity verification module 550, configured to parse the received message through the primary server, compare the sequence of backup data blocks with the sequence of original data blocks according to the parsing result of the received message, and perform continuity verification on the data backup result of the original data according to the comparison result; wherein, when the sequence of backup data blocks is the same as the sequence of original data blocks, the data backup result of the original data is continuous; when the sequence of backup data blocks is different from the sequence of original data blocks, the data backup result of the original data is discontinuous.

[0100] It can be seen that when continuously verifying the data backup result in the backup server, the system splits the original data into multiple data blocks for backup. Compared with directly comparing the original data between the primary server and the backup server, by directly comparing whether the sequence of backup data blocks is the same as the sequence of original data blocks, it is possible to determine whether the original data in the backup server is consistent with the primary server in a shorter time, improving the efficiency of continuity verification during the data backup process. At the same time, when the backup server does not receive all the data blocks in the sequence of original data blocks, only the missing data blocks need to be re-supplemented and transmitted, so that it is not necessary to re-transmit all the original data, which not only reduces the data backup time and improves the data backup efficiency, but also ensures that the backup data in the backup server is complete and continuous. Moreover, the system transmits the sequence of original data blocks to the backup server for backup according to the bandwidth resource allocation result, which can stably transmit the data blocks to the greatest extent. It can not only save the bandwidth resources used by the original data in the primary server during the backup process, but also avoid problems such as data loss and discontinuity caused by network fluctuations.

[0101] It should be noted that the continuity verification system for data backup provided in the above embodiments and the continuity verification method for data backup provided in the above embodiments belong to the same concept. The specific manner of performing operations in the continuity verification method for data backup has been described in detail in some of the above embodiments, and will not be elaborated here. In practical applications, the continuity verification system for data backup provided in the above embodiments can allocate the above functions to different functional modules as needed, that is, divide the internal structure of the system into different functional modules, and then complete all or part of the functions described above through some corresponding embodiments of the continuity verification method for data backup. There is no limitation here. In addition, for the specific application process and technical effects of the continuity verification system for data backup provided in the above embodiments, refer to the corresponding embodiments of the continuity verification method for data backup above, and will not be elaborated here either.

[0102] The above embodiments are only illustrative of the principles and effects of the present application, and are not used to limit the present application. Any person familiar with this technology can modify or change the above embodiments without departing from the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by those with ordinary knowledge in the technical field without departing from the spirit and technical ideas disclosed in the present application should still be covered by the claims of the present application.

[0103] It can be understood that although the terms first, second, etc. may be used to describe the original data in the embodiments of the present application, these terms are only used to distinguish the original data from each other. For example, without departing from the scope of the embodiments of the present application, the first original data may also be referred to as the second original data, and similarly, the second original data may also be referred to as the first original data.

Claims

1. A method for continuous verification during data backup, characterized in that The method includes the following steps: In response to a data backup request, splitting the original data in the primary server to obtain a sequence of original data blocks; wherein, the sequence of original data blocks includes a plurality of data blocks; Allocating bandwidth resources to the data blocks in the sequence of original data blocks; According to the bandwidth resource allocation result, transmitting the sequence of original data blocks to the backup server for backup, and associating the received data blocks by the backup server according to the data block index to obtain a sequence of backup data blocks; wherein, the data block index includes the position information of the data block in the sequence of original data blocks; Generating a reception message according to the sequence of backup data blocks, and feeding back the reception message to the primary server; Parsing the reception message by the primary server, comparing the sequence of backup data blocks with the sequence of original data blocks according to the reception message parsing result, and verifying the continuity of the data backup result of the original data according to the comparison result; wherein, when the sequence of backup data blocks is the same as the sequence of original data blocks, the data backup result of the original data is continuous; when the sequence of backup data blocks is different from the sequence of original data blocks, the data backup result of the original data is discontinuous; Wherein, the process of allocating bandwidth resources to the data blocks in the sequence of original data blocks includes: Generate a bandwidth resource allocation matrix based on the data volume of the data block, the memory occupancy rate of the data block, and the data utilization rate of the data block , there is: ; In the formula, represents the data volume of the th data block in the original data block sequence, represents the memory occupancy rate of the th data block in the original data block sequence, represents the data utilization rate of the th data block in the original data block sequence, , represents the total number of data blocks in the original data block sequence, and are positive integers; where the memory occupancy rate of a data block represents the ratio of the running memory capacity occupied by all data in the data block when running on the main server to the total running memory capacity of the main server, and the data utilization rate of a data block represents the ratio of the total number of runs of all data in the data block on the main server within a preset unit time to the total number of runs of all data in the original data block sequence on the main server; Normalize each column of the bandwidth resource allocation matrix to obtain matrix , and we have: ; Among them, , , , , , , are positive integers; According to the matrix Calculate the contribution degree of data volume, the contribution degree of memory occupancy rate, and the contribution degree of data utilization rate, and there is:[[]] In the formula, represents the contribution degree of the data volume corresponding to the th data block in the original data block sequence, represents the contribution degree of the memory occupancy corresponding to the th data block in the original data block sequence, represents the contribution degree of the data utilization rate corresponding to the th data block in the original data block sequence, is a preset constant; According to the contribution degree Perform bandwidth resource allocation on the data blocks in the original data block sequence.

2. The continuity verification method during data backup according to claim 1, wherein The process of allocating bandwidth resources to the data blocks in the sequence of original data blocks further includes: Obtain the th communication link node on the corresponding communication link between the primary server and the backup server; where is a natural number; According to the total bandwidth resources of the master server and the backup server and the bandwidth weight of the th communication link node , calculate the bandwidth resources of the th communication link node , there is: ; When the th data block in the original data block sequence arrives at the th communication link node, according to the corresponding contribution degree weight , allocate the bandwidth resource of the th communication link node to the th data block; where , , ; In the formula, represents the contribution degree weight of the data volume corresponding to the th data block in the original data block sequence, represents the contribution degree weight of the memory occupancy rate corresponding to the th data block in the original data block sequence, represents the contribution degree weight of the data utilization rate corresponding to the th data block in the original data block sequence.

3. The continuity verification method during data backup according to claim 1, characterized in that The method further includes: Partitioning the storage space of the backup server according to a pre-determined or real-time determined data structure to obtain a plurality of storage capacity areas; Each storage capacity area is represented by column storage capacity and row storage capacity, and the storage utilization rate of the th storage capacity area in the backup server under the th backup time period is calculated. There is: ​ In the formula, represents the th storage utilization rate of the th storage capacity area in the backup server under the th backup time period, is a positive integer; represents the total number of data blocks in the backup data block sequence, and , represents the total number of data blocks in the original data block sequence, and are positive integers; represents the th column storage capacity weight corresponding to the th storage capacity area under the th backup time period; represents the th column storage capacity occupied by the th data block in the backup data block sequence in the th storage capacity area under the th backup time period; represents the th column storage capacity of the th storage capacity area under the th backup time period; represents the th row storage capacity weight corresponding to the th storage capacity area under the th backup time period; represents the th row storage capacity occupied by the th data block in the backup data block sequence in the th storage capacity area under the th backup time period; represents the th row storage capacity of the th storage capacity area under the th backup time period; where , ; When less than , calculate the unused storage capacity of the th storage capacity area in the backup server during the th backup time period, and there is: ; where , represents the preset storage utilization rate of the th storage capacity area in the backup server during the th backup time period, represents the unused column storage capacity of the th storage capacity area in the backup server during the th backup time period, represents the unused row storage capacity of the th storage capacity area in the backup server during the th backup time period, ; represents the unused row storage capacity of the th storage capacity area in the backup server during the th backup time period, . Share the idle storage capacity area as a shared storage capacity area.

4. The continuity verification method during data backup according to any one of claims 1 to 3, characterized in that When the sequence of backup data blocks is different from the sequence of original data blocks, the method further includes: Obtaining the data blocks where the sequence of backup data blocks and the sequence of original data blocks are different, denoted as missing data blocks; According to the bandwidth resource allocation result of the missing data blocks, re-transmitting the missing data blocks to the backup server, and embedding the missing data blocks into the sequence of backup data blocks according to the data block index corresponding to the missing data blocks to obtain an updated sequence of backup data blocks; Generating a retransmission message according to the updated sequence of backup data blocks, and feeding back the retransmission message to the primary server; Parsing the retransmission message by the primary server, comparing the updated sequence of backup data blocks with the sequence of original data blocks according to the retransmission message parsing result, and verifying the continuity of the data backup result of the original data according to the comparison result; When the updated sequence of backup data blocks is the same as the sequence of original data blocks, the data backup result of the original data is continuous, and the data backup in the current backup time period is aborted; When the updated sequence of backup data blocks is different from the sequence of original data blocks, continue to find the missing data blocks for re-transmission until the last updated sequence of backup data blocks is the same as the sequence of original data blocks.

5. The method for continuous verification during data backup according to any one of claims 1 to 3, characterized in that, The process of splitting the original data in the primary server includes: Compare the first original data with the second original data, and determine the difference data and identical data between the first original data and the second original data, and perform data splitting based on the difference data and / or the identical data; wherein, the first original data and the second original data are respectively the original data in the main server under two adjacent backup time periods. Alternatively, obtain the data type of the original data in the server, and perform data splitting on the original data in the main server according to the data type, so that the data within each data block in the original data block sequence belongs to the same data type.

6. The continuity verification method during data backup according to any one of claims 1 to 3, characterized in that The process of performing data splitting on the original data in the main server further includes: The electronic data generated by the target user, where the target user includes enterprises. Obtain the enterprise information of the enterprise, where the enterprise information includes: enterprise credit code information, enterprise organization code information, and / or enterprise industrial and commercial registration number information. Generate an encryption character and a decryption character according to the enterprise information, use the encryption character to encrypt the electronic data corresponding to the enterprise, and use the corresponding encrypted data as the original data in the main server for data splitting; and transmit the decryption character to the backup server, and after the backup server receives the data block transmitted by the main server, use the decryption character for decryption.

7. The continuity verification method during data backup according to claim 1, wherein The method further includes: Use a pre-determined or real-time determined compression method to compress the data blocks in the original data block sequence, and transmit the compressed data blocks to the backup server for backup; And, after the backup server receives the data blocks transmitted by the main server, decompress the compressed data blocks according to the decompression method corresponding to the compression method.

8. The continuity verification method during data backup according to claim 1, characterized in that The method further includes: Divide the servers pre-set for storing data into a main server and a backup server, and set the main server and the backup server at different geographical locations, and the geographical location distance between the main server and the backup server is greater than or equal to a preset distance; Configure the storage space of the main server, and divide the storage space of the main server into a fixed storage space and a temporary storage space; Add the original data to the fixed storage space for permanent storage, and add the original data to the temporary storage space for temporary caching; Compare the original data temporarily cached in the current backup time period with the original data temporarily cached in the previous backup time period in the temporary storage space, and use the original data with differences as the data to be backed up; Perform data splitting on the data to be backed up, and add the original data block sequence obtained by the data splitting to the temporary storage space for caching; Sort and encode all the data blocks in the original data block sequence in the order of the generation time of the data blocks, and generate a data block index according to the sorting result and the encoding result; and When the backup data block sequence is the same as the original data block sequence, delete the original data temporarily cached in the previous backup time period and the original data block sequence temporarily cached in the current backup time period from the temporary storage space.

9. A continuity verification system during data backup, characterized in that, The system includes: A data splitting module, configured to split the original data in the main server in response to a data backup request to obtain an original data block sequence; wherein the original data block sequence includes a plurality of data blocks; A bandwidth allocation module, configured to allocate bandwidth resources to the data blocks in the original data block sequence; A backup transmission module, configured to transmit the original data block sequence to the backup server for backup according to the bandwidth resource allocation result, and associate the received data blocks by the backup server according to the data block index to obtain a backup data block sequence; wherein the data block index includes the position information of the data block in the original data block sequence; A message module, configured to generate a received message according to the backup data block sequence and feedback the received message to the main server; A continuity verification module, configured to parse the received message by the main server, compare the backup data block sequence with the original data block sequence according to the received message parsing result, and verify the continuity of the data backup result of the original data according to the comparison result; wherein when the backup data block sequence is the same as the original data block sequence, the data backup result of the original data is continuous; when the backup data block sequence is different from the original data block sequence, the data backup result of the original data is discontinuous; Wherein, the process of the bandwidth allocation module allocating bandwidth resources to the data blocks in the original data block sequence includes: Generate a bandwidth resource allocation matrix based on the data volume of a data block, the memory occupancy rate of the data block, and the data utilization rate of the data block , there is: ; In the formula, represents the data volume of the th data block in the original data block sequence, represents the memory occupancy rate of the th data block in the original data block sequence, represents the data utilization rate of the th data block in the original data block sequence, , represents the total number of data blocks in the original data block sequence, and are positive integers; wherein, the memory occupancy rate of a data block represents the ratio of the running memory capacity occupied by all data in the data block during operation in the main server to the total running memory capacity of the main server, and the data utilization rate of a data block represents the ratio of the total number of runs of all data in the data block in the main server within a preset unit time to the total number of runs of all data in the original data block sequence in the main server; Normalize each column of the bandwidth resource allocation matrix to obtain a matrix , and we have: ; Among them, , , , , , , are positive integers; According to the matrix Calculate the contribution degrees of the data volume, memory occupancy rate, and data utilization rate, and we have: In the formula, represents the contribution degree of the data volume corresponding to the th data block in the original data block sequence, represents the contribution degree of the memory occupancy rate corresponding to the th data block in the original data block sequence, represents the contribution degree of the data utilization rate corresponding to the th data block in the original data block sequence, is a preset constant; According to the contribution degree Perform bandwidth resource allocation on the data blocks in the original data block sequence.

Citation Information

Patent Citations

  • Data center network bandwidth allocation and flow optimization method based on space game

    CN119094475A

  • Data concentrated backup method, reduction method and its system

    CN1791095A