Cloud data center server data backup method and related equipment

By extracting hot data from user's historical cloud data, determining the backup reference block and sliding backup window, and establishing a backup reference library, the adaptive backup of the cloud data center server is realized, the problem of data backup burden is solved, and storage efficiency and data are improved Recovery speed.

CN119396621AActive Publication Date: 2025-02-07GUANGZHOU HAOTE ENERGY SAVING & ENVIRONMENTAL PROTECTION TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411193504.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2025-02-07
Estimated Expiration
2044-08-28

AI Technical Summary

Technical Problem

As the data generated by users increases, the data backup demand for cloud data center servers also increases, and the prior art is difficult to achieve adaptive backups to each user, resulting in increased storage burden.

Method used

By obtaining the historical cloud data of the target user, extracting hot data, determining the backup reference block and sliding backup window, dividing the sliding backup interval, updating the backup reference block until a matching interval is found, a backup reference library is established, and adaptive backup is realized.

Benefits of technology

It realizes adaptive backup of cloud data generated by users, reduces the data backup burden of cloud data center servers, and improves storage efficiency and data recovery speed.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119396621A_ABST
    Figure CN119396621A_ABST
Patent Text Reader

Abstract

The invention provides a cloud data center server data backup method and related equipment, and the method comprises the steps: determining a backup reference block and a sliding backup window of to-be-backed-up data, dividing the sliding backup window into a plurality of sliding backup intervals, taking the sliding backup interval which is the same as the backup reference block as a backup transition window, and carrying out the backup of the to-be-backed-up data. Determining a self-adaptive backup ratio according to the sliding backup window and the backup transition window, and updating the backup reference blocks to obtain a plurality of backup reference blocks, a plurality of backup transition windows and a plurality of self-adaptive backup ratios; and establishing a backup reference library of the data to be backed up according to all the backup reference blocks, all the backup transition windows and all the adaptive backup ratios, and when a target user generates new cloud data, performing adaptive backup on the new cloud data based on the backup reference library. By adopting the scheme of the invention, adaptive backup can be carried out on the cloud data generated by the user, and the data backup burden of the cloud data center server is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of data backup, and in particular to a cloud data center server data backup method and related equipment. Background Art

[0002] Data backup refers to copying data from one location to another location or media to prevent data loss, damage, or accidental deletion. When performing data backup, the source data is copied and stored in one or more backup targets to provide a backup copy of the source data. The backup target can be a local storage device (such as a hard drive, tape library, etc.) or a cloud storage service.

[0003] Cloud data center server data refers to various data stored on cloud data center servers. A cloud data center is a centralized computing resource pool consisting of large servers and network equipment for storing, processing, and managing large amounts of data. The data stored in a cloud data center includes: private files of individual users, applications, databases, media files, log records, sensor data, etc. of corporate users. In the prior art, cloud data center server data backup is a key data management measure. However, as the data generated by users continues to increase, the storage space required for backup data also increases dramatically. If, as in the past, a unified backup solution is used to back up the data stored by all users of the cloud data center server, and adaptive backup cannot be flexibly performed for each user, the storage burden of the cloud data center server will be aggravated. Therefore, how to adaptively back up the cloud data generated by users and reduce the data backup burden of cloud data center servers has become a problem faced by the industry. Summary of the invention

[0004] Based on this, the present application provides a cloud data center server data backup method and related equipment for adaptively backing up cloud data generated by users.

[0005] In a first aspect, the present application provides a cloud data center server data backup method, comprising the following steps:

[0006] Obtain the historical cloud data of the target user in the cloud service center, extract the hot data in the historical cloud data, and obtain the data to be backed up;

[0007] Determining a backup reference block and a sliding backup window for the data to be backed up;

[0008] Dividing the sliding backup window into a plurality of sliding backup intervals, and determining whether one of the plurality of sliding backup intervals is the same as the backup reference block;

[0009] If none of the multiple sliding backup intervals is identical to the backup reference block, updating the backup reference block until one of the multiple sliding backup intervals is found to be identical to the updated backup reference block;

[0010] If one of the multiple sliding backup intervals is the same as the backup reference block, the sliding backup interval that is the same as the backup reference block is used as a backup transition window, and an adaptive backup ratio when backing up data corresponding to the backup transition window is determined according to the sliding backup window and the backup transition window; the backup reference block is continuously updated until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining multiple backup reference blocks, multiple backup transition windows, and multiple adaptive backup ratios;

[0011] A backup reference library of the data to be backed up is established by all backup reference blocks, all backup transition windows and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

[0012] In some embodiments, extracting hot data from the historical cloud data to obtain the data to be backed up specifically includes:

[0013] Obtain the target user's access records in the cloud data center;

[0014] Perform data analysis on target users’ access records in the cloud data center;

[0015] Dividing the historical cloud data into cold data and hot data according to the result of data analysis;

[0016] Extract the divided hot data to obtain the data to be backed up;

[0017] The cold data is stored separately and a backup library of the cold data is established.

[0018] In some embodiments, establishing the backup repository of the cold data specifically includes:

[0019] Setting a life cycle of the cold data according to a value threshold of the cold data;

[0020] configuring a storage medium for the cold data according to characteristics of the cold data;

[0021] Archiving the cold data according to a storage cost threshold of the cold data;

[0022] A backup library for the cold data is established according to the life management cycle, the configured storage medium, and the archiving processing method.

[0023] In some embodiments, updating the backup reference block specifically includes:

[0024] If none of the plurality of sliding backup intervals is the same as the backup reference block, the size of the initial reference capacity in the backup reference block is reduced by one data unit in a sequence from the back to the front, to complete the update;

[0025] Searching again, if none of the multiple sliding backup intervals is the same as the updated backup reference block, subtracting one data unit from the size of the initial reference capacity in the updated backup reference block in a backward order to complete the next update;

[0026] The same process is repeated until a sliding backup interval is found that is the same as the updated backup reference block.

[0027] In some embodiments, the sliding backup window is composed of hot data to be backed up and the storage capacity of the corresponding sliding window.

[0028] In some embodiments, a backup reference library of the data to be backed up is established by all backup reference blocks, all backup transition windows, and all adaptive backup ratios. When a target user generates new cloud data, adaptively backing up the new cloud data based on the backup reference library specifically includes:

[0029] A backup reference block library is established from all the backup reference blocks, and the position of each transition sliding backup interval that is the same as the backup reference block is marked;

[0030] A backup reference block library is established from all the backup reference blocks, and the position of each backup transition window that is the same as the backup reference block is marked;

[0031] Establishing data guidance relationships between all backup reference blocks and corresponding backup transition windows, and establishing a data guidance library based on all data guidance relationships;

[0032] A backup reference library of the data to be backed up is established according to the data guide library, the backup reference block library and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

[0033] In some embodiments, establishing data reference relationships between all backup reference blocks and corresponding backup transition windows, and establishing a data reference library from all data reference relationships specifically includes:

[0034] For each backup reference block, determining positions of all backup transition windows identical to the backup reference block in the sliding backup window;

[0035] Determine the position range of the backup reference block in the sliding backup window according to the positions of all the backup transition windows;

[0036] Generate a data pointer entry according to the identifier of the backup reference block and the position range of the backup reference block in the sliding backup window, wherein the data pointer entry is the data pointer relationship;

[0037] The generated data guidance entry is added to the data guidance library, thereby obtaining the data guidance library.

[0038] In a second aspect, the present application provides a cloud data center server data backup system, including:

[0039] An acquisition module is used to acquire the historical cloud data of the target user in the cloud service center, extract hot data from the historical cloud data, and obtain the data to be backed up;

[0040] A processing module, used for determining a backup reference block and a sliding backup window of the data to be backed up;

[0041] a processing module, configured to divide the sliding backup window into a plurality of sliding backup intervals, and determine whether one of the plurality of sliding backup intervals is the same as the backup reference block;

[0042] a processing module, configured to update the backup reference block if none of the plurality of sliding backup intervals is identical to the backup reference block, until a sliding backup interval among the plurality of sliding backup intervals is found to be identical to the updated backup reference block;

[0043] A processing module, configured to, if one of the plurality of sliding backup intervals is identical to the backup reference block, use the sliding backup interval identical to the backup reference block as a backup transition window, determine an adaptive backup ratio when backing up data corresponding to the backup transition window according to the sliding backup window and the backup transition window; continue to update the backup reference block until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining a plurality of backup reference blocks, a plurality of backup transition windows, and a plurality of adaptive backup ratios;

[0044] The execution module is used to establish a backup reference library of the data to be backed up based on all backup reference blocks, all backup transition windows and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

[0045] In a third aspect, the present application provides a computer device including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above-mentioned cloud data center server data backup method when executing the computer program.

[0046] In a fourth aspect, the present application provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the above-mentioned cloud data center server data backup method.

[0047] The technical solution provided by the embodiments disclosed in this application has the following beneficial effects:

[0048] In the cloud data center server data backup method and related equipment provided by the present application, the historical cloud data of the target user in the cloud service center is first obtained, and the hot data in the historical cloud data is extracted to obtain the data to be backed up; the backup reference block and the sliding backup window of the data to be backed up are determined; the sliding backup window is divided into multiple sliding backup intervals, and it is determined whether there is a sliding backup interval in the multiple sliding backup intervals that is the same as the backup reference block; if none of the multiple sliding backup intervals is the same as the backup reference block, the backup reference block is updated until one of the multiple sliding backup intervals is found to be the same as the updated backup reference block; if If there is one that is identical to the backup reference block, the sliding backup interval that is identical to the backup reference block is used as the backup transition window, and the adaptive backup ratio when backing up the data corresponding to the backup transition window is determined according to the sliding backup window and the backup transition window; the backup reference block is continuously updated until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining multiple backup reference blocks, multiple backup transition windows and multiple adaptive backup ratios; a backup reference library of the data to be backed up is established by all the backup reference blocks, all the backup transition windows and all the adaptive backup ratios, and when the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

[0049] It can be seen that in the present application, a backup reference library of the data to be backed up is established through all backup reference blocks, all backup transition windows and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library; wherein, firstly, a unique identifier is assigned to each backup reference block, and a backup reference block library is established based on all backup reference blocks and corresponding identifiers. Establishing a backup reference block library can make better use of storage space; secondly, for each backup reference block, the positions of all backup transition windows identical to the backup reference block in the sliding backup window are determined; then, the position range of the backup reference block in the sliding backup window is determined based on the positions of all backup transition windows, and a data guide entry is generated based on the identifier of the backup reference block and the position range of its backup reference block in the sliding backup window (the data guide entry is the data guide relationship), and then the generated data guide entry is added to the data guide library to obtain the data guide library. , by referencing at different locations through the guidance relationship, repeated data blocks only need to be stored once, without the need for repeated storage, and data can be quickly located and restored, thereby improving data access efficiency; finally, the data guidance relationship in the data guidance library, the backup reference block in the backup reference block library, and the corresponding identifier are used as references for backing up new data, and corresponding codes are generated. When the user needs to restore the data, data restoration is performed based on the corresponding code, the data guidance relationship in the data guidance library, the backup reference block in the backup reference block library, and the corresponding identifier. For each backup reference block in the backup reference block library, the adaptive backup ratio of the backup reference block in the restored data is calculated. If the adaptive backup ratio of the backup reference block in the restored data is equal to the initial adaptive backup ratio of the backup reference block, the restored data is sent to the target user. In summary, adaptive backup of cloud data generated by users can be achieved, reducing the data backup burden of cloud data center servers. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 A flowchart of a cloud data center server data backup method in some embodiments of the present application;

[0051] Figure 2 A schematic diagram of a process for establishing a data guidance library in some embodiments of the present application;

[0052] Figure 3 This is a structural block diagram of a cloud data center server data backup system in some embodiments of the present application;

[0053] Figure 4 This is a diagram of the internal structure of a computer device in some embodiments of the present application. DETAILED DESCRIPTION

[0054] The core of the present application is to obtain the historical cloud data of the target user in the cloud service center, extract the hot data in the historical cloud data, obtain the data to be backed up, determine the backup reference block and the sliding backup window of the data to be backed up, divide the sliding backup window into multiple sliding backup intervals, and determine whether there is a sliding backup interval in the multiple sliding backup intervals that is the same as the backup reference block. If none of the multiple sliding backup intervals is the same as the backup reference block, the backup reference block is updated until one of the multiple sliding backup intervals is found to be the same as the updated backup reference block. If one of the multiple sliding backup intervals is the same as the backup reference block, the sliding backup area that is the same as the backup reference block is updated. The time interval is used as a backup transition window, and an adaptive backup ratio when backing up data corresponding to the backup transition window is determined according to the sliding backup window and the backup transition window; the backup reference block is continuously updated until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining multiple backup reference blocks, multiple backup transition windows and multiple adaptive backup ratios, and a backup reference library of the data to be backed up is established by all the backup reference blocks, all the backup transition windows and all the adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library. In summary, the cloud data generated by the user can be adaptively backed up, thereby reducing the data backup burden of the cloud data center server.

[0055] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods. Figure 1 , which is an exemplary flow chart of a cloud data center server data backup method according to some embodiments of the present application, and the cloud data center server data backup method 100 mainly includes the following steps:

[0056] In step 101, historical cloud data of a target user in a cloud service center is obtained, and hot data in the historical cloud data is extracted to obtain data to be backed up.

[0057] In specific implementation, the historical cloud data of the target user in the cloud service center can be obtained in the following manner: after obtaining access permission from the target user, the historical cloud data of the target user in the cloud service center is obtained from the logs and activity history records provided by the cloud service center.

[0058] In some embodiments, extracting hot data from the historical cloud data to obtain the data to be backed up specifically includes:

[0059] Obtain the target user's access records in the cloud data center;

[0060] Perform data analysis on target users’ access records in the cloud data center;

[0061] Dividing the historical cloud data into cold data and hot data according to the result of data analysis;

[0062] Extract the divided hot data to obtain the data to be backed up;

[0063] The cold data is stored separately and a backup library of the cold data is established.

[0064] It should be noted that the access records in the present application include: data access frequency, recent access time, data size and other records; the data analysis refers to the analysis of the importance of existing data based on historical data; in specific implementation, the corresponding importance can be set according to the data access frequency, recent access time, and data size (for example: scoring, the scoring range is 0 to 10, the closer to 10, the more important the data, the closer to 0, the less important the data), and data with an importance greater than or equal to a preset scoring threshold is classified as hot data, and data with an importance less than a preset scoring threshold is classified as cold data, wherein the scoring threshold can be set according to the specific situation, and in other embodiments, other methods can also be used to divide the data stored by users in the cloud data center into cold data and hot data, which is not specifically limited here.

[0065] In addition, in specific implementation, the cold data can be stored separately and a backup library of the cold data can be established according to the nature, storage requirements, budget and recovery speed of the cold data. For example, the life management cycle of the cold data can be set according to the value threshold of the cold data, and then the storage medium of the cold data can be configured according to the characteristics of the cold data. Then, the cold data can be archived according to the storage cost threshold of the cold data. Finally, a backup library of the cold data can be established according to the life management cycle, the configured storage medium and the archiving method. In other embodiments, a threshold can be determined according to business needs and the value of data, and the threshold can be used to determine whether the cold data needs life cycle management, and the cold data can be divided into different levels or areas according to the value threshold of the cold data. Then, a retention threshold of the cold data can be set according to the value threshold of the cold data, and an automatic trigger can be set at the same time. When the life management cycle of the cold data exceeds the retention threshold, the automatic trigger is triggered to automatically delete the stored cold data. In other embodiments, other methods can also be used to implement it, which will not be repeated here.

[0066] In step 102, a backup reference block and a sliding backup window of the data to be backed up are determined.

[0067] In specific implementation, the sliding backup window is composed of the hot data to be backed up and the storage capacity of the corresponding sliding window. The sliding backup window represents a window for storing the hot data to be backed up, which can be used for sliding backup of the currently processed data to be backed up, and can accommodate a certain number of characters or bytes. The backup reference block is composed of the reference hot data and the initial reference capacity of the corresponding reference window. As a preferred embodiment, determining the backup reference block and the sliding backup window of the data to be backed up can be implemented in the following manner, namely: the data amount of the data to be backed up can be set to the storage capacity of the sliding backup window, and then half of the storage capacity of the sliding backup window can be set as the initial reference capacity of the backup reference block. In other embodiments, other methods can also be used to set the backup reference block and the sliding backup window, which will not be repeated here.

[0068] In step 103, the sliding backup window is divided into a plurality of sliding backup intervals, and it is determined whether one of the plurality of sliding backup intervals is the same as the backup reference block.

[0069] In some embodiments, dividing the sliding backup window into a plurality of sliding backup intervals may be implemented by the following method, namely:

[0070] The first N data in the sliding backup window are used as the first sliding backup interval;

[0071] The second data to the N+1th data in the sliding backup window are used as the next sliding backup interval;

[0072] The same process is repeated until all data in the sliding backup window is divided into corresponding sliding backup intervals, thereby obtaining a plurality of sliding backup intervals.

[0073] In specific implementation, N in the present application can be set according to the size of the initial reference capacity in the backup reference block; wherein, by identifying and utilizing the backup reference block, redundancy in hot data can be effectively eliminated and the storage space of the cloud data center server can be reduced.

[0074] In addition, in a specific implementation, it is determined whether one of the multiple sliding backup intervals is the same as the backup reference block, that is: relative to each sliding backup interval, it is determined whether the hot data in the sliding backup interval is the same as the hot data in the sliding backup interval; wherein, when multiple sliding backup intervals are the same as the backup reference block, only one backup reference block may be stored, and the backup reference block may be referenced in other sliding backup intervals, which can save storage space and further improve the storage efficiency of the cloud data center server.

[0075] It should be noted that in the present application, when the amount of data that the cloud data center server needs to process is reduced, the read and write operation speed can be faster, while reducing the burden on the cloud data center server storage device. During the data transmission process, by transmitting only one backup reference block and the sliding backup interval that references the block, the time and bandwidth requirements for data transmission can be reduced, which is especially beneficial for operations such as remote backup, replication and migration of data.

[0076] In step 104, if none of the plurality of sliding backup intervals is identical to the backup reference block, the backup reference block is updated until one of the plurality of sliding backup intervals is found to be identical to the updated backup reference block.

[0077] In some embodiments, the backup reference block may be updated in the following manner:

[0078] If none of the plurality of sliding backup intervals is the same as the backup reference block, the size of the initial reference capacity in the backup reference block is reduced by one data unit in a sequence from the back to the front, to complete the update;

[0079] Searching again, if none of the multiple sliding backup intervals is the same as the updated backup reference block, subtracting one data unit from the size of the initial reference capacity in the updated backup reference block in a backward order to complete the next update;

[0080] The same process is repeated until a sliding backup interval is found that is the same as the updated backup reference block.

[0081] It should be noted that in the present application, by dynamically adjusting the size of the backup reference block, redundancy in the data can be more accurately identified and eliminated; wherein, a larger backup reference block size may cover a smaller reference window, resulting in incomplete elimination of redundancy. Therefore, gradually reducing the size of the backup reference block can identify redundancy in a more fine-grained manner and improve the effect of eliminating data redundancy. Moreover, gradually reducing the size of the backup reference block can further optimize the storage space utilization of the cloud data center server. A smaller reference window size can better adapt to the repetitive patterns of different data and reduce storage redundancy, which can further reduce storage requirements and improve the storage efficiency of the cloud data center server. When data is damaged or lost, a smaller backup reference block can speed up the data recovery process. In addition, since the backup reference block is shared in multiple sliding backup intervals, the consistency and integrity of the data can be improved.

[0082] In step 105, if one of the multiple sliding backup intervals is the same as the backup reference block, the sliding backup interval that is the same as the backup reference block is used as a backup transition window, and the adaptive backup ratio when backing up the data corresponding to the backup transition window is determined based on the sliding backup window and the backup transition window; the backup reference block is continued to be updated until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining multiple backup reference blocks, multiple backup transition windows and multiple adaptive backup ratios.

[0083] In the following embodiment, the adaptive backup ratio when backing up the data corresponding to the backup transition window according to the sliding backup window and the backup transition window can be determined by the following formula, namely:

[0084]

[0085] Wherein, l represents the adaptive backup ratio when backing up the data corresponding to the backup transition window, ζ represents the data length from the first hot data in the sliding backup window to the first hot data in the backup transition window, Indicates the data length from the last hot data in the sliding backup window to the last hot data in the backup transition window.

[0086] It should be noted that the adaptive backup ratio in the present application indicates the degree of deviation of the backup transition window in the sliding backup window. When the adaptive backup ratio is larger, the degree of deviation of the backup transition window in the sliding backup window is larger. When the adaptive backup ratio is smaller, the degree of deviation of the backup transition window in the sliding backup window is smaller. The adaptive backup ratio can also be used to reflect the relative position of the corresponding data in the backup transition window in the sliding backup window.

[0087] In specific implementation, after determining the adaptive backup ratio, continue to subtract one data unit from the size of the initial reference capacity in the backup reference block in a forward order, and continue to determine whether one of the multiple sliding backup intervals is the same as the updated backup reference block, repeat steps 104 and 105 to obtain a new backup reference block, a new backup transition window, and a new adaptive backup ratio until the initial reference capacity of the backup reference block is equal to zero.

[0088] In step 106, a backup reference library of the data to be backed up is established by all backup reference blocks, all backup transition windows and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

[0089] In some embodiments, a backup reference library of the data to be backed up is established by all backup reference blocks, all backup transition windows, and all adaptive backup ratios. When the target user generates new cloud data, adaptive backup of the new cloud data based on the backup reference library can be implemented in the following manner, namely:

[0090] A backup reference block library is established from all the backup reference blocks, and the position of each backup transition window that is the same as the backup reference block is marked;

[0091] Establishing data guidance relationships between all backup reference blocks and corresponding backup transition windows, and establishing a data guidance library based on all data guidance relationships;

[0092] A backup reference library of the data to be backed up is established according to the data guide library, the backup reference block library and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

[0093] In some embodiments, the establishment of a backup reference block library from all backup reference blocks may be implemented in the following manner, namely:

[0094] Assigning a unique identifier to each backup reference block;

[0095] A backup reference block library is established based on all backup reference blocks and corresponding identifiers.

[0096] In specific implementation, the UUID generator in the prior art can be used to generate an identifier for each backup reference block; or a corresponding hash value can be generated based on the hot data in the backup reference block, and the hash value can be used as the identifier of the corresponding backup reference block; in other embodiments, other methods can also be used to assign a unique identifier to the backup reference block, which is not limited here.

[0097] In some embodiments, reference Figure 2 As shown, this figure is a schematic diagram of the process of establishing a data guidance library in some embodiments of the present application. In this embodiment, data guidance relationships between all backup reference blocks and corresponding backup transition windows are established. The following steps can be used to establish a data guidance library based on all data guidance relationships:

[0098] In step 1021, for each backup reference block, positions of all backup transition windows identical to the backup reference block in the sliding backup window are determined;

[0099] In step 1022, the position range of the backup reference block in the sliding backup window is determined according to the positions of all the backup transition windows;

[0100] In step 1023, a data pointer entry is generated according to the identifier of the backup reference block and the position range of the backup reference block in the sliding backup window, wherein the data pointer entry is a data pointer relationship;

[0101] In step 1024, the generated data guide entry is added to the data guide library, thereby obtaining the data guide library.

[0102] In specific implementation, MapReduce, Hive or Pig in big data processing technology can be used to generate data guide entries based on the identifier of the backup reference block and the position range of its backup reference block in the sliding backup window. In other embodiments, other methods can also be used to generate data guide entries, which are not limited here.

[0103] It should be noted that in the present application, by establishing a backup reference block library, storage space can be better utilized; duplicate data blocks only need to be stored once and referenced at different locations through a guidance relationship without the need for repeated storage. By establishing a data guidance library, data can be quickly located and restored, thereby improving data access efficiency; at the same time, since the data guidance library records the location of the backup reference blocks, the integrity and consistency of the data can be verified.

[0104] In specific implementation, a backup reference library of the data to be backed up is established according to the data guidance library, the backup reference block library and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library, that is: the data guidance library, the backup reference block library and all adaptive backup ratios form a backup reference library for hot data, and each adaptive backup ratio is used as the initial adaptive backup ratio of the corresponding backup reference block in the backup library; wherein the data guidance relationship in the data guidance library and the backup reference block in the backup reference block library and the corresponding identifier are used as references when backing up new data, and corresponding codes are generated; when the target user needs to restore data , perform data recovery based on corresponding codes, data guidance relationships in the data guidance library, backup reference blocks in the backup reference block library, and corresponding identifiers; for each backup reference block in the backup reference block library, calculate the adaptive backup ratio of the backup reference block in the recovery data; if the adaptive backup ratio of the backup reference block in the recovery data is equal to the initial adaptive backup ratio of the backup reference block, send the recovery data to the target user; if the adaptive backup ratio of the backup reference block in the recovery data is not equal to the initial adaptive backup ratio of the backup reference block, regenerate new recovery data, and repeat the above steps until the adaptive backup ratio of the backup reference block in the new recovery data is equal to the initial adaptive backup ratio of the backup reference block.

[0105] It should be noted that in the present application, when restoring data, by comparing the adaptive backup ratio of the backup reference block in the restored data with the initial adaptive backup ratio of the backup reference block, it is possible to detect whether the data has been restored normally, thereby improving the accuracy of data recovery.

[0106] In addition, in another aspect of the present application, in some embodiments, the present application provides a cloud data center server data backup system, referring to Figure 3 , which is a schematic diagram of exemplary hardware and / or software of a cloud data center server data backup system according to some embodiments of the present application, the cloud data center server data backup system 300 includes: an acquisition module 301, a processing module 302 and an execution module 303, which are described as follows:

[0107] Acquisition module 301, in this application, acquisition module 301 is mainly used to acquire historical cloud data of the target user in the cloud service center, extract hot data in the historical cloud data, and obtain data to be backed up;

[0108] Processing module 402, in this application, the processing module 402 is used to determine the backup reference block and the sliding backup window of the data to be backed up;

[0109] The processing module 402 in the present application is further used to divide the sliding backup window into a plurality of sliding backup intervals, and determine whether one of the plurality of sliding backup intervals is the same as the backup reference block;

[0110] The processing module 402 in the present application is further configured to update the backup reference block if none of the plurality of sliding backup intervals is identical to the backup reference block, until one of the plurality of sliding backup intervals is found to be identical to the updated backup reference block;

[0111] The processing module 402 in the present application is also used for, if one of the multiple sliding backup intervals is the same as the backup reference block, using the sliding backup interval that is the same as the backup reference block as a backup transition window, and determining an adaptive backup ratio when backing up data corresponding to the backup transition window according to the sliding backup window and the backup transition window; continuing to update the backup reference block until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining multiple backup reference blocks, multiple backup transition windows, and multiple adaptive backup ratios;

[0112] Execution module 403. In the present application, execution module 403 is mainly used to establish a backup reference library of the data to be backed up by all backup reference blocks, all backup transition windows and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

[0113] Each module in the above-mentioned cloud data center server data backup system can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0114] In addition, in one embodiment, the present application provides a computer device, which may be a server, and its internal structure diagram may be as follows: Figure 4 As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store cloud data center server data backup method data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a cloud data center server data backup method is implemented.

[0115] Those skilled in the art will understand that Figure 4 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0116] In one embodiment, a computer device is also provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the steps in the above-mentioned cloud data center server data backup method embodiment are implemented.

[0117] In one embodiment, a computer-readable storage medium is provided, storing a computer program, which, when executed by a processor, implements the steps in the above-mentioned cloud data center server data backup method embodiment.

[0118] In one embodiment, a computer program product or computer program is provided, the computer program product or computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the steps in the above-mentioned cloud data center server data backup method embodiment.

[0119] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0120] In summary, in the cloud data center server data backup method and related equipment disclosed in the embodiments of the present application, first, the historical cloud data of the target user in the cloud service center is obtained, the hot data in the historical cloud data is extracted, the data to be backed up is obtained, the backup reference block and the sliding backup window of the data to be backed up are determined, the sliding backup window is divided into multiple sliding backup intervals, and it is determined whether there is a sliding backup interval in the multiple sliding backup intervals that is the same as the backup reference block. If none of the multiple sliding backup intervals is the same as the backup reference block, the backup reference block is updated until one of the multiple sliding backup intervals is found to be the same as the updated backup reference block. If one of the multiple sliding backup intervals is the same as the backup reference block, The same sliding backup interval as the backup reference block is used as a backup transition window, and an adaptive backup ratio when backing up data corresponding to the backup transition window is determined according to the sliding backup window and the backup transition window; the backup reference block is continuously updated until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining multiple backup reference blocks, multiple backup transition windows and multiple adaptive backup ratios, and a backup reference library of the data to be backed up is established by all the backup reference blocks, all the backup transition windows and all the adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library, so that the cloud data generated by the user can be adaptively backed up, thereby reducing the data backup burden of the cloud data center server.

[0121] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0122] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A cloud data center server data backup method, characterized in that: The steps include: Obtain the historical cloud data of the target user in the cloud service center, extract the hot data in the historical cloud data, and obtain the data to be backed up; Determining a backup reference block and a sliding backup window for the data to be backed up; Dividing the sliding backup window into a plurality of sliding backup intervals, and determining whether one of the plurality of sliding backup intervals is the same as the backup reference block; If none of the multiple sliding backup intervals is identical to the backup reference block, updating the backup reference block until one of the multiple sliding backup intervals is found to be identical to the updated backup reference block; If one of the multiple sliding backup intervals is the same as the backup reference block, the sliding backup interval that is the same as the backup reference block is used as a backup transition window, and an adaptive backup ratio when backing up data corresponding to the backup transition window is determined according to the sliding backup window and the backup transition window; the backup reference block is continuously updated until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining multiple backup reference blocks, multiple backup transition windows, and multiple adaptive backup ratios; A backup reference library of the data to be backed up is established by all backup reference blocks, all backup transition windows and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

2. The method according to claim 1, characterized in that Extracting hot data from the historical cloud data to obtain the data to be backed up specifically includes: Obtain the target user's access records in the cloud data center; Perform data analysis on target users’ access records in the cloud data center; Dividing the historical cloud data into cold data and hot data according to the result of data analysis; Extract the divided hot data to obtain the data to be backed up; The cold data is stored separately and a backup library of the cold data is established.

3. The method according to claim 2, characterized in that Establishing the backup library of the cold data specifically includes: Setting a life cycle of the cold data according to a value threshold of the cold data; configuring a storage medium for the cold data according to characteristics of the cold data; Archiving the cold data according to a storage cost threshold of the cold data; A backup library for the cold data is established according to the life management cycle, the configured storage medium, and the archiving processing method.

4. The method according to claim 1, characterized in that Updating the backup reference block specifically includes: If none of the plurality of sliding backup intervals is the same as the backup reference block, the size of the initial reference capacity in the backup reference block is reduced by one data unit in a sequence from the back to the front, to complete the update; Searching again, if none of the multiple sliding backup intervals is the same as the updated backup reference block, subtracting one data unit from the size of the initial reference capacity in the updated backup reference block in a backward order to complete the next update; The same process is repeated until a sliding backup interval is found that is the same as the updated backup reference block.

5. The method according to claim 1, characterized in that The sliding backup window is composed of hot data to be backed up and the storage capacity of the corresponding sliding window.

6. The method according to claim 1, characterized in that A backup reference library of the data to be backed up is established by all the backup reference blocks, all the backup transition windows and all the adaptive backup ratios. When the target user generates new cloud data, adaptively backing up the new cloud data based on the backup reference library specifically includes: A backup reference block library is established from all the backup reference blocks, and the position of each backup transition window that is the same as the backup reference block is marked; Establishing data guidance relationships between all backup reference blocks and corresponding backup transition windows, and establishing a data guidance library based on all data guidance relationships; A backup reference library of the data to be backed up is established according to the data guide library, the backup reference block library and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

7. The method according to claim 6, characterized in that Establishing data guidance relationships between all backup reference blocks and corresponding backup transition windows, and establishing a data guidance library based on all data guidance relationships specifically includes: For each backup reference block, determining positions of all backup transition windows identical to the backup reference block in the sliding backup window; Determine the position range of the backup reference block in the sliding backup window according to the positions of all the backup transition windows; Generate a data guide entry according to the identifier of the backup reference block and the position range of the backup reference block in the sliding backup window, wherein the data guide entry is the data guide relationship; The generated data guidance entry is added to the data guidance library, thereby obtaining the data guidance library.

8. A cloud data center server data backup system, characterized in that: include: An acquisition module is used to acquire the historical cloud data of the target user in the cloud service center, extract hot data from the historical cloud data, and obtain the data to be backed up; A processing module, used for determining a backup reference block and a sliding backup window of the data to be backed up; a processing module, configured to divide the sliding backup window into a plurality of sliding backup intervals, and determine whether one of the plurality of sliding backup intervals is the same as the backup reference block; a processing module, configured to update the backup reference block if none of the plurality of sliding backup intervals is identical to the backup reference block, until a sliding backup interval among the plurality of sliding backup intervals is found to be identical to the updated backup reference block; A processing module, configured to, if one of the plurality of sliding backup intervals is identical to the backup reference block, use the sliding backup interval identical to the backup reference block as a backup transition window, determine an adaptive backup ratio when backing up data corresponding to the backup transition window according to the sliding backup window and the backup transition window; continue to update the backup reference block until the initial reference capacity in the updated backup reference block is equal to zero, thereby obtaining a plurality of backup reference blocks, a plurality of backup transition windows, and a plurality of adaptive backup ratios; The execution module is used to establish a backup reference library of the data to be backed up based on all backup reference blocks, all backup transition windows and all adaptive backup ratios. When the target user generates new cloud data, the new cloud data is adaptively backed up based on the backup reference library.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the cloud data center server data backup method described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the cloud data center server data backup method according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Mass data backup processing method and system

    CN112214355A

  • Analytics-based backup system for determining optimum backup methods and predicting backup windows

    US10083095B1

  • Targeted chunking of data

    US10324805B1

  • Network informed policy creation using dynamically sized windows

    US20230096974A1