Automatic service data backup and recovery system

Abstract

The invention provides an automatic business data backup and recovery system, which relates to the technical field of data backup and comprises a data backup module used for automatically backing up business system data in a target business system based on a backup type to obtain backup data; the backup verification module is used for verifying the backup data and repairing the backup data in time when a backup verification problem exists; and the backup recovery module is used for realizing quick recovery based on the backup data when the business system data is abnormal. Performing automatic backup on the service system data in the target service system based on the backup type to obtain backup data; verifying the backup data, and timely repairing when a backup verification problem exists; and when the business system data is abnormal, rapid recovery is realized based on the backup data, so that accurate recovery of data damaged by system software and hardware faults, man-made disasters or natural disasters and the like is effectively realized, and safe and efficient backup recovery of core business data is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of data backup, and in particular to an automated business data backup and recovery system. Background Art

[0002] In recent years, with the increase in business systems within enterprises year by year, the amount of data has continued to increase, and the dependence on data has become increasingly high, resulting in great pressure on local backup storage. However, the existing data backup system cannot effectively guarantee the data security of enterprises when regional natural disasters or man-made disasters and cyber attacks occur, which in turn has a serious impact on the company's business system data. Therefore, how to achieve safe and efficient local + remote backup and recovery management of enterprise business data has become one of the current research focuses.

[0003] Therefore, the present invention provides an automated business data backup and recovery system. Summary of the invention

[0004] The present invention provides an automated business data backup and recovery system, which is used to automatically back up business system data in a target business system based on the backup type to obtain backup data; verify the backup data, and promptly repair it when there is a backup verification problem; when there is an abnormality in the business system data, quickly recover it based on the backup data, effectively realizing accurate recovery of data damaged due to system software and hardware failures, man-made disasters or natural disasters, so as to ensure safe and efficient backup and recovery of core business data.

[0005] The present invention provides an automated business data backup and recovery system, comprising:

[0006] Data backup module: used to automatically back up the business system data in the target business system based on the backup type to obtain backup data;

[0007] Backup verification module: used to verify backup data and promptly repair backup verification problems;

[0008] Backup and recovery module: used to achieve rapid recovery based on backup data when there are abnormalities in the business system data.

[0009] Preferably, the data backup module includes:

[0010] A backup tool determination unit: used to determine the corresponding selected backup tool for each backup type based on the type of business system data;

[0011] When there is only a single selected backup tool, the currently selected backup tool is considered as the designated backup tool for the corresponding backup type;

[0012] When there are multiple selected backup tools, determining the designated backup tool by analyzing the tool applicability of each selected backup tool;

[0013] Data backup unit: used to automatically perform full backup, incremental backup, differential backup and off-site backup of business system data in the target business system.

[0014] Preferably, when there are multiple selected backup tools, determining the designated backup tool by analyzing the tool applicability of each selected backup tool includes:

[0015] Acquire each backup type of a preset number of reference business systems of the same type as the current target business system, and specify a first historical usage count of different selected backup tools for data backup within a preset time period;

[0016] Based on the backup effect evaluation index, the historical backup effect of each backup type of each reference business system using the selected backup tool for data backup is evaluated to obtain the backup effect evaluation coefficient;

[0017] Taking the backup evaluation coefficient as the dependent variable, the type-tool effect evaluation curve of the corresponding backup type of each reference business system is constructed in time series;

[0018] Extract key curve features of the backup tool effect evaluation curve and perform weighted average calculation to obtain a first effect evaluation coefficient;

[0019] The first effect evaluation coefficient is combined with the first historical usage times for analysis to obtain a tool applicability coefficient;

[0020] The calculation formula of the tool applicability coefficient is as follows:

[0021] In the formula, G i y is the tool suitability coefficient of the i-th selected backup tool corresponding to the current backup type; ij It is represented by the first historical usage count of the jth reference business system using the ith selected backup tool to back up the data of the current backup type within a preset time period; α is represented by the influence weight of the tool usage frequency on the applicability of the analysis tool; It is represented as the first effect evaluation coefficient of the backup effect of the j-th reference business system using the i-th selected backup tool to back up the data of the current backup type within the preset time period; β is represented as the influence weight of the tool backup effect on the applicability of the analysis tool;

[0022] The selected backup tool with the largest tool applicability coefficient is regarded as the designated backup tool for the current backup type.

[0023] Preferably, the backup verification module includes:

[0024] Complete verification unit: used to verify the storage integrity of the backup data using the storage verification block after each business system data backup; and to verify the integrity of the backup data metadata using the metadata verification block;

[0025] Storage verification block: used to verify and calculate the currently backed up business system data using the set verification algorithm to obtain the original checksum;

[0026] Performing checksum calculation on the backup data using a set checksum algorithm to obtain a first checksum;

[0027] If the original checksum is the same as the first checksum, it is determined that the current backup data is not damaged during the storage process, that is, the backup data is stored completely, and is output as a first verification result;

[0028] Otherwise, it is determined that the current backup data is damaged during the storage process, that is, the backup data is not stored completely, and is output as the first verification result;

[0029] Metadata verification block: used to verify the metadata of the backup data based on the set verification rules, obtain the metadata verification result and output it as the first verification result;

[0030] The repair unit is configured to extract a corresponding set repair strategy from a set verification problem category-repair strategy mapping table for repair according to the first verification result if the backup data storage is incomplete or the metadata of the backup data is incomplete.

[0031] Preferably, the backup and recovery module includes:

[0032] Special recovery analysis unit: used to locate the business system data that needs to be recovered using automated tools after a disaster occurs, and mark it as the first special abnormal data;

[0033] According to the set recovery strategy, recover the first special abnormal data based on the off-site backup data;

[0034] When a system fault occurs, a system fault signal is generated based on the system fault type and transmitted to the maintenance staff;

[0035] The maintenance staff performs maintenance according to the system fault signal and the corresponding system maintenance strategy;

[0036] Use automated tools to locate business system data that needs to be restored and mark it as the second special abnormal data;

[0037] Based on the abnormality evaluation index, the abnormal state of the second special abnormal data is evaluated to obtain a special abnormality coefficient;

[0038] According to the special abnormality coefficient, determining the special abnormality level of the second special abnormality data;

[0039] When the special abnormality level is severe, the special abnormality data is restored based on the off-site backup data according to the set recovery strategy;

[0040] When the special abnormality level is moderate or mild, the special abnormality data is restored based on the local backup data according to the set recovery strategy;

[0041] A regular recovery strategy screening unit: used to periodically scan business system data using an automated tool, and mark currently abnormal business system data as first abnormal data;

[0042] Based on the abnormality evaluation index, the abnormal state of the first abnormal data is evaluated to obtain a first abnormality coefficient;

[0043] Determining a first abnormality level of the current first abnormal data according to the first abnormality coefficient;

[0044] Using the first abnormal level and the corresponding backup type of the first abnormal data as screening conditions, extracting a target recovery strategy from a set abnormality-recovery strategy library;

[0045] A recovery monitoring unit: used for real-time monitoring of the data recovery process of the first abnormal data using the target recovery strategy, and the data recovery process of the special abnormal data using the set recovery strategy, and performing an abnormal response when a recovery abnormality occurs;

[0046] Recovery verification unit: used to perform recovery verification operation after the first abnormal data or special abnormal data is recovered.

[0047] Preferably, the recovery monitoring unit comprises:

[0048] Data acquisition block: used to monitor in real time the process of recovering the corresponding abnormal data using the current recovery strategy, and obtain the recovery process data;

[0049] Resource analysis block: used to compare the resource utilization data in the recovery process data with the corresponding set resource utilization threshold;

[0050] If there is resource utilization data that exceeds the corresponding set resource utilization threshold, it is determined that there is insufficient resource utilization in the current recovery process, and the resource support strategy is automatically responded;

[0051] Progress analysis block: used to evaluate whether the current data recovery efficiency reaches the expectation according to the recovery progress data in the recovery process data, and obtain a first efficiency evaluation coefficient;

[0052] When the first efficiency evaluation coefficient is greater than a set efficiency evaluation threshold, it is determined that the current recovery efficiency meets expectations;

[0053] When the efficiency evaluation coefficient is not greater than the set efficiency evaluation threshold, it is determined that the current recovery efficiency does not meet expectations;

[0054] Recovery strategy adjustment block: used for inputting the current recovery process data into the adjustment operation generation model obtained by pre-training the neural network to obtain the first adjustment operation when the recovery efficiency does not meet expectations;

[0055] Using the first adjustment operation to modify the current recovery strategy to obtain an optimized recovery strategy;

[0056] The optimized recovery strategy is used to recover the corresponding abnormal data.

[0057] Preferably, the calculation formula of the first efficiency evaluation coefficient is as follows:

[0058] In the formula, G represents the first efficiency evaluation coefficient of the current data recovery; T represents the set period for data recovery; s1 represents the total amount of data recovery; s0 represents the current amount of recovered data; t0 represents the current recovery time; n1 represents the amount of data that failed to be recovered during the recovery process; It is represented as the average value of the re-execution recovery interval time of the failed recovery data volume; ω1 is represented as the influence weight of the recovery time on the calculation of the first efficiency evaluation coefficient; ω2 is represented as the influence weight of the current recovery success rate on the calculation of the first efficiency evaluation coefficient.

[0059] Preferably, the recovery verification unit includes:

[0060] A recovery verification unit: used for marking the recovery data obtained by recovering the corresponding abnormal data by adopting the current recovery strategy as the first recovery data;

[0061] The first recovery data is verified to be correct by using a set recovery verification method to obtain a recovery correctness verification result;

[0062] Performing a checksum calculation on the first restored data using a set checksum algorithm to obtain a restored checksum;

[0063] If the original checksum and the restored checksum of the current abnormal data are the same, the first restored data is determined to be complete;

[0064] Otherwise, it is determined that the first restored data is incomplete;

[0065] Based on the recovery correctness verification result, if the first recovery data is correct and the first recovery data is complete, it is determined that the current data recovery is successful;

[0066] Otherwise, the current data recovery is determined to be unsuccessful, the recovery failure record is recorded, and the maintenance staff is notified to intervene.

[0067] Compared with the prior art, the present invention has the following beneficial effects:

[0068] The backup data is obtained by automatically backing up the business system data in the target business system based on the backup type; the backup data is verified and repaired in a timely manner when there are backup verification problems; when there are abnormalities in the business system data, rapid recovery is achieved based on the backup data, effectively realizing the accurate recovery of data damaged due to system software and hardware failures, man-made disasters or natural disasters, so as to ensure the safe and efficient backup and recovery of core business data.

[0069] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0070] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0072] Figure 1 The present invention is a structural diagram of an automated business data backup and recovery system in an embodiment of the present invention. DETAILED DESCRIPTION

[0073] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0074] The embodiment of the present invention provides an automated business data backup and recovery system. Figure 1 As shown, including:

[0075] Data backup module: used to automatically back up the business system data in the target business system based on the backup type to obtain backup data;

[0076] Backup verification module: used to verify backup data and promptly repair backup verification problems;

[0077] Backup and recovery module: used to achieve rapid recovery based on backup data when there are abnormalities in the business system data.

[0078] In this embodiment, backup types include full backup, incremental backup, differential backup and off-site backup; the target business system refers to the business system that needs to be backed up within the enterprise, including portal systems, standardized OA systems, production business systems, etc.; business system data refers to databases, files, operating systems, virtualization platforms and other types of data in the target business system, among which database types include Oracle, SQL Server, MySQL, DB2, Informix, MongoDB, PostgreSQL, Caché, SAP HANA, etc.; operating system types include Windows, Linux, AIX, Solaris, HP-UX, as well as Kylin operating system, Kylin Security operating system, Tongxin UOS operating system, Zhongke Fangde operating system and the like under Loongson, Feiteng, Shenwei, Hygon and Zhaoxin architectures.

[0079] In this embodiment, the backup data verification includes the storage integrity verification of the backup data and the metadata integrity verification of the backup data; the backup verification problems include incomplete storage of the backup data and incomplete metadata of the backup data.

[0080] The beneficial effects of the above technical solution are: obtaining backup data by automatically backing up the business system data in the target business system based on the backup type; verifying the backup data and promptly repairing it when there are backup verification problems; when there are abnormalities in the business system data, rapid recovery is achieved based on the backup data, effectively realizing accurate recovery of data damaged due to system software and hardware failures, man-made disasters or natural disasters, so as to ensure safe and efficient backup and recovery of core business data.

[0081] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the data backup module comprises:

[0082] A backup tool determination unit: used to determine the corresponding selected backup tool for each backup type based on the type of business system data;

[0083] When there is only a single selected backup tool, the currently selected backup tool is considered as the designated backup tool for the corresponding backup type;

[0084] When there are multiple selected backup tools, determining the designated backup tool by analyzing the tool applicability of each selected backup tool;

[0085] Data backup unit: used to automatically perform full backup, incremental backup, differential backup and off-site backup of business system data in the target business system.

[0086] In this embodiment, the types of target business systems include portal systems, standardized OA systems, production business systems, etc.; business system data refers to databases, files, operating systems, virtualization platforms and other types of data in the target business system; backup types include full backup, incremental backup, differential backup and off-site backup; the selected backup tool option refers to the corresponding backup tools of different backup types determined based on the type of business system data. For example, when the business system data is a file, the selected backup tools for full backup include rsync, BackupPC, Amanda, etc.; when the business system data is a MySQL database, the selected backup tools for full backup include mysqldump, XtraBackup, etc.; when the business system data is an operating system, the selected backup tools for full backup include CloneZilla, Acronis True Image, etc.

[0087] In this embodiment, the full backup steps are as follows:

[0088] 11. Determine the full backup frequency of corresponding business data of different business levels in the target business system according to the business level;

[0089] 12. Write a setting script and specify the key data of the full script in the setting script;

[0090] 13. Based on the full backup frequency set according to the service level, the full backup frequency logic is set in the setting script to obtain a full backup script;

[0091] 14. Create a full backup task based on the full backup script in the backup scheduling tool, configure task attributes for the full backup task, and then add the full backup task to the preset full backup task list;

[0092] 15. The backup scheduling tool is configured to automatically execute the full backup task according to the preset full backup task list;

[0093] Among them, the business level includes two levels: critical and general; the full backup frequency is pre-set; the script is pre-determined, such as Shell scripts and batch scripts; the key data of the full script includes the full backup type, the specified backup tool corresponding to the full backup type, the path of the business data, the storage location of the full backup file, the full backup directory, the data directory, the generated full backup file name and the library key information of the current target database, such as the database user name and password, and the database name; the full backup script is obtained after the full script key data is specified in the setting script, and then the full backup frequency logic is set in the setting script based on the full backup frequency determined according to the business level; the backup scheduling tool is pre-set, such as Cron, Task Scheduler; the task attributes include the task name, task execution frequency, the path of the backup script, etc.; the preset full backup task list is pre-established by the backup scheduling tool.

[0094] In this embodiment, the incremental backup steps are as follows:

[0095] 21. Determine the incremental backup frequency of corresponding business data of different business levels in the target business system according to the business level;

[0096] 22. Write a setting script and specify key data of the incremental script in the setting script;

[0097] 23. After each full backup, all data that has changed since the last data backup to the current incremental backup time is backed up according to the set incremental backup frequency determined according to the business level, and the incremental backup frequency logic is set in the setting script to obtain an incremental backup script;

[0098] 24. In setting a backup scheduling tool, create an incremental backup task based on the incremental backup script, configure task attributes for the incremental backup task, and then add the incremental backup task to a preset incremental backup task list;

[0099] 25. The backup scheduling tool is configured to automatically execute incremental backup tasks according to a preset incremental backup task list;

[0100] Among them, the setting of incremental backup frequency is pre-set; the key data of the incremental script includes the incremental backup type, the specified backup tool corresponding to the incremental backup type, the path of the business data, the storage location of the incremental backup file, the incremental backup directory, the data directory, the generated incremental backup file name and the library key information of the current target database; the incremental backup script is to set the incremental script key data in the setting script, and then based on each full backup, according to the set incremental backup frequency determined according to the business level, back up all data that has changed since the last data backup to the current incremental backup time, and is obtained after setting the incremental backup frequency logic in the setting script; the preset incremental backup task list is pre-established by the setting backup scheduling tool.

[0101] In this embodiment, the differential backup steps are as follows:

[0102] 31. Used to determine the set differential backup frequency of corresponding business data of different business levels in the target business system according to the business level;

[0103] 32. Write a setting script and specify key data of the difference script in the setting script;

[0104] 33. After each full backup, all data changed from the last full backup to the current differential backup time is backed up according to the set differential backup frequency determined according to the business level, and the differential backup frequency logic is set in the setting script to obtain a differential backup script;

[0105] 34. Creating a differential backup task based on the differential backup script in a backup scheduling tool, configuring task attributes for the differential backup task, and then adding the differential backup task to a preset differential backup task list;

[0106] 35. The backup scheduling tool is configured to automatically execute differential backup tasks according to a preset differential backup task list;

[0107] Among them, the setting of differential backup frequency is pre-set; the key data of the differential script includes the differential backup type, the specified backup tool corresponding to the differential backup type, the path of the business data, the storage location of the differential backup file, the differential backup directory, the data directory, the generated differential backup file name and the library key information of the current target database; the differential backup script is to set the differential script key data in the setting script, and then based on each full backup, according to the set differential backup frequency determined according to the business level, back up all data that has changed since the last full backup to the current differential backup time, and is obtained after setting the differential backup frequency logic in the setting script; the preset differential backup task list is pre-established by the setting backup scheduling tool.

[0108] In this embodiment, off-site backup is achieved by synchronizing the backup data of the target business system to a preset off-site backup center in real time by using a set encryption transmission method, wherein the set encryption method is pre-set, such as key management, encryption protocol, etc.; the preset off-site backup center is a pre-set facility located in a geographical location far away from the main data center, which is used to store backup copies of data.

[0109] In this embodiment, the backup task supports multi-channel function, and the range of channels that can be set supports 1 to 255 channels. The number of backups can be adjusted online according to resource conditions;

[0110] Backup tasks support compression function, which reduces data transmission cost, improves backup efficiency, and significantly reduces the backup storage space occupied by backup sets;

[0111] The backup task supports the breakpoint resume function. If a network anomaly occurs during the backup process, the anomaly point will be recorded. After the network is restored, the backup job can be continued from the anomaly point.

[0112] The backup task supports the speed limit function, which can be used to limit the speed in different time periods. Speed ​​limit can avoid occupying a large amount of transmission bandwidth during data backup and recovery, thereby reducing the impact of backup and recovery on the user's core business.

[0113] The beneficial effect of the above technical solution is: by intelligently selecting the most suitable backup tool for automated backup according to the characteristics of different business system data, the accuracy of data backup can be effectively ensured while improving backup efficiency.

[0114] An embodiment of the present invention provides an automated business data backup and recovery system. When there are multiple selected backup tools, the specified backup tool is determined by analyzing the tool applicability of each selected backup tool, including:

[0115] Acquire each backup type of a preset number of reference business systems of the same type as the current target business system, and specify a first historical usage count of different selected backup tools for data backup within a preset time period;

[0116] Based on the backup effect evaluation index, the historical backup effect of each backup type of each reference business system using the selected backup tool for data backup is evaluated to obtain the backup effect evaluation coefficient;

[0117] Taking the backup evaluation coefficient as the dependent variable, the type-tool effect evaluation curve of the corresponding backup type of each reference business system is constructed in time series;

[0118] Extract key curve features of the backup tool effect evaluation curve and perform weighted average calculation to obtain a first effect evaluation coefficient;

[0119] The first effect evaluation coefficient is combined with the first historical usage times for analysis to obtain a tool applicability coefficient;

[0120] The calculation formula of the tool applicability coefficient is as follows:

[0121] In the formula, G i y is the tool suitability coefficient of the i-th selected backup tool corresponding to the current backup type; ij It is represented by the first historical usage count of the jth reference business system using the ith selected backup tool to back up the data of the current backup type within a preset time period; α is represented by the influence weight of the tool usage frequency on the applicability of the analysis tool; It is represented as the first effect evaluation coefficient of the backup effect of the j-th reference business system using the i-th selected backup tool to back up the data of the current backup type within the preset time period; β is represented as the influence weight of the tool backup effect on the applicability of the analysis tool;

[0122] The selected backup tool with the largest tool applicability coefficient is regarded as the designated backup tool for the current backup type.

[0123] In this embodiment, the types of target business systems include portal systems, standardized OA systems, production business systems, etc.; the preset quantity is predetermined; the reference business system refers to a system of the same type as the target business system; the preset time period is preset; the first historical usage count refers to the corresponding backup type of the reference business system, and specifies the historical usage count of the corresponding selected backup tool for data backup within the preset time period; the backup effect evaluation index includes backup efficiency, backup data integrity and backup data accuracy; the backup effect evaluation coefficient is used to evaluate the historical backup effect of the selected backup tool for data backup, and is obtained by weighted averaging the index values ​​of the historical backup effect of the corresponding backup type of the reference business system using the selected backup tool for data backup based on the backup effect evaluation index, wherein the weight assigned to the backup effect evaluation index is obtained by solving a matrix constructed after pairwise comparison and relative importance scoring of the backup effect evaluation index using the hierarchical analysis method.

[0124] In this embodiment, the type-tool effect evaluation curve is used to characterize the historical backup effect of the corresponding backup type of each reference business system using the selected backup tool for data backup; the key curve characteristics include the average value, maximum value, minimum value and standard deviation, wherein the weights assigned to the key curve characteristics are obtained by solving a matrix constructed by comparing the key curve characteristics pairwise and scoring their relative importance using the hierarchical analysis method; the first effect evaluation coefficient is calculated by weighted average of the key curve characteristics of the backup tool effect evaluation curve; the tool applicability coefficient is used to characterize the applicability of the selected backup tool to the backup type of the current target business system.

[0125] The beneficial effect of the above technical solution is: by calculating the tool applicability coefficient, data support is provided for intelligently and accurately selecting the most suitable backup tool for automated backup, which is conducive to achieving accurate data backup while improving backup efficiency.

[0126] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the backup verification module comprises:

[0127] Complete verification unit: used to verify the storage integrity of the backup data using the storage verification block after each business system data backup; and to verify the integrity of the backup data metadata using the metadata verification block;

[0128] Storage verification block: used to verify and calculate the currently backed up business system data using the set verification algorithm to obtain the original checksum;

[0129] Performing checksum calculation on the backup data using a set checksum algorithm to obtain a first checksum;

[0130] If the original checksum is the same as the first checksum, it is determined that the current backup data is not damaged during the storage process, that is, the backup data is stored completely, and is output as a first verification result;

[0131] Otherwise, it is determined that the current backup data is damaged during the storage process, that is, the backup data is not stored completely, and is output as the first verification result;

[0132] Metadata verification block: used to verify the metadata of the backup data based on the set verification rules, obtain the metadata verification result and output it as the first verification result;

[0133] The repair unit is configured to extract a corresponding set repair strategy from a set verification problem category-repair strategy mapping table for repair according to the first verification result if the backup data storage is incomplete or the metadata of the backup data is incomplete.

[0134] In this embodiment, the verification algorithm is set to be a predetermined algorithm for calculating the checksum, such as MD5, SHA-1, and SHA-256 algorithms; the original checksum is obtained by checking and calculating the current backed-up business system data using the set verification algorithm; the first checksum is obtained by checking and calculating the backup data using the set verification algorithm; the verification rules are set to be pre-set rules for verifying the integrity of the metadata of the backup data, including checking the integrity, format correctness, and timestamp consistency of the metadata fields, etc.; the metadata includes timestamp, file size, file permissions, and owner information, etc.; the first verification result includes whether the backup data storage is complete / incomplete, and whether the metadata of the backup data is complete / incomplete; the verification problem category-repair strategy mapping table is set to be composed of backup verification problems summarized based on historical backup verification repair data and the corresponding most suitable repair strategies, wherein the backup verification problems include incomplete backup data storage and incomplete metadata of the backup data, and the repair strategies include optimizing the backup frequency, improving the backup method, etc.

[0135] The beneficial effect of the above technical solution is: by verifying the backup data and taking corresponding measures to repair the backup data when there are verification anomalies, the integrity and reliability of the backup data can be effectively ensured, thereby improving the efficiency and accuracy of subsequent data recovery.

[0136] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the backup and recovery module comprises:

[0137] Special recovery analysis unit: used to locate the business system data that needs to be recovered using automated tools after a disaster occurs, and mark it as the first special abnormal data;

[0138] According to the set recovery strategy, recover the first special abnormal data based on the off-site backup data;

[0139] When a system fault occurs, a system fault signal is generated based on the system fault type and transmitted to the maintenance staff;

[0140] The maintenance staff performs maintenance according to the system fault signal and the corresponding system maintenance strategy;

[0141] Use automated tools to locate business system data that needs to be restored and mark it as the second special abnormal data;

[0142] Based on the abnormality evaluation index, the abnormal state of the second special abnormal data is evaluated to obtain a special abnormality coefficient;

[0143] According to the special abnormality coefficient, determining the special abnormality level of the second special abnormality data;

[0144] When the special abnormality level is severe, the special abnormality data is restored based on the off-site backup data according to the set recovery strategy;

[0145] When the special abnormality level is moderate or mild, the special abnormality data is restored based on the local backup data according to the set recovery strategy;

[0146] A regular recovery strategy screening unit: used to periodically scan business system data using an automated tool, and mark currently abnormal business system data as first abnormal data;

[0147] Based on the abnormality evaluation index, the abnormal state of the first abnormal data is evaluated to obtain a first abnormality coefficient;

[0148] Determining a first abnormality level of the current first abnormal data according to the first abnormality coefficient;

[0149] Using the first abnormal level and the corresponding backup type of the first abnormal data as screening conditions, extracting a target recovery strategy from a set abnormality-recovery strategy library;

[0150] A recovery monitoring unit: used for real-time monitoring of the data recovery process of the first abnormal data using the target recovery strategy, and the data recovery process of the special abnormal data using the set recovery strategy, and performing an abnormal response when a recovery abnormality occurs;

[0151] Recovery verification unit: used to perform recovery verification operation after the first abnormal data or special abnormal data is recovered.

[0152] In this embodiment, the automation tool refers to a pre-built data verification tool for automatically performing data detection, analysis and positioning; the business system data refers to the database, file, operating system, virtualization platform and other types of data in the target business system; the first special abnormal data refers to the damaged business system data that needs to be restored and is located by the automation tool when a man-made disaster or a natural disaster occurs; the set recovery strategy refers to a pre-set strategy for recovering damaged data caused by a disaster or system failure, which is composed of information such as the specific steps of data recovery, required resources, recovery time objectives, recovery point objectives and estimated recovery time; off-site backup data refers to the data that is synchronized in real time to a preset off-site backup center by using a set encryption transmission method, wherein the set encryption method is pre-set, such as key management, encryption protocol, etc.; the preset off-site backup center is a pre-set facility located in a geographical location away from the main data center for storing backup copies of data.

[0153] In this embodiment, the system failure types include hardware failure and software failure; the system maintenance strategy includes repairing or replacing damaged hardware devices, reinstalling the operating system, database and application, configuring necessary network and security settings, etc.; the second special abnormal data refers to the damaged business system data that needs to be restored and is located by automated tools when a system hardware or software failure occurs; the abnormal evaluation indicators include data loss, data integrity and data consistency; the special abnormal coefficient is obtained by weighted averaging the indicator value obtained by evaluating the abnormal state of the second special abnormal data using the abnormal evaluation indicator, and is used to characterize the abnormal degree of the current second special abnormal data, wherein the weight assigned to the abnormal evaluation indicator is obtained by solving a matrix constructed by comparing the abnormal evaluation indicators pairwise and scoring the relative importance using the hierarchical analysis method; the special abnormal level is determined from the abnormal level table based on the special abnormal coefficient, wherein the abnormal level table is composed of abnormal levels and abnormal coefficient ranges, and the abnormal levels include severe, moderate and mild; local backup data refers to backup data saved in the same data storage center as the business system data.

[0154] In this embodiment, the first abnormal data refers to the damaged business system data that needs to be restored and is located by regularly scanning the business system data using an automated tool; the first abnormal coefficient is obtained by weighted averaging the indicator value obtained by evaluating the abnormal state of the second special abnormal data using the abnormal evaluation indicator, and is used to characterize the degree of abnormality of the current first abnormal data; the first abnormal level is determined from the abnormal level table based on the first abnormal coefficient; the backup types include full backup, incremental backup, differential backup and off-site backup; the set abnormality-recovery strategy library is pre-set, and is composed of the abnormality level, backup type and corresponding recovery strategy; the target recovery strategy refers to a strategy selected from the set abnormality-recovery strategy library for recovering damaged data detected regularly in the business system data, and is composed of information such as specific steps for data recovery, required resources, recovery time target, recovery point target, and estimated recovery time.

[0155] The beneficial effect of the above technical solution is: by using automated tools to locate abnormal data and taking corresponding strategies to realize automated processing of data recovery in the event of disasters, system failures and regular abnormal identification of business system data, it helps to quickly recover key business data, thereby ensuring business continuity and data integrity.

[0156] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the recovery monitoring unit comprises:

[0157] Data acquisition block: used to monitor in real time the process of recovering the corresponding abnormal data using the current recovery strategy, and obtain the recovery process data;

[0158] Resource analysis block: used to compare the resource utilization data in the recovery process data with the corresponding set resource utilization threshold;

[0159] If there is resource utilization data that exceeds the corresponding set resource utilization threshold, it is determined that there is insufficient resource utilization in the current recovery process, and the resource support strategy is automatically responded;

[0160] Progress analysis block: used to evaluate whether the current data recovery efficiency reaches the expectation according to the recovery progress data in the recovery process data, and obtain a first efficiency evaluation coefficient;

[0161] When the first efficiency evaluation coefficient is greater than a set efficiency evaluation threshold, it is determined that the current recovery efficiency meets expectations;

[0162] When the efficiency evaluation coefficient is not greater than the set efficiency evaluation threshold, it is determined that the current recovery efficiency does not meet expectations;

[0163] Recovery strategy adjustment block: used for inputting the current recovery process data into the adjustment operation generation model obtained by pre-training the neural network to obtain the first adjustment operation when the recovery efficiency does not meet expectations;

[0164] Using the first adjustment operation to modify the current recovery strategy to obtain an optimized recovery strategy;

[0165] The optimized recovery strategy is used to recover the corresponding abnormal data.

[0166] In this embodiment, the recovery process data is composed of resource utilization data and recovery progress data, wherein the resource utilization data includes CPU, memory, disk I / O, network bandwidth, etc.; the resource utilization threshold is set to be a value that accounts for 80% of the resource utilization safety threshold; the recovery progress data includes the amount of recovered data, the recovery failure data point, the re-execution recovery interval of the recovery failure data point, etc.; the resource support strategy includes releasing non-critical resources and requesting additional resource support. If there are currently no non-critical resources that can be released, or the releasable non-critical resources cannot meet the current resource support amount, then the request for additional resource support strategy is adopted for resource support; if there are currently non-critical resources that can be released, and the releasable non-critical resources meet the current resource support amount, then A strategy of releasing non-critical resources is adopted; the first efficiency evaluation coefficient is used to evaluate the efficiency of the current data recovery; the efficiency evaluation threshold is set in advance; the adjustment operation generation model is a model obtained by training a neural network with historical recovery process data marked with preset amounts of adjustment operations as training data, and is used to output adjustment operations for the current recovery strategy according to the current recovery progress, wherein the historical recovery process data includes resource utilization, recovery progress, recovery strategy and its effect, etc.; the optimized recovery strategy is a strategy obtained by modifying the current recovery strategy using the first adjustment operation, wherein the first adjustment operation is the result of inputting the current recovery process data into the adjustment operation generation model output, such as changing the recovery order, optimizing recovery parameters, etc.

[0167] The beneficial effect of the above technical solution is: by real-time monitoring of the process of data recovery using the current recovery strategy, the resource utilization and recovery progress are analyzed, and the corresponding recovery strategy is obtained for data recovery, thereby achieving effective management and optimization of the data recovery process.

[0168] The embodiment of the present invention provides an automated business data backup and recovery system, and the calculation formula of the first efficiency evaluation coefficient is as follows:

[0169] In the formula, G represents the first efficiency evaluation coefficient of the current data recovery; T represents the set period for data recovery; s1 represents the total amount of data recovery; s0 represents the current amount of recovered data; t0 represents the current recovery time; n1 represents the amount of data that failed to be recovered during the recovery process; It is represented as the average value of the re-execution recovery interval time of the failed recovery data volume; ω1 is represented as the influence weight of the recovery time on the calculation of the first efficiency evaluation coefficient; ω2 is represented as the influence weight of the current recovery success rate on the calculation of the first efficiency evaluation coefficient.

[0170] In this embodiment, the weights of the recovery time and the recovery success rate for calculating the first efficiency evaluation coefficient are obtained by solving a matrix constructed after pairwise comparison and relative importance scoring using the hierarchical analysis method.

[0171] The beneficial effect of the above technical solution is: by calculating the first efficiency evaluation coefficient, a data basis is provided for judging whether the recovery efficiency meets expectations, which helps to take timely adjustment operations to correct the current recovery strategy and ensure effective data recovery.

[0172] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the recovery verification unit comprises:

[0173] A recovery verification unit: used for marking the recovery data obtained by recovering the corresponding abnormal data by adopting the current recovery strategy as the first recovery data;

[0174] The first recovery data is verified to be correct by using a set recovery verification method to obtain a recovery correctness verification result;

[0175] Performing a checksum calculation on the first restored data using a set checksum algorithm to obtain a restored checksum;

[0176] If the original checksum and the restored checksum of the current abnormal data are the same, the first restored data is determined to be complete;

[0177] Otherwise, it is determined that the first restored data is incomplete;

[0178] Based on the recovery correctness verification result, if the first recovery data is correct and the first recovery data is complete, it is determined that the current data recovery is successful;

[0179] Otherwise, the current data recovery is determined to be unsuccessful, the recovery failure record is recorded, and the maintenance staff is notified to intervene.

[0180] In this embodiment, the first recovery data refers to the data obtained after recovering the first abnormal data using the target recovery strategy, and the data obtained after recovering the special abnormal data using the set recovery strategy; the set recovery verification method is predetermined to verify the correctness of the recovery data, including stratified sampling inspection, database query, file content comparison and business logic verification, wherein different types of data correspond to different set recovery verification methods, for example, database data is verified using a database query method, that is, using an SQL query statement to compare the database type recovery data with the data in the original database; file data is verified using a file content comparison method, that is, a byte-level comparison is performed on the file type recovery data and the original file; the recovery correctness verification result includes two results: correct recovery and incorrect recovery.

[0181] In this embodiment, the set verification algorithm is a predetermined algorithm for calculating the checksum, such as MD5, SHA-1, and SHA-256 algorithms; the recovery checksum refers to the result obtained by checking and calculating the first recovery data using the set verification algorithm; the original checksum of the abnormal data refers to the checksum of the corresponding backup data of the current abnormal data; the recovery failure record consists of the abnormal data identifier, data anomaly type, data recovery timestamp, recovery strategy details, recovery correctness verification result, and checksum comparison result, wherein the abnormal data identifier includes the data file name and database table name.

[0182] The beneficial effect of the above technical solution is that by verifying the integrity and correctness of the recovered data, it can ensure that the recovered data is complete and logically consistent with the original data, reducing data distortion or errors caused by errors in the recovery process, thereby improving the quality of data recovery.

[0183] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An automated business data backup and recovery system, characterized in that: include: Data backup module: used to automatically back up the business system data in the target business system based on the backup type to obtain backup data; Backup verification module: used to verify backup data and promptly repair backup verification problems; Backup and recovery module: used to achieve rapid recovery based on backup data when there are abnormalities in the business system data.

2. The automated business data backup and recovery system according to claim 1, characterized in that: The data backup module comprises: A backup tool determination unit: used to determine the corresponding selected backup tool for each backup type based on the type of business system data; When there is only a single selected backup tool, the currently selected backup tool is considered as the designated backup tool for the corresponding backup type; When there are multiple selected backup tools, determining the designated backup tool by analyzing the tool applicability of each selected backup tool; Data backup unit: used to automatically perform full backup, incremental backup, differential backup and off-site backup of business system data in the target business system.

3. The automated business data backup and recovery system according to claim 2, characterized in that: When there are multiple selected backup tools, the designated backup tool is determined by analyzing the tool applicability of each selected backup tool, including: Acquire each backup type of a preset number of reference business systems of the same type as the current target business system, and specify a first historical usage count of different selected backup tools for data backup within a preset time period; Based on the backup effect evaluation index, the historical backup effect of each backup type of each reference business system using the selected backup tool for data backup is evaluated to obtain the backup effect evaluation coefficient; Taking the backup evaluation coefficient as the dependent variable, the type-tool effect evaluation curve of the corresponding backup type of each reference business system is constructed in time series; Extract key curve features of the backup tool effect evaluation curve and perform weighted average calculation to obtain a first effect evaluation coefficient; The first effect evaluation coefficient is combined with the first historical usage times for analysis to obtain a tool applicability coefficient; The calculation formula of the tool applicability coefficient is as follows: In the formula, G i y is the tool suitability coefficient of the i-th selected backup tool corresponding to the current backup type; ij It is represented by the first historical usage count of the jth reference business system using the ith selected backup tool to back up the data of the current backup type within a preset time period; α is represented by the influence weight of the tool usage frequency on the applicability of the analysis tool; It is represented as the first effect evaluation coefficient of the backup effect of the j-th reference business system using the i-th selected backup tool to back up the data of the current backup type within the preset time period; β is represented as the influence weight of the tool backup effect on the applicability of the analysis tool; The selected backup tool with the largest tool applicability coefficient is regarded as the designated backup tool for the current backup type.

4. The automated business data backup and recovery system according to claim 1, characterized in that: The backup verification module comprises: Complete verification unit: used to verify the storage integrity of the backup data using the storage verification block after each business system data backup; and to verify the integrity of the backup data metadata using the metadata verification block; Storage verification block: used to verify and calculate the currently backed up business system data using the set verification algorithm to obtain the original checksum; Performing checksum calculation on the backup data using a set checksum algorithm to obtain a first checksum; If the original checksum is the same as the first checksum, it is determined that the current backup data is not damaged during the storage process, that is, the backup data is stored completely, and is output as a first verification result; Otherwise, it is determined that the current backup data is damaged during the storage process, that is, the backup data is not stored completely, and is output as the first verification result; Metadata verification block: used to verify the metadata of the backup data based on the set verification rules, obtain the metadata verification result and output it as the first verification result; The repair unit is configured to extract a corresponding set repair strategy from a set verification problem category-repair strategy mapping table for repair according to the first verification result if the backup data storage is incomplete or the metadata of the backup data is incomplete.

5. The automated business data backup and recovery system according to claim 1, characterized in that: The backup and recovery module comprises: Special recovery analysis unit: used to locate the business system data that needs to be recovered using automated tools after a disaster occurs, and mark it as the first special abnormal data; According to the set recovery strategy, recover the first special abnormal data based on the off-site backup data; When a system fault occurs, a system fault signal is generated based on the system fault type and transmitted to the maintenance staff; The maintenance staff performs maintenance according to the system fault signal and the corresponding system maintenance strategy; Use automated tools to locate business system data that needs to be restored and mark it as the second special abnormal data; Based on the abnormality evaluation index, the abnormal state of the second special abnormal data is evaluated to obtain a special abnormality coefficient; According to the special abnormality coefficient, determining the special abnormality level of the second special abnormality data; When the special abnormality level is severe, the special abnormality data is restored based on the off-site backup data according to the set recovery strategy; When the special abnormality level is moderate or mild, the special abnormality data is restored based on the local backup data according to the set recovery strategy; A regular recovery strategy screening unit: used to periodically scan business system data using an automated tool, and mark currently abnormal business system data as first abnormal data; Based on the abnormality evaluation index, the abnormal state of the first abnormal data is evaluated to obtain a first abnormality coefficient; Determining a first abnormality level of the current first abnormal data according to the first abnormality coefficient; Using the first abnormal level and the corresponding backup type of the first abnormal data as screening conditions, extracting a target recovery strategy from a set abnormality-recovery strategy library; A recovery monitoring unit: used for real-time monitoring of the data recovery process of the first abnormal data using the target recovery strategy, and the data recovery process of the special abnormal data using the set recovery strategy, and performing an abnormal response when a recovery abnormality occurs; Recovery verification unit: used to perform recovery verification operation after the first abnormal data or special abnormal data is recovered.

6. The automated business data backup and recovery system according to claim 5, characterized in that: The recovery monitoring unit comprises: Data acquisition block: used to monitor in real time the process of recovering the corresponding abnormal data using the current recovery strategy, and obtain the recovery process data; Resource analysis block: used to compare the resource utilization data in the recovery process data with the corresponding set resource utilization threshold; If there is resource utilization data that exceeds the corresponding set resource utilization threshold, it is determined that there is insufficient resource utilization in the current recovery process, and the resource support strategy is automatically responded; Progress analysis block: used to evaluate whether the current data recovery efficiency reaches the expectation according to the recovery progress data in the recovery process data, and obtain a first efficiency evaluation coefficient; When the first efficiency evaluation coefficient is greater than a set efficiency evaluation threshold, it is determined that the current recovery efficiency meets expectations; When the efficiency evaluation coefficient is not greater than the set efficiency evaluation threshold, it is determined that the current recovery efficiency does not meet expectations; Recovery strategy adjustment block: used for inputting the current recovery process data into the adjustment operation generation model obtained by pre-training the neural network to obtain the first adjustment operation when the recovery efficiency does not meet expectations; Using the first adjustment operation to modify the current recovery strategy to obtain an optimized recovery strategy; The optimized recovery strategy is used to recover the corresponding abnormal data.

7. The automated business data backup and recovery system according to claim 6, characterized in that: The calculation formula of the first efficiency evaluation coefficient is as follows: In the formula, G represents the first efficiency evaluation coefficient of the current data recovery; T represents the set period for data recovery; s1 represents the total amount of data recovery; s0 represents the current amount of recovered data; t0 represents the current recovery time; n1 represents the amount of data that failed to be recovered during the recovery process; It is represented as the average value of the re-execution recovery interval time of the failed recovery data volume; ω1 is represented as the influence weight of the recovery time on the calculation of the first efficiency evaluation coefficient; ω2 is represented as the influence weight of the current recovery success rate on the calculation of the first efficiency evaluation coefficient.

8. The automated business data backup and recovery system according to claim 5, characterized in that: The recovery verification unit comprises: A recovery verification unit: used for marking the recovery data obtained by recovering the corresponding abnormal data by adopting the current recovery strategy as the first recovery data; The first recovery data is verified to be correct by using a set recovery verification method to obtain a recovery correctness verification result; Performing a checksum calculation on the first restored data using a set checksum algorithm to obtain a restored checksum; If the original checksum and the restored checksum of the current abnormal data are the same, the first restored data is determined to be complete; Otherwise, it is determined that the first restored data is incomplete; Based on the recovery correctness verification result, if the first recovery data is correct and the first recovery data is complete, it is determined that the current data recovery is successful; Otherwise, the current data recovery is determined to be unsuccessful, the recovery failure record is recorded, and the maintenance staff is notified to intervene.

Images