An automated business data backup and recovery system

Abstract

The present invention provides an automated business data backup and recovery system, which relates to the field of data backup technology and includes: a data backup module: used to automatically back up business system data in a target business system based on a backup type to obtain backup data; a backup verification module: used to verify the backup data and promptly repair it when a backup verification problem exists; and a backup recovery module: used to quickly recover the business system data based on the backup data when an anomaly exists. By automatically backing up the business system data in the target business system based on the backup type to obtain backup data; verifying the backup data and promptly repairing it when a backup verification problem exists; and quickly recovering the business system data based on the backup data when an anomaly exists, the system effectively achieves accurate recovery of data damaged by system software and hardware failures, man-made disasters, or natural disasters, thereby ensuring safe and efficient backup and recovery of core business data.

Description

Technical Field

[0001] The present invention relates to the technical field of data backup, and in particular to an automated business data backup and recovery system. Background Art

[0002] In recent years, with the annual growth of enterprise business systems and the continuous increase in data volume, data dependency has increased, leading to significant pressure on local backup storage. However, existing data backup systems cannot effectively guarantee enterprise data security in the event of regional natural disasters, man-made disasters, cyberattacks, and other events, which can severely impact business system data. Therefore, achieving secure and efficient local and remote backup and recovery management of enterprise business data has become a key research focus.

[0003] Therefore, the present invention provides an automated business data backup and recovery system. Summary of the Invention

[0004] The present invention provides an automated business data backup and recovery system, which is used to automatically back up business system data in a target business system based on the backup type to obtain backup data; verify the backup data and promptly repair it when there is a backup verification problem; when there is an anomaly in the business system data, quickly recover it based on the backup data, effectively realizing the accurate recovery of data damaged due to system software and hardware failures, man-made disasters or natural disasters, so as to ensure the safe and efficient backup and recovery of core business data.

[0005] The present invention provides an automated business data backup and recovery system, comprising:

[0006] Data backup module: used to automatically back up the business system data in the target business system based on the backup type to obtain backup data;

[0007] Backup verification module: used to verify backup data and promptly repair any backup verification issues;

[0008] Backup and recovery module: used to achieve rapid recovery based on backup data when there are abnormalities in business system data.

[0009] Preferably, the data backup module includes:

[0010] A backup tool determination unit is used to determine the corresponding selected backup tool for each backup type based on the type of business system data;

[0011] When there is only a single selected backup tool, the currently selected backup tool is considered the designated backup tool for the corresponding backup type;

[0012] When there are multiple selected backup tools, determining the designated backup tool by analyzing the tool applicability of each selected backup tool;

[0013] Data backup unit: used to automatically perform full backup, incremental backup, differential backup and off-site backup of business system data in the target business system.

[0014] Preferably, when there are multiple selected backup tools, determining the designated backup tool by analyzing the tool applicability of each selected backup tool includes:

[0015] Obtaining a preset number of backup types of reference business systems of the same type as the current target business system, and specifying a first historical usage count of different selected backup tools for data backup within a preset time period;

[0016] Based on the backup effect evaluation index, the historical backup effect of each backup type of each reference business system using the selected backup tool for data backup is evaluated to obtain the backup effect evaluation coefficient;

[0017] Using the backup evaluation coefficient as the dependent variable, a type-tool effect evaluation curve for the corresponding backup type of each reference business system is constructed in time series;

[0018] Extracting key curve features of the backup tool effect evaluation curve and performing weighted average calculation to obtain a first effect evaluation coefficient;

[0019] Analyze the first effect evaluation coefficient and the first historical usage times to obtain a tool applicability coefficient;

[0020] The calculation formula of the tool applicability coefficient is as follows:

[0021] Where G i y represents the tool suitability coefficient of the i-th selected backup tool corresponding to the current backup type; ij It represents the first historical usage count of the jth reference business system using the ith selected backup tool to back up data of the current backup type within a preset time period; α represents the weight of the impact of tool usage frequency on the applicability of the analysis tool; It represents the first effect evaluation coefficient of the backup effect of the j-th reference business system using the i-th selected backup tool to back up the data of the current backup type within the preset time period; β represents the influence weight of the tool backup effect on the applicability of the analysis tool;

[0022] The selected backup tool with the greatest tool applicability coefficient is regarded as the designated backup tool for the current backup type.

[0023] Preferably, the backup verification module includes:

[0024] Complete verification unit: used to verify the storage integrity of the backup data using the storage verification block after each business system data backup; and to verify the integrity of the backup data metadata using the metadata verification block;

[0025] Storage verification block: used to verify and calculate the current backed-up business system data using the set verification algorithm to obtain the original checksum;

[0026] Performing a checksum calculation on the backup data using a set checksum algorithm to obtain a first checksum;

[0027] If the original checksum is the same as the first checksum, it is determined that the current backup data has not been damaged during the storage process, that is, the backup data is stored intact, and is output as a first verification result;

[0028] Otherwise, it is determined that the current backup data is damaged during the storage process, that is, the backup data storage is incomplete, and is output as the first verification result;

[0029] Metadata verification block: used to verify the metadata of the backup data based on the set verification rules, obtain the metadata verification result and output it as the first verification result;

[0030] The repair unit is configured to extract a corresponding set repair strategy from a set verification problem category-repair strategy mapping table to perform repair if the backup data storage is incomplete or the metadata of the backup data is incomplete according to the first verification result.

[0031] Preferably, the backup and recovery module includes:

[0032] Special recovery analysis unit: used to locate the business system data that needs to be recovered using automated tools after a disaster occurs, and mark it as the first special abnormal data;

[0033] Recover the first special abnormal data based on off-site backup data according to a set recovery strategy;

[0034] When a system fault occurs, a system fault signal is generated based on the system fault type and transmitted to maintenance personnel;

[0035] The maintenance staff performs maintenance according to the system fault signal and the corresponding system maintenance strategy;

[0036] Use automated tools to locate business system data that needs to be restored and mark it as the second special abnormal data;

[0037] Based on the abnormality evaluation index, the abnormal state of the second special abnormal data is evaluated to obtain a special abnormality coefficient;

[0038] Determining the special abnormality level of the second special abnormality data according to the special abnormality coefficient;

[0039] When the special abnormality level is severe, the special abnormality data is restored based on the off-site backup data according to the set recovery strategy;

[0040] When the special abnormality level is moderate or mild, the special abnormality data is restored based on the local backup data according to the set recovery strategy;

[0041] A regular recovery strategy screening unit is configured to periodically scan business system data using an automated tool and mark currently abnormal business system data as first abnormal data;

[0042] Based on the abnormality evaluation index, the abnormal state of the first abnormal data is evaluated to obtain a first abnormality coefficient;

[0043] determining a first abnormality level of the current first abnormal data according to the first abnormality coefficient;

[0044] Using the first abnormality level and the corresponding backup type of the first abnormal data as screening conditions, extracting a target recovery strategy from a set abnormality-recovery strategy library;

[0045] Recovery monitoring unit: used for real-time monitoring of the data recovery process of the first abnormal data using the target recovery strategy, and the data recovery process of the special abnormal data using the set recovery strategy, and performing abnormal response when a recovery abnormality occurs;

[0046] Recovery verification unit: used to perform recovery verification operation after the first abnormal data or special abnormal data is recovered.

[0047] Preferably, the recovery monitoring unit includes:

[0048] Data acquisition block: used to monitor in real time the process of recovering the corresponding abnormal data using the current recovery strategy and obtain the recovery process data;

[0049] Resource analysis block: used to compare the resource utilization data in the recovery process data with the corresponding set resource utilization threshold;

[0050] If resource utilization data exceeds the corresponding set resource utilization threshold, it is determined that the current recovery process has insufficient resource utilization and the resource support policy is automatically responded to;

[0051] Progress analysis block: used to evaluate whether the current data recovery efficiency meets expectations based on the recovery progress data in the recovery process data, and obtain a first efficiency evaluation coefficient;

[0052] When the first efficiency evaluation coefficient is greater than a set efficiency evaluation threshold, it is determined that the current recovery efficiency meets expectations;

[0053] When the efficiency evaluation coefficient is not greater than the set efficiency evaluation threshold, it is determined that the current recovery efficiency does not meet expectations;

[0054] Recovery strategy adjustment block: used to input the current recovery process data into the adjustment operation generation model obtained by pre-training the neural network to obtain the first adjustment operation when the recovery efficiency does not meet expectations;

[0055] Using the first adjustment operation to modify the current recovery strategy to obtain an optimized recovery strategy;

[0056] The optimized recovery strategy is used to recover the corresponding abnormal data.

[0057] Preferably, the calculation formula of the first efficiency evaluation coefficient is as follows:

[0058] Where G is the first efficiency evaluation coefficient for the current data recovery; T is the set period for data recovery; s1 is the total amount of data recovery; s0 is the amount of data currently recovered; t0 is the current recovery time; n1 is the amount of data that failed to be recovered during the recovery process; It is represented by the average value of the recovery interval time of the failed data recovery; ω1 is represented by the influence weight of the recovery time on the calculation of the first efficiency evaluation coefficient; ω2 is represented by the influence weight of the current recovery success rate on the calculation of the first efficiency evaluation coefficient.

[0059] Preferably, the recovery verification unit includes:

[0060] Recovery verification unit: used for marking the recovered data obtained by recovering the corresponding abnormal data using the current recovery strategy as the first recovered data;

[0061] Verifying the correctness of the first restored data using a set recovery verification method to obtain a recovery correctness verification result;

[0062] Performing a checksum calculation on the first restored data using a set checksum algorithm to obtain a restored checksum;

[0063] If the original checksum and the restored checksum of the current abnormal data are the same, the first restored data is determined to be complete;

[0064] Otherwise, it is determined that the first restored data is incomplete;

[0065] Based on the recovery correctness verification result, if the first recovery data is correct and the first recovery data is complete, it is determined that the current data recovery is successful;

[0066] Otherwise, the current data recovery is determined to be unsuccessful, the recovery failure record is recorded, and the maintenance staff is notified to intervene.

[0067] Compared with the prior art, the present invention has the following advantages:

[0068] Backup data is obtained by automatically backing up the business system data in the target business system based on the backup type; the backup data is verified and repaired in a timely manner when there are backup verification problems; when there are anomalies in the business system data, rapid recovery is achieved based on the backup data, effectively realizing the accurate recovery of data damaged due to system software and hardware failures, man-made disasters or natural disasters, so as to ensure the safe and efficient backup and recovery of core business data.

[0069] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0070] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0072] Figure 1 This is a structural diagram of an automated business data backup and recovery system in an embodiment of the present invention. DETAILED DESCRIPTION

[0073] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0074] The embodiment of the present invention provides an automated business data backup and recovery system, such as Figure 1 Shown, including:

[0075] Data backup module: used to automatically back up the business system data in the target business system based on the backup type to obtain backup data;

[0076] Backup verification module: used to verify backup data and promptly repair any backup verification issues;

[0077] Backup and recovery module: used to achieve rapid recovery based on backup data when there are abnormalities in business system data.

[0078] In this embodiment, the backup types include full backup, incremental backup, differential backup and off-site backup; the target business system refers to the business system that needs to be backed up within the enterprise, including portal systems, standardized OA systems, production business systems, etc.; business system data refers to databases, files, operating systems, virtualization platforms and other types of data in the target business system, among which the types of databases include Oracle, SQL Server, MySQL, DB2, Informix, MongoDB, PostgreSQL, Caché, SAP HANA, etc.; the types of operating systems include Windows, Linux, AIX, Solaris, HP-UX, as well as Kylin operating system, Kylin Security operating system, Tongxin UOS operating system, Zhongke Fangde operating system under Loongson, Feiteng, Shenwei, Hygon and Zhaoxin architecture.

[0079] In this embodiment, the backup data verification includes storage integrity verification of the backup data and metadata integrity verification of the backup data; backup verification problems include incomplete storage of the backup data and incomplete metadata of the backup data.

[0080] The beneficial effects of the above technical solution are: obtaining backup data by automatically backing up the business system data in the target business system based on the backup type; verifying the backup data and promptly repairing it when there are backup verification problems; when there are abnormalities in the business system data, rapid recovery is achieved based on the backup data, effectively realizing the accurate recovery of data damaged due to system software and hardware failures, man-made disasters or natural disasters, so as to ensure the safe and efficient backup and recovery of core business data.

[0081] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the data backup module includes:

[0082] A backup tool determination unit is used to determine the corresponding selected backup tool for each backup type based on the type of business system data;

[0083] When there is only a single selected backup tool, the currently selected backup tool is considered the designated backup tool for the corresponding backup type;

[0084] When there are multiple selected backup tools, determining the designated backup tool by analyzing the tool applicability of each selected backup tool;

[0085] Data backup unit: used to automatically perform full backup, incremental backup, differential backup and off-site backup of business system data in the target business system.

[0086] In this embodiment, the types of target business systems include portal systems, standardized OA systems, production business systems, etc.; business system data refers to databases, files, operating systems, virtualization platforms and other types of data in the target business system; backup types include full backup, incremental backup, differential backup and off-site backup; the selected backup tool option refers to the corresponding backup tools for different backup types determined based on the type of business system data. For example, when the business system data is a file, the selected backup tools for full backup include rsync, BackupPC, Amanda, etc.; when the business system data is a MySQL database, the selected backup tools for full backup include mysqldump, XtraBackup, etc.; when the business system data is an operating system, the selected backup tools for full backup include CloneZilla, Acronis True Image, etc.

[0087] In this embodiment, the full backup steps are as follows:

[0088] 11. Determine the full backup frequency of the corresponding business data of different business levels in the target business system according to the business level;

[0089] 12. Write a setup script and specify the full script key data in the setup script;

[0090] 13. Based on the full backup frequency set according to the service level, set the full backup frequency logic in the setting script to obtain a full backup script;

[0091] 14. Create a full backup task based on the full backup script in the backup scheduling tool, configure task attributes for the full backup task, and then add the full backup task to the preset full backup task list;

[0092] 15. The backup scheduling tool automatically executes the full backup task according to the preset full backup task list;

[0093] Among them, the business level includes two levels: critical and general; the full backup frequency is pre-set; the script is pre-determined, such as a Shell script or a batch script; the key data of the full script include the full backup type, the specified backup tool corresponding to the full backup type, the path of the business data, the storage location of the full backup file, the full backup directory, the data directory, the generated full backup file name, and the library key information of the current target database, such as the database user name and password, and the database name; the full backup script is obtained after the full script key data is specified in the setting script, and then the full backup frequency logic is set in the setting script based on the full backup frequency determined according to the business level; the backup scheduling tool is pre-set, such as Cron and Task Scheduler; the task attributes include the task name, task execution frequency, the path of the backup script, etc.; the preset full backup task list is pre-established by the backup scheduling tool.

[0094] In this embodiment, the incremental backup steps are as follows:

[0095] 21. Determine the incremental backup frequency of corresponding business data of different business levels in the target business system according to the business level;

[0096] 22. Write a setting script and specify the incremental script key data in the setting script;

[0097] 23. After each full backup, back up all data that has changed since the last data backup to the current incremental backup time according to the set incremental backup frequency determined according to the business level, and set the incremental backup frequency logic in the setting script to obtain an incremental backup script;

[0098] 24. Create an incremental backup task based on the incremental backup script in the backup scheduling tool, configure task attributes for the incremental backup task, and then add the incremental backup task to the preset incremental backup task list;

[0099] 25. The backup scheduling tool automatically executes incremental backup tasks according to a preset incremental backup task list;

[0100] Among them, the setting of incremental backup frequency is pre-set; the key data of the incremental script includes the incremental backup type, the specified backup tool corresponding to the incremental backup type, the path of the business data, the storage location of the incremental backup file, the incremental backup directory, the data directory, the generated incremental backup file name and the library key information of the current target database; the incremental backup script is obtained after setting the incremental script key data in the setting script, and then based on each full backup, according to the set incremental backup frequency determined according to the business level, all data that has changed since the last data backup to the current incremental backup time is backed up, and the incremental backup frequency logic is set in the setting script; the preset incremental backup task list is pre-established by the setting backup scheduling tool.

[0101] In this embodiment, the differential backup steps are as follows:

[0102] 31. Used to determine the set differential backup frequency of corresponding business data of different business levels in the target business system according to the business level;

[0103] 32. Write a setting script and specify key data of the difference script in the setting script;

[0104] 33. After each full backup, back up all data that has changed since the last full backup to the current differential backup time according to the set differential backup frequency determined according to the business level, and set the differential backup frequency logic in the setting script to obtain a differential backup script;

[0105] 34. Create a differential backup task based on the differential backup script in the backup scheduling tool, configure task attributes for the differential backup task, and then add the differential backup task to the preset differential backup task list;

[0106] 35. The backup scheduling tool is configured to automatically execute differential backup tasks according to a preset differential backup task list;

[0107] Among them, the setting of differential backup frequency is pre-set; the key data of the differential script includes the differential backup type, the specified backup tool corresponding to the differential backup type, the path of the business data, the storage location of the differential backup file, the differential backup directory, the data directory, the generated differential backup file name and the library key information of the current target database; the differential backup script is obtained after setting the differential script key data in the setting script, and then based on each full backup, according to the set differential backup frequency determined according to the business level, all data that has changed since the last full backup to the current differential backup time is backed up, and the differential backup frequency logic is set in the setting script; the preset differential backup task list is pre-established by the setting backup scheduling tool.

[0108] In this embodiment, off-site backup is achieved by synchronizing the backup data of the target business system to a preset off-site backup center in real time by using a set encryption transmission method, wherein the set encryption method is pre-set, such as key management, encryption protocol, etc.; the preset off-site backup center is a pre-set facility located in a geographical location far away from the main data center, which is used to store backup copies of data.

[0109] In this embodiment, the backup task supports multi-channel function, and the range of supported channels is 1 to 255. The number of backup channels can be adjusted online according to resource conditions.

[0110] Backup tasks support compression, which reduces data transmission costs, improves backup efficiency, and significantly reduces the backup storage space occupied by backup sets.

[0111] Backup tasks support breakpoint resuming. If a network anomaly occurs during the backup process, the anomaly point will be recorded. Once the network is restored, the backup job can be resumed from the anomaly point.

[0112] Backup tasks support speed limiting, which can be set by time period. Speed ​​limiting can prevent large amounts of transmission bandwidth from being occupied during data backup and recovery, thereby reducing the impact of backup and recovery on users' core business.

[0113] The beneficial effect of the above technical solution is: by intelligently selecting the most appropriate backup tool for automated backup based on the characteristics of different business system data, the accuracy of data backup can be effectively ensured while improving backup efficiency.

[0114] An embodiment of the present invention provides an automated business data backup and recovery system. When there are multiple selected backup tools, the system determines a designated backup tool by analyzing the tool applicability of each selected backup tool, including:

[0115] Obtaining a preset number of backup types of reference business systems of the same type as the current target business system, and specifying a first historical usage count of different selected backup tools for data backup within a preset time period;

[0116] Based on the backup effect evaluation index, the historical backup effect of each backup type of each reference business system using the selected backup tool for data backup is evaluated to obtain the backup effect evaluation coefficient;

[0117] Using the backup evaluation coefficient as the dependent variable, a type-tool effect evaluation curve for the corresponding backup type of each reference business system is constructed in time series;

[0118] Extracting key curve features of the backup tool effect evaluation curve and performing weighted average calculation to obtain a first effect evaluation coefficient;

[0119] Analyze the first effect evaluation coefficient and the first historical usage times to obtain a tool applicability coefficient;

[0120] The calculation formula of the tool applicability coefficient is as follows:

[0121] Where G i y represents the tool suitability coefficient of the i-th selected backup tool corresponding to the current backup type; ij It represents the first historical usage count of the jth reference business system using the ith selected backup tool to back up data of the current backup type within a preset time period; α represents the weight of the impact of tool usage frequency on the applicability of the analysis tool; It represents the first effect evaluation coefficient of the backup effect of the j-th reference business system using the i-th selected backup tool to back up the data of the current backup type within the preset time period; β represents the influence weight of the tool backup effect on the applicability of the analysis tool;

[0122] The selected backup tool with the greatest tool applicability coefficient is regarded as the designated backup tool for the current backup type.

[0123] In this embodiment, the types of target business systems include portal systems, standardized OA systems, production business systems, etc.; the preset quantity is predetermined; the reference business system refers to a system of the same type as the target business system; the preset time period is predetermined; the first historical usage count refers to the corresponding backup type of the reference business system, and specifies the historical usage count of the corresponding selected backup tool for data backup within the preset time period; the backup effect evaluation index includes backup efficiency, backup data integrity, and backup data accuracy; the backup effect evaluation coefficient is used to evaluate the historical backup effect of the selected backup tool for data backup, and is obtained by weighted averaging the index values ​​of the historical backup effect of the corresponding backup type of the reference business system using the selected backup tool based on the backup effect evaluation index, wherein the weight assigned to the backup effect evaluation index is obtained by solving the matrix constructed after pairwise comparison and relative importance scoring of the backup effect evaluation index using the hierarchical analysis method.

[0124] In this embodiment, the type-tool effect evaluation curve is used to characterize the historical backup effect of data backup performed by the selected backup tool for the corresponding backup type of each reference business system; the key curve characteristics include the average value, maximum value, minimum value and standard deviation, wherein the weights assigned to the key curve characteristics are obtained by solving a matrix constructed by comparing the key curve characteristics with each other and scoring their relative importance using the hierarchical analysis method; the first effect evaluation coefficient is obtained by calculating the weighted average of the key curve characteristics of the backup tool effect evaluation curve; the tool applicability coefficient is used to characterize the applicability of the selected backup tool to the backup type of the current target business system.

[0125] The beneficial effect of the above technical solution is: by calculating the tool applicability coefficient, data support is provided for intelligently and accurately selecting the most suitable backup tool for automated backup, which is conducive to achieving accurate data backup while improving backup efficiency.

[0126] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the backup verification module includes:

[0127] Complete verification unit: used to verify the storage integrity of the backup data using the storage verification block after each business system data backup; and to verify the integrity of the backup data metadata using the metadata verification block;

[0128] Storage verification block: used to verify and calculate the current backed-up business system data using the set verification algorithm to obtain the original checksum;

[0129] Performing a checksum calculation on the backup data using a set checksum algorithm to obtain a first checksum;

[0130] If the original checksum is the same as the first checksum, it is determined that the current backup data has not been damaged during the storage process, that is, the backup data is stored intact, and is output as a first verification result;

[0131] Otherwise, it is determined that the current backup data is damaged during the storage process, that is, the backup data storage is incomplete, and is output as the first verification result;

[0132] Metadata verification block: used to verify the metadata of the backup data based on the set verification rules, obtain the metadata verification result and output it as the first verification result;

[0133] The repair unit is configured to extract a corresponding set repair strategy from a set verification problem category-repair strategy mapping table to perform repair if the backup data storage is incomplete or the metadata of the backup data is incomplete according to the first verification result.

[0134] In this embodiment, the set verification algorithm is a predetermined algorithm for calculating the checksum, such as MD5, SHA-1, and SHA-256 algorithms; the original checksum is obtained by checking and calculating the current backed-up business system data using the set verification algorithm; the first checksum is obtained by checking and calculating the backup data using the set verification algorithm; the set verification rules are pre-set rules for verifying the integrity of the metadata of the backup data, including checking the integrity, format correctness, and timestamp consistency of the metadata fields, etc.; the metadata includes timestamp, file size, file permissions, and owner information, etc.; the first verification result includes whether the backup data storage is complete / incomplete, and whether the metadata of the backup data is complete / incomplete; the set verification problem category-repair strategy mapping table is composed of backup verification problems summarized based on historical backup verification repair data and the corresponding most suitable repair strategies, wherein the backup verification problems include incomplete backup data storage and incomplete metadata of the backup data, and the repair strategies include optimizing the backup frequency, improving the backup method, etc.

[0135] The beneficial effect of the above technical solution is: by verifying the backup data and taking corresponding measures to repair the backup data when there are verification anomalies, the integrity and reliability of the backup data can be effectively ensured, thereby improving the efficiency and accuracy of subsequent data recovery.

[0136] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the backup and recovery module includes:

[0137] Special recovery analysis unit: used to locate the business system data that needs to be recovered using automated tools after a disaster occurs, and mark it as the first special abnormal data;

[0138] Recover the first special abnormal data based on off-site backup data according to a set recovery strategy;

[0139] When a system fault occurs, a system fault signal is generated based on the system fault type and transmitted to maintenance personnel;

[0140] The maintenance staff performs maintenance according to the system fault signal and the corresponding system maintenance strategy;

[0141] Use automated tools to locate business system data that needs to be restored and mark it as the second special abnormal data;

[0142] Based on the abnormality evaluation index, the abnormal state of the second special abnormal data is evaluated to obtain a special abnormality coefficient;

[0143] Determining the special abnormality level of the second special abnormality data according to the special abnormality coefficient;

[0144] When the special abnormality level is severe, the special abnormality data is restored based on the off-site backup data according to the set recovery strategy;

[0145] When the special abnormality level is moderate or mild, the special abnormality data is restored based on the local backup data according to the set recovery strategy;

[0146] A regular recovery strategy screening unit is configured to periodically scan business system data using an automated tool and mark currently abnormal business system data as first abnormal data;

[0147] Based on the abnormality evaluation index, the abnormal state of the first abnormal data is evaluated to obtain a first abnormality coefficient;

[0148] determining a first abnormality level of the current first abnormal data according to the first abnormality coefficient;

[0149] Using the first abnormality level and the corresponding backup type of the first abnormal data as screening conditions, extracting a target recovery strategy from a set abnormality-recovery strategy library;

[0150] Recovery monitoring unit: used for real-time monitoring of the data recovery process of the first abnormal data using the target recovery strategy, and the data recovery process of the special abnormal data using the set recovery strategy, and performing abnormal response when a recovery abnormality occurs;

[0151] Recovery verification unit: used to perform recovery verification operation after the first abnormal data or special abnormal data is recovered.

[0152] In this embodiment, the automation tool refers to a pre-built data verification tool for automatically performing data detection, analysis and positioning; the business system data refers to the database, file, operating system, virtualization platform and other types of data in the target business system; the first special abnormal data refers to the damaged business system data that needs to be restored and is located using the automation tool when a man-made disaster or a natural disaster occurs; the set recovery strategy refers to a pre-set strategy for recovering damaged data caused by a disaster or system failure, which is composed of information such as the specific steps for data recovery, required resources, recovery time objectives, recovery point objectives and expected recovery time; off-site backup data refers to the data that is synchronized in real time to a preset off-site backup center by using a set encryption transmission method, wherein the set encryption method is pre-set, such as key management, encryption protocol, etc.; the preset off-site backup center is a pre-set facility located in a geographical location away from the main data center for storing backup copies of data.

[0153] In this embodiment, system failure types include hardware failures and software failures; system maintenance strategies include repairing or replacing damaged hardware devices, reinstalling operating systems, databases and applications, configuring necessary network and security settings, etc.; second special abnormal data refers to damaged business system data that needs to be restored and is located using automated tools when system hardware and software failures occur; abnormality assessment indicators include data loss amount, data integrity and data consistency; the special abnormality coefficient is obtained by weighted averaging the indicator values ​​obtained by evaluating the abnormal state of the second special abnormal data using the abnormality assessment indicator, and is used to characterize the abnormality degree of the current second special abnormal data, wherein the weight assigned to the abnormality assessment indicator is obtained by solving a matrix constructed by pairwise comparison and relative importance scoring of the abnormality assessment indicators using the hierarchical analysis method; the special abnormality level is determined from the abnormality level table based on the special abnormality coefficient, wherein the abnormality level table consists of abnormality level and abnormality coefficient range, and the abnormality level includes severe, moderate and mild; local backup data refers to backup data saved to the same data storage center as the business system data.

[0154] In this embodiment, the first abnormal data refers to the damaged business system data that needs to be restored and is located by regularly scanning the business system data using an automated tool; the first abnormal coefficient is obtained by weighted averaging the indicator value obtained by evaluating the abnormal state of the second special abnormal data using the abnormal evaluation indicator, and is used to characterize the abnormality degree of the current first abnormal data; the first abnormal level is determined from the abnormal level table based on the first abnormal coefficient; the backup types include full backup, incremental backup, differential backup and off-site backup; the set abnormality-recovery policy library is pre-set and consists of the abnormality level, backup type and corresponding recovery policy; the target recovery policy refers to a policy selected from the set abnormality-recovery policy library for recovering damaged data that is regularly detected in the business system data, and is composed of information such as the specific steps of data recovery, required resources, recovery time target, recovery point target, and expected recovery time.

[0155] The beneficial effect of the above technical solution is: by using automated tools to locate abnormal data and adopt corresponding strategies to realize automated processing of data recovery in the event of disasters, system failures and regular abnormal identification of business system data, it helps to quickly restore critical business data, thereby ensuring business continuity and data integrity.

[0156] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the recovery monitoring unit includes:

[0157] Data acquisition block: used to monitor in real time the process of recovering the corresponding abnormal data using the current recovery strategy and obtain the recovery process data;

[0158] Resource analysis block: used to compare the resource utilization data in the recovery process data with the corresponding set resource utilization threshold;

[0159] If resource utilization data exceeds the corresponding set resource utilization threshold, it is determined that the current recovery process has insufficient resource utilization and the resource support policy is automatically responded to;

[0160] Progress analysis block: used to evaluate whether the current data recovery efficiency meets expectations based on the recovery progress data in the recovery process data, and obtain a first efficiency evaluation coefficient;

[0161] When the first efficiency evaluation coefficient is greater than a set efficiency evaluation threshold, it is determined that the current recovery efficiency meets expectations;

[0162] When the efficiency evaluation coefficient is not greater than the set efficiency evaluation threshold, it is determined that the current recovery efficiency does not meet expectations;

[0163] Recovery strategy adjustment block: used to input the current recovery process data into the adjustment operation generation model obtained by pre-training the neural network to obtain the first adjustment operation when the recovery efficiency does not meet expectations;

[0164] Using the first adjustment operation to modify the current recovery strategy to obtain an optimized recovery strategy;

[0165] The optimized recovery strategy is used to recover the corresponding abnormal data.

[0166] In this embodiment, the recovery process data consists of resource utilization data and recovery progress data, wherein the resource utilization data includes CPU, memory, disk I / O, network bandwidth, etc.; the resource utilization threshold is set to a value that accounts for 80% of the resource utilization safety threshold; the recovery progress data includes the amount of recovered data, the recovery failure data point, the re-execution recovery interval of the recovery failure data point, etc.; the resource support strategy includes releasing non-critical resources and requesting additional resource support. If there are currently no non-critical resources that can be released, or the releasable non-critical resources cannot meet the current resource support amount, then the request for additional resource support strategy is adopted for resource support; if there are currently non-critical resources that can be released, and the releasable non-critical resources meet the current resource support amount, then Adopt a strategy of releasing non-critical resources; the first efficiency evaluation coefficient is used to evaluate the efficiency of current data recovery; the efficiency evaluation threshold is set in advance; the adjustment operation generation model is a model obtained by training a neural network with historical recovery process data marked with preset amounts of adjustment operations as training data, and is used to output adjustment operations for the current recovery strategy according to the current recovery progress, wherein the historical recovery process data includes resource utilization, recovery progress, recovery strategy and its effect, etc.; the optimized recovery strategy is a strategy obtained by modifying the current recovery strategy using the first adjustment operation, wherein the first adjustment operation is the result of inputting the current recovery process data into the adjustment operation generation model output, such as changing the recovery order, optimizing recovery parameters, etc.

[0167] The beneficial effect of the above technical solution is: by real-time monitoring of the process of data recovery using the current recovery strategy, analyzing the resource utilization and recovery progress, obtaining the corresponding recovery strategy for data recovery, and realizing effective management and optimization of the data recovery process.

[0168] An embodiment of the present invention provides an automated business data backup and recovery system. The calculation formula of the first efficiency evaluation coefficient is as follows:

[0169] Where G is the first efficiency evaluation coefficient for the current data recovery; T is the set period for data recovery; s1 is the total amount of data recovery; s0 is the amount of data currently recovered; t0 is the current recovery time; n1 is the amount of data that failed to be recovered during the recovery process; It is represented by the average value of the recovery interval time of the failed data recovery; ω1 is represented by the influence weight of the recovery time on the calculation of the first efficiency evaluation coefficient; ω2 is represented by the influence weight of the current recovery success rate on the calculation of the first efficiency evaluation coefficient.

[0170] In this embodiment, the weights of the recovery time and the recovery success rate for calculating the first efficiency evaluation coefficient are obtained by solving a matrix constructed by performing pairwise comparisons and relative importance scoring using the hierarchical analysis method.

[0171] The beneficial effect of the above technical solution is: by calculating the first efficiency evaluation coefficient, a data basis is provided for judging whether the recovery efficiency meets expectations, which in turn helps to take timely adjustment operations to correct the current recovery strategy and ensure effective data recovery.

[0172] An embodiment of the present invention provides an automated business data backup and recovery system, wherein the recovery verification unit includes:

[0173] Recovery verification unit: used for marking the recovered data obtained by recovering the corresponding abnormal data using the current recovery strategy as the first recovered data;

[0174] Verifying the correctness of the first restored data using a set recovery verification method to obtain a recovery correctness verification result;

[0175] Performing a checksum calculation on the first restored data using a set checksum algorithm to obtain a restored checksum;

[0176] If the original checksum and the restored checksum of the current abnormal data are the same, the first restored data is determined to be complete;

[0177] Otherwise, it is determined that the first restored data is incomplete;

[0178] Based on the recovery correctness verification result, if the first recovery data is correct and the first recovery data is complete, it is determined that the current data recovery is successful;

[0179] Otherwise, the current data recovery is determined to be unsuccessful, the recovery failure record is recorded, and the maintenance staff is notified to intervene.

[0180] In this embodiment, the first recovered data refers to the data obtained after recovering the first abnormal data using the target recovery strategy, and the data obtained after recovering the special abnormal data using the set recovery strategy; the set recovery verification method is predetermined to verify the correctness of the recovered data, including stratified sampling inspection, database query, file content comparison and business logic verification, wherein different types of data correspond to different set recovery verification methods, for example, database data is verified using a database query method, that is, SQL query statements are used to compare the database type recovery data with the data in the original database; file data is verified using a file content comparison method, that is, a byte-level comparison is performed on the file type recovery data and the original file; the recovery correctness verification results include two results: correct recovery and incorrect recovery.

[0181] In this embodiment, the set checksum algorithm is a predetermined algorithm for calculating the checksum, such as MD5, SHA-1, or SHA-256 algorithms; the recovery checksum refers to the result obtained by checking and calculating the first recovery data using the set checksum algorithm; the original checksum of the abnormal data refers to the checksum of the corresponding backup data of the current abnormal data; the recovery failure record consists of the abnormal data identifier, data abnormality type, data recovery timestamp, recovery strategy details, recovery correctness verification result, and checksum comparison result, wherein the abnormal data identifier includes the data file name and database table name.

[0182] The beneficial effect of the above technical solution is that by verifying the integrity and correctness of the recovered data, it can ensure that the recovered data is complete and logically consistent with the original data, reducing data distortion or errors caused by errors in the recovery process, thereby improving the quality of data recovery.

[0183] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. An automated business data backup and recovery system, characterized in that: include: Data backup module: used to automatically back up the business system data in the target business system based on the backup type to obtain backup data; Backup verification module: used to verify backup data and promptly repair any backup verification issues; Backup and recovery module: used to quickly restore business system data based on backup data when there is an anomaly; The data backup module includes: A backup tool determination unit is used to determine the corresponding selected backup tool for each backup type based on the type of business system data; When there is only a single selected backup tool, the currently selected backup tool is considered the designated backup tool for the corresponding backup type; When there are multiple selected backup tools, determining the designated backup tool by analyzing the tool applicability of each selected backup tool; Data backup unit: used to automatically perform full backup, incremental backup, differential backup, and off-site backup of business system data in the target business system; When there are multiple selected backup tools, the designated backup tool is determined by analyzing the tool applicability of each selected backup tool, including: Obtaining a preset number of backup types of reference business systems of the same type as the current target business system, and specifying a first historical usage count of different selected backup tools for data backup within a preset time period; Based on the backup effect evaluation index, the historical backup effect of each backup type of each reference business system using the selected backup tool for data backup is evaluated to obtain the backup effect evaluation coefficient; Using the backup evaluation coefficient as the dependent variable, a type-tool effect evaluation curve for the corresponding backup type of each reference business system is constructed in time series; Extracting key curve features of the backup tool effect evaluation curve and performing weighted average calculation to obtain a first effect evaluation coefficient; Analyze the first effect evaluation coefficient and the first historical usage times to obtain a tool applicability coefficient; The calculation formula of the tool applicability coefficient is as follows: Where, The tool suitability coefficient of the i-th selected backup tool corresponding to the current backup type is represented; It represents the first historical usage count of the j-th reference business system using the i-th selected backup tool to back up data of the current backup type within a preset time period; It is expressed as the weight of the influence of the tool usage frequency on the applicability of the analysis tool; It is represented as the first effect evaluation coefficient of the backup effect of the j-th reference business system using the i-th selected backup tool to back up the data of the current backup type within a preset time period; It is expressed as the weight of the impact of tool backup effect on the applicability of the analysis tool; The selected backup tool with the greatest tool applicability coefficient is regarded as the designated backup tool for the current backup type.

2. The automated business data backup and recovery system according to claim 1, characterized in that: The backup verification module includes: Complete verification unit: used to verify the storage integrity of the backup data using the storage verification block after each business system data backup; and to verify the integrity of the backup data metadata using the metadata verification block; Storage verification block: used to verify and calculate the current backed-up business system data using the set verification algorithm to obtain the original checksum; Performing a checksum calculation on the backup data using a set checksum algorithm to obtain a first checksum; If the original checksum is the same as the first checksum, it is determined that the current backup data has not been damaged during the storage process, that is, the backup data is stored intact, and is output as a first verification result; Otherwise, it is determined that the current backup data is damaged during the storage process, that is, the backup data storage is incomplete, and is output as the first verification result; Metadata verification block: used to verify the metadata of the backup data based on the set verification rules, obtain the metadata verification result and output it as the first verification result; The repair unit is configured to extract a corresponding set repair strategy from a set verification problem category-repair strategy mapping table to perform repair if the backup data storage is incomplete or the metadata of the backup data is incomplete according to the first verification result.

3. The automated business data backup and recovery system according to claim 1, characterized in that: The backup and recovery module includes: Special recovery analysis unit: used to locate the business system data that needs to be recovered using automated tools after a disaster occurs, and mark it as the first special abnormal data; Recover the first special abnormal data based on off-site backup data according to a set recovery strategy; When a system fault occurs, a system fault signal is generated based on the system fault type and transmitted to maintenance personnel; The maintenance staff performs maintenance according to the system fault signal and the corresponding system maintenance strategy; Use automated tools to locate business system data that needs to be restored and mark it as the second special abnormal data; Based on the abnormality evaluation index, the abnormal state of the second special abnormal data is evaluated to obtain a special abnormality coefficient; Determining the special abnormality level of the second special abnormality data according to the special abnormality coefficient; When the special abnormality level is severe, the special abnormality data is restored based on the off-site backup data according to the set recovery strategy; When the special abnormality level is moderate or mild, the special abnormality data is restored based on the local backup data according to the set recovery strategy; A regular recovery strategy screening unit is configured to periodically scan business system data using an automated tool and mark currently abnormal business system data as first abnormal data; Based on the abnormality evaluation index, the abnormal state of the first abnormal data is evaluated to obtain a first abnormality coefficient; determining a first abnormality level of the current first abnormal data according to the first abnormality coefficient; Using the first abnormality level and the corresponding backup type of the first abnormal data as screening conditions, extracting a target recovery strategy from a set abnormality-recovery strategy library; Recovery monitoring unit: used for real-time monitoring of the data recovery process of the first abnormal data using the target recovery strategy, and the data recovery process of the special abnormal data using the set recovery strategy, and performing abnormal response when a recovery abnormality occurs; Recovery verification unit: used to perform recovery verification operation after the first abnormal data or special abnormal data is recovered.

4. The automated business data backup and recovery system according to claim 3, characterized in that: The recovery monitoring unit includes: Data acquisition block: used to monitor in real time the process of recovering the corresponding abnormal data using the current recovery strategy and obtain the recovery process data; Resource analysis block: used to compare the resource utilization data in the recovery process data with the corresponding set resource utilization threshold; If resource utilization data exceeds the corresponding set resource utilization threshold, it is determined that the current recovery process has insufficient resource utilization and the resource support policy is automatically responded to; Progress analysis block: used to evaluate whether the current data recovery efficiency meets expectations based on the recovery progress data in the recovery process data, and obtain a first efficiency evaluation coefficient; When the first efficiency evaluation coefficient is greater than a set efficiency evaluation threshold, it is determined that the current recovery efficiency meets expectations; When the efficiency evaluation coefficient is not greater than the set efficiency evaluation threshold, it is determined that the current recovery efficiency does not meet expectations; Recovery strategy adjustment block: used to input the current recovery process data into the adjustment operation generation model obtained by pre-training the neural network to obtain the first adjustment operation when the recovery efficiency does not meet expectations; Using the first adjustment operation to modify the current recovery strategy to obtain an optimized recovery strategy; The optimized recovery strategy is used to recover the corresponding abnormal data.

5. The automated business data backup and recovery system according to claim 4, characterized in that: The calculation formula of the first efficiency evaluation coefficient is as follows: ； Where, It is represented as the first efficiency evaluation coefficient of the current data recovery; Indicates setting a deadline for data recovery; Expressed as the total amount of data recovered; Indicates the amount of data currently restored; Indicates the current recovery time; Indicates the amount of data that failed to be restored during the recovery process; It is expressed as the average recovery interval time of the failed recovery data volume; It is expressed as the weight of the impact of recovery time on the calculation of the first efficiency evaluation coefficient; 2 represents the influence weight of the current recovery success rate on the calculation of the first efficiency evaluation coefficient.

6. The automated business data backup and recovery system according to claim 3, characterized in that: The recovery verification unit includes: Recovery verification unit: used for marking the recovered data obtained by recovering the corresponding abnormal data using the current recovery strategy as the first recovered data; Verifying the correctness of the first restored data using a set recovery verification method to obtain a recovery correctness verification result; Performing a checksum calculation on the first restored data using a set checksum algorithm to obtain a restored checksum; If the original checksum and the restored checksum of the current abnormal data are the same, the first restored data is determined to be complete; Otherwise, it is determined that the first restored data is incomplete; Based on the recovery correctness verification result, if the first recovery data is correct and the first recovery data is complete, it is determined that the current data recovery is successful; Otherwise, the current data recovery is determined to be unsuccessful, the recovery failure record is recorded, and the maintenance staff is notified to intervene.

Images