80 results about "Incremental backup" patented technology

The invention relates to the technical field of database backup, and particularly provides a MySQL database incremental encryption backup method and device based on MySQLdump, and the device comprises a total backup module, an incremental backup module, an encryption module and a backup management module; the full backup module adopts a MySQL official tool mysqldump to realize complete backup of the database; the incremental backup module is realized on the basis of a MySQL binary log binlog, and data changes are captured by analyzing event records in the binlog; the encryption module is constructed based on an OpenSSL library and provides enterprise-level data protection capability; and the backup management module realizes backup full-life-cycle management. Compared with the prior art, the method has the advantages that the problem of high consumption of traditional total backup resources and the safety problem can be solved, and meanwhile, the complexity and extra cost of a third-party backup tool are avoided.

The invention provides a Hadoop cluster incremental backup recovery method based on data block optimization, and relates to the technical field of data management, and the method comprises the following steps: obtaining distribution state information and historical change records of data blocks in a distributed file system, extracting space-time correlation characteristics, and constructing a data block dependency graph containing dependency direction and dependency intensity; identifying the changed data blocks, performing topological sorting, and identifying key path data blocks and independent data block clusters; calculating a distribution entropy value according to a copy distribution position, and determining a backup granularity type; a backup execution sequence is generated according to a topological sorting result, key path data blocks are backed up preferentially, independent data block clusters are backed up in parallel, and backup metadata containing dependency relationship identifiers and distribution entropy values are generated; and performing dependency consistency verification after recovery based on the dependency relationship identifier. According to the method, the backup recovery efficiency is improved, the data consistency is guaranteed, and the storage overhead is reduced.

The invention discloses a data backup method and device, equipment, a medium and a computer program product, and relates to the technical field of data processing.The method comprises the steps that when a continuous protection snapshot is created for a source volume, the current backup generation of the source volume before the snapshot is created is set as a snapshot generation identifier; and synchronizing data by relying on mapping relation metadata including the current backup generation of the source volume, the last backup generation of the source volume, the storage backup data generation of the target volume and the water level field. Reading corresponding generation data of the source volume according to the water level mark in the first backup, writing into the target volume, and increasing the water level to the total number of source volume data blocks after completion; during incremental backup, a new snapshot is created, the water level is reset, only adjacent generations of difference data are synchronized, and a corresponding generation identifier is distributed for target volume data in each backup. In this way, no extra bitmap is needed to participate in difference marking, the synchronization efficiency is improved, the target volume keeps historical backup data of all generations in the synchronization period, and the problem that the target volume cannot effectively protect data in the traditional incremental backup synchronization stage is solved.

The invention relates to a database technology, in particular to a block incremental backup method based on a shared storage cluster, a product, a medium and equipment. The block incremental backup method comprises the steps that each node of a shared storage cluster independently stores block change information of the node by utilizing a respective mapping file, and the block change information comprises information of a modified data block on the node; when the block incremental backup is executed, based on the block change information of each node, integrating to obtain all modified data blocks; and performing incremental backup processing according to the modified data block to realize block incremental backup. According to the block incremental backup method, only the information of the modified data block is stored through the mapping file, and the block incremental backup is performed based on the block change information, so that the problem of large disk space occupation caused by storage of all data block information is avoided, the disk space occupation is reduced, efficient storage of the block change information is realized, and the storage efficiency is improved. And meanwhile, the backup efficiency is improved, so that the overall performance is improved.

The invention discloses a virtual machine data backup method and device of a cloud computing management platform, a program product, equipment and a medium, and relates to the technical field of computers. The method comprises the following steps: scanning file system metadata of a disk mirror image file of a virtual machine snapshot, screening out a current change file from the disk mirror image file, and determining a current change data block needing to be backed up in an incremental backup mode by comparing a target data block of the current change file with a corresponding data block of reference backup data; the reference backup data is a basic backup data set for incremental comparison; performing hierarchical compression processing on the current changed data block; and constructing a target storage directory in the object storage service according to the virtual machine identifier and the backup task identifier associated with the cloud computing management platform, and backing up the compressed data to the target storage directory. According to the invention, the backup data size and backup time are optimized, and the limitation of low backup function efficiency of the cloud computing management platform is effectively improved.

The invention discloses a data backup method and device, electronic equipment and a storage medium, and relates to the technical field of computers, the data backup method comprises the steps that a cloud hard disk backup interface of a block storage service is expanded, a local backup directory is configured, a snapshot reserved space can be dynamically calculated to optimize storage resource utilization, and the data backup efficiency is improved. In addition, unnecessary directories are eliminated through file system level incremental backup, redundant data transmission is reduced, backup file verification is calculated, data reliability is guaranteed, and therefore the technical problems that in an existing cloud hard disk backup method, due to the fact that a full disk backup strategy is adopted, backup efficiency is low, and storage space is seriously wasted can be solved. The technical effects of improving the backup efficiency of the cloud hard disk, reducing the waste of storage space and guaranteeing the consistency of backup data are achieved.

The invention discloses a distributed database backup method and device and a medium, and relates to the field of databases, the method comprises the following steps: receiving a backup instruction of a target database, analyzing the backup instruction, extracting a backup type and a backup target range in the backup instruction, and generating a corresponding backup task; when the full backup task is executed, an initial logic clock is generated, and an initial blood relationship topological graph is constructed; creating a full-amount atomic snapshot, partitioning the full-amount atomic snapshot and storing the full-amount atomic snapshot into a corresponding physical backup medium to generate full-amount metadata; when the incremental backup task is executed, historical backup metadata is obtained, a change log in the target database is scanned according to a historical logic clock, and the historical blood relationship topological graph is updated based on a change record; determining a newly-added storage unit, creating a newly-added atomic snapshot, and storing the newly-added atomic snapshot in a physical backup medium; incremental metadata is generated. The integrity and accuracy of incremental data are ensured, and the risk of data omission or wrong backup is reduced.

This invention provides a method, system, device, and medium for data backup of power information communication nodes. The method includes classifying data on the communication node according to preset data classification rules to obtain important and non-important data; generating scan objects based on a preset scan object generator on the communication node and the important data; scanning incremental data on the communication node in real time using a preset scanner on a backup server; performing incremental data backup when the scanner detects the scan object; and deleting the scan object when the incremental data backup is complete. Through features such as data classification, incremental backup, and deletion of scan objects after backup, this invention provides an efficient and reliable data backup solution, effectively protecting important data on power information communication nodes and ensuring data availability and integrity.

This invention discloses a method, device, and storage medium for secure data backup and migration of storage devices, relating to the field of data backup technology. The method includes the following steps: dividing file data in the storage device using a file data partitioning method to obtain a set of file data blocks; obtaining feature parameters of all file data blocks in the set and obtaining feature vectors for each file data block, denoted as file data block feature information; constructing a data block filtering feature vector and building a document feature filtering table based on the file data block feature information, and performing an initial backup; and performing a second backup based on the file data partitioning method and the document feature filtering table. This invention addresses the problem that existing data backup technologies, when performing incremental backups of file data, cannot simultaneously guarantee backup efficiency and data reliability while avoiding the need to restore each backup individually during data recovery.

The invention belongs to the technical field of data backup, and provides a server backup method and system based on a Hash algorithm, and the method comprises the following steps: adopting an incremental backup mode, and only backing up data which changes after last backup; in combination with an event notification mechanism of a file system, capturing generated data in real time and backing up the data, and meanwhile, carrying out duplicate removal and blocking processing on the data; the processed data is sent to a specified storage position after being subjected to Hash encryption; carrying out distributed processing on the received data, and managing and distributing the data to the local and the cloud; in the backup process, the monitoring operation state is continuously kept, and logs of backup activities are recorded; data are captured in real time by combining an event notification mechanism of a file system, and security protection measures are set, so that viruses and malicious software are effectively prevented from infecting backup data. And meanwhile, the processed data is encrypted and then sent to a specified storage position, so that the data is further prevented from being illegally accessed.

The invention discloses a continuous data protection method, device and equipment based on a Linux complete machine and a storage medium, and the method comprises the steps: when a backup instruction is received, creating a backup plan, and determining a to-be-backed-up Linux system and an NFS storage end for backup processing; registering a corresponding request interface in the block device of the Linux system to be backed up, and intercepting the received BIO request based on the request interface; the request type of the BIO request is judged, and the request type comprises a write request and other requests; when it is judged that the request type is a write request, whether a backup instruction is executed or not is determined according to the BIO request, and when it is determined that the backup instruction is executed, the Linux system to be backed up is backed up to the NFS storage end. By directly intercepting a block device write request on a kernel level, realizing incremental backup based on a two-dimensional mapping table and combining a metadata management mechanism, the method has the advantages of improving backup universality, reducing system overhead and realizing block-level incremental backup.

The invention relates to the technical field of data processing, and discloses a data backup method, device, equipment, medium and product, the method comprises the following steps: in response to a closing instruction for a target virtual machine, obtaining a target bitmap corresponding to the target virtual machine; storing the target bitmap into a target storage space distributed for the target virtual machine in the shared block; the shared block is a pre-applied data block for recording bitmaps of a plurality of virtual machines; in response to a starting instruction for a target virtual machine, obtaining a target bitmap from a target storage space of the shared block, and importing the target bitmap; and in response to a backup instruction for the target virtual machine, performing incremental backup on the target virtual machine according to the target bitmap. According to the method and the device, the validity of incremental backup cannot be influenced when the virtual machine is shut down, the incremental backup can be continued after the virtual machine is started up, the backup efficiency can be improved, and the method and the device are suitable for various disk formats.

A request to restore a specific backup instance is received. In response to the received request to restore the specific backup instance, a new reference backup instance based on the specific backup instance stored at the storage controlled by the backup system is created at a storage controlled by a backup system. Data associated with the specific backup instance is provided to a recipient system from the storage associated with a backup system. A constructive incremental backup snapshot of the recipient system is performed based on the new reference backup instance.

The invention discloses a data backup method and device based on a skip list, and the method comprises the steps: carrying out the partitioning operation of initial backup data, and obtaining a plurality of initial backup data blocks; calculating a hash value of each initial backup data block, storing each initial backup data block, and generating storage description information of each initial backup data block; constructing skip list index information based on the hash value of each initial backup data block and the storage description information; wherein the skip list index information is composed of index nodes organized in a skip list form, and each index node takes a hash value of the corresponding initial backup data block as a sorting key and stores storage description information of the corresponding initial backup data block; and performing incremental backup operation on the updated backup data based on the skip list index information. According to the technical scheme, the backup efficiency and the utilization rate of the backup storage space are improved, and meanwhile the reliability, accuracy and operation convenience of data backup and recovery are guaranteed.

The application discloses an Oracle database management method and device based on VMware snapshots, equipment and a storage medium, and the method comprises the following steps: creating a target virtual machine on a VMware virtual platform, and restoring the target virtual machine based on full backup of an Oracle database; when full backup of the target virtual machine is restored, performing snapshot processing on the target virtual machine to generate a first VMware snapshot of the target virtual machine; when incremental backup is performed, obtaining incremental data of the Oracle database in a current backup stage, wherein the current backup stage is a stage between current backup and adjacent previous backup; performing incremental restoration in the target virtual machine to obtain a database copy of the target virtual machine when the adjacent previous incremental backup is completed, and restoring the incremental data into the database copy; and when the restoration processing is completed, updating the first VMware snapshot based on the incremental data. The backup and restoration efficiency is significantly improved.

The application discloses a data backup method and device, an electronic device and a storage medium, relates to the technical field of computers, and comprises a cloud hard disk backup interface extended by a block storage service and a local backup directory configured, can dynamically calculate a snapshot reserved space to optimize storage resource utilization, and can also exclude unnecessary directories through a file system level incremental backup to reduce redundant data transmission, and calculate a backup file checksum to guarantee data reliability, so that the technical problem of low backup efficiency and serious storage space waste caused by a full disk backup strategy in the prior cloud hard disk backup method can be solved, and the technical effects of improving cloud hard disk backup efficiency, reducing storage space waste, and guaranteeing backup data consistency are achieved.

The application discloses a data backup method, an electronic device, a storage medium and a program product, relates to the technical field of data processing, and comprises the following steps: when an exception is handled on a first node, determining access information of a data block of a first non-main copy, and creating a first shadow copy in a third node based on the access information, so that the purpose of creating the first shadow copy in the third node on demand is achieved, thereby reducing resource consumption for creating the copy; and the first shadow copy only performs incremental backup on changed data in the first non-main copy, thereby reducing resource consumption for data transmission, and in the case that the first node and the second node may be abnormal at the same time, emergency redundancy can be provided through the first shadow copy, and the problem that data is completely unavailable due to simultaneous failure of double copies is avoided. Therefore, the technical problem of high data backup resource consumption in the prior art can be solved, and the technical effect of reducing data backup resource consumption is achieved.

This invention discloses a data backup method, apparatus, device, and medium for cloud-native applications. The method includes: acquiring a cloud-native stateful application and its corresponding multiple components, as well as the backup priority of each component; acquiring incremental backup data for each stateful component and full backup data for each stateless component according to the backup priority of each component; and associating and storing the incremental backup data for each stateful component and the full backup data for each stateless component to complete the data backup of the cloud-native stateful application. The technical solution of this embodiment, by performing incremental backups on the stateful components included in the stateful application and full backups on the stateless components, and associating and storing the incremental backup data and full backup data to complete the data backup, can ensure the consistency of the backup data of the stateful application and improve the probability of successful application recovery.

The present application belongs to the field of data incremental backup and restoration, and particularly relates to a data incremental backup and restoration method based on bit operation. The method comprises the following steps: 1. New backup: allocating a bit value to a new backup task, and matching the bit value with the existing data in the backup library, and using the bit of the repeated data in the matching result and the bit of the new differential data of the backup task; 2. Restoring backup: querying the backup data with the set bit in the backup library according to the bit value of the backup task to restore; 3. Deleting backup: removing the position of the backup data record with the set bit value of the backup task until 0, and then physically deleting. The present application uses a bit field as a carrier for storing the differential version of the backup task, and uses bit operation to process the data storage and extraction task of the backup and restoration process, thereby saving the rapid increase of the storage space occupied by the repeated data in the full backup, and effectively simplifying the logical design cost and physical storage cost of the data backup and restoration.

The invention relates to the technical field of data backup, in particular to a data asset security management-oriented data incremental backup method and system. According to the access frequency, the update frequency and the security level of different types of core asset data, the distinction degree of each type of core asset data is obtained; for any kind of core asset data, forming a to-be-analyzed data group by the data at each moment, the attribute data and the security management data; obtaining a plurality of to-be-analyzed data group clusters according to the attribute data corresponding to different to-be-analyzed data groups and the network transmission state data and the backup record information data in the security management data; according to the data distribution and the distinction degree in all the to-be-analyzed data groups in different to-be-analyzed data group clusters, obtaining the backup significance of each type of core asset data; and obtaining candidate incremental data, and carrying out incremental data backup. According to the method, the safety of the backup data is improved by accurately obtaining the incremental data of different core asset data assets.

The invention discloses an Oracle database management method and device based on a Vmware snapshot, equipment and a storage medium, and the method comprises the steps: creating a target virtual machine on a Vmware virtual platform, and carrying out the recovery on the target virtual machine based on the full backup of an Oracle production library; when the total backup recovery of the target virtual machine is completed, performing snapshot processing on the target virtual machine, and generating a first VMmware snapshot of the target virtual machine; when incremental backup is executed, incremental data of the Oracle production library in the current backup stage is obtained, and the current backup stage is the stage between the current backup and the adjacent previous backup; performing incremental recovery in the target virtual machine to obtain a database copy when the target virtual machine completes adjacent previous incremental backup, and recovering the incremental data to the database copy; and when the recovery processing is completed, updating the first VMware snapshot based on the incremental data. And the backup recovery efficiency is obviously improved.

The application discloses a virtual machine data backup method, device, program product, equipment and medium of a cloud computing management platform, relates to the technical field of computers, and comprises the following steps: generating a virtual machine snapshot; filtering out current change files from a disk image file of the virtual machine snapshot by scanning file system metadata of the disk image file, and determining current change data blocks that need to be backed up in an incremental backup mode by comparing target data blocks of the current change files with corresponding data blocks of reference backup data; the reference backup data is a basic backup data set used for incremental comparison; performing hierarchical compression processing on the current change data blocks; constructing a target storage directory in an object storage service according to virtual machine identifiers and backup task identifiers associated with the cloud computing management platform, and backing up the compressed data into the target storage directory. The application optimizes the backup data size and the backup time, and effectively improves the low-efficiency limitation of the backup function of the cloud computing management platform.

The embodiment of the invention provides a data backup method. The data backup method comprises a plurality of rounds of incremental backups, any round of incremental backup comprises the following steps: determining a plurality of incremental data blocks to be backed up according to a current baseline index set and a plurality of incremental index sets; the plurality of incremental index sets are index sets of incremental data blocks corresponding to a plurality of rounds of incremental backups completed after the baseline index set is generated. And executing backup on the plurality of incremental data blocks, and generating a current round of incremental index set according to the indexes corresponding to the data blocks subjected to backup. And judging whether a merging condition is met or not based on the plurality of increment index sets and the current round of increment index set, and if the merging condition is met, merging the current baseline index set, the plurality of increment index sets and the current round of increment index set to serve as an updated baseline index set.

The utility model discloses a device for integrating a distributed TMS (Transport Management System) upgrading system, which belongs to the technical field of terminal management and comprises an intelligent networking module which has an automatic discovery function and can identify all local TMS system equipment capable of participating in upgrading in the same network segment through a broadcast type detection means according to a network protocol; a temporary distributed upgrading network is automatically established; the upgrade package intelligent management module is used for carrying out full-life-cycle management on the TMS system upgrade package; the upgrading process regulation and control module is used for coordinating and monitoring the upgrading process of each local TMS system; the data security guarantee module is used for accurately backing up important data in the local TMS system by adopting an advanced incremental backup technology before the TMS system is upgraded; according to the utility model, network resources in the same network segment are fully utilized through the distributed upgrading architecture, the network bottleneck caused by centralized upgrading is avoided, the upgrading speed is greatly accelerated, and the time required for upgrading is shortened.

The invention discloses a satellite task planning data backtracking and redisk method based on an incremental backup technology, and belongs to the field of satellite task planning and the technical field of database management. Comprising the following steps: S1, constructing a twin system; s2, on the basis of a twin system, performing initialization configuration on a database in the task planning system to obtain a backtracking mechanism; s3, aiming at the characteristics of the task planning system, constructing a regular automatic backup module; step S4, constructing a WAL log archiving module; s5, based on a regular automatic backup module and a WAL log archiving module, establishing a recovery scheduling service; and S6, starting the twin system, sending a request to the twin system based on the recovery scheduling service, and recovering the database in the task planning system to any historical moment.

The invention provides a data backup method and device, a data recovery method and device, electronic equipment and a storage medium. A to-be-backed-up file is segmented into a plurality of file blocks, and incremental backup is carried out on the file blocks to improve the data backup efficiency; the method comprises the following steps of: calculating a hash value of each file block at the same time, checking an index relationship between a storage directory and a plurality of file blocks by utilizing the hash value, calculating a backup snapshot identifier of a current backup round by utilizing the hash value of each file block, and searching the storage directory needing data recovery by utilizing the backup snapshot identifier. The data needing data recovery is determined by utilizing the index relationship between the storage directory and the multiple file blocks, so that the data can be completely recovered, and zombie block data is avoided.

This application provides a method, device, storage medium, and program product for parallel merging of database backup sets, relating to the field of distributed systems. The method includes: obtaining the dependency chain of the backup sets to be merged; obtaining data block penetration markers based on the backup set dependency chain; processing data blocks in the full backup set in parallel to a temporary directory through multiple first sub-processes; processing at least one file dependent on an incremental backup set in parallel to a temporary directory through multiple second sub-processes; merging incremental data blocks from at least one incremental backup set in parallel to a temporary directory through multiple third sub-processes; and organizing and generating a merged full backup set based on the contents of the temporary directory. This method adds parallel scheduling capabilities based on data block penetration markers, improving the execution efficiency of merging backup sets.

Techniques are disclosed relating to providing fast access to restored data in a cloud storage environment. A computing system stores multiple sets of incremental backup data that reflect changes in data being backed up between backup intervals and metadata that indicates which set of incremental backup data stores a given object. The computing system generates an endpoint for a requesting computing system, where the endpoint supports requests for restored backup data and data responses. In response to a request from the requesting computing system via the endpoint, the computing system queries the metadata based on the request and stores metadata retrieved from the query in a key / value store using object identification information as key data and the retrieved metadata as value data. The computing system provides requested data according to a lazy loading technique, including providing requested data via the endpoint based on the metadata in the key / value store.

The invention discloses a file backup recovery method and system, and the method comprises the steps: creating a backup directory corresponding to a to-be-backed-up directory structure of a source end at a target end, and completely synchronizing a specified file or directory of the source end to the backup directory in an original format and structure; after each time of successful full backup or incremental backup, creating a time point snapshot for the data volume where the backup directory is located at the target end; when data needs to be recovered, a snapshot at a specific time point is selected from the existing snapshot list, and a writable clone volume is created in time based on the snapshot; and mounting the clone volume to a specified recovery target mounting point through a network storage protocol, so that the backup data can be immediately accessed and used in a native format. By utilizing the embodiment of the invention, the backup storage efficiency can be remarkably improved, the recovery process can be accelerated, and the backup data can be instantly accessed and used in a native format.

This invention discloses a data backup and recovery method, a server, a distributed system, and a storage medium. The data backup method includes: responding to a backup command, backing up the full data of each shard in the distributed system to a local node using a backup and recovery management tool, and reading the consistency point of each shard, wherein the full data of each shard ends at the consistency point of the corresponding shard; triggering an incremental backup operation based on the consistency point of each shard, the incremental backup operation including, through an incremental backup recovery service, performing real-time backup of the incremental data of each shard according to the consistency point of each shard. Using the above method, unified management of full and incremental backup data can be achieved, and incremental data can be synchronized in real time through the incremental backup recovery service.