109 results about "Incremental backup" patented technology

The invention relates to the field of data backup, in particular to an intelligent data backup method and system based on an AI large model. The method comprises the following steps: acquiring an enterprise global data list, performing intelligent data structure deconstruction and dynamic attribute mapping modeling, and constructing a holographic data semantic perception model; performing real-time transient risk mutation detection on the holographic data semantic perception model, and constructing an intelligent backup triggering mechanism; carrying out storage resource demand prediction based on an intelligent backup trigger mechanism, carrying out multi-storage cloud environment resource dynamic scheduling, and constructing an elastic backup storage resource pool; carrying out incremental backup analysis and self-adaptive compression coding to obtain an incremental backup coding packet; and performing dynamic backup sequence adjustment and intelligent incremental backup decision on the incremental backup coding packet based on the elastic backup storage resource pool, and constructing an intelligent incremental backup execution engine. According to the method, the reliability, the accuracy and the traceability of a backup result are improved through self-adaptive intelligent incremental backup.

The invention discloses a permanent incremental backup method based on an S3 bucket-level virtual snapshot, and relates to the technical field of data storage and backup, the method comprises the following steps: initializing a backup system and starting a backup agent program, an index management service and an S3 object storage service; complete backup is executed, and a VID and S3 bucket-level virtual snapshoot are generated; efficiently managing a mapping relation between a file path and a snapshot identifier through a B + tree and an inverted index by utilizing a MongoDB index service; incremental backup is executed, and file changes are accurately recognized through Hash comparison and modification time comparison; a storage position is optimized by adopting an incremental storage and deduplication storage mechanism and an IncDSI optimization algorithm; executing backup chain integration and cleaning; and performing data recovery based on the VID of the file and the directory. According to the method, the backup efficiency is remarkably improved, the storage overhead is reduced, the data recovery process is optimized, and the method is suitable for data backup and management of a large-scale file system and has important application value and prospect.

The invention discloses an encryption protection method for network data backup and recovery, which relates to the technical field of data protection, and comprises the following steps: respectively implementing differential backup strategies by adopting a local, cloud and remote three-terminal collaborative backup architecture; and performing local data backup by a combined scheme of complete backup and incremental backup to generate a chained hash value sequence. Three-terminal key isolation and dynamic derivation are adopted to guarantee data security, an independent key system is adopted locally, cloud and remotely, a chain type key is generated locally based on a hash chain, version independent keys are generated at the cloud and remotely, and data security of other terminals is not affected by key leakage of any storage terminal. The recovery priority is automatically switched from local to cloud to remote, the local decrypts incremental data layer by layer through a hash chain, the cloud directly calls an independent key of a target version and uses a synthetic backup complete copy in remote, and the disaster recovery efficiency is improved through layered recovery and synthetic backup.

The invention relates to the technical field of database backup, and particularly provides a MySQL database incremental encryption backup method and device based on MySQLdump, and the device comprises a total backup module, an incremental backup module, an encryption module and a backup management module; the full backup module adopts a MySQL official tool mysqldump to realize complete backup of the database; the incremental backup module is realized on the basis of a MySQL binary log binlog, and data changes are captured by analyzing event records in the binlog; the encryption module is constructed based on an OpenSSL library and provides enterprise-level data protection capability; and the backup management module realizes backup full-life-cycle management. Compared with the prior art, the method has the advantages that the problem of high consumption of traditional total backup resources and the safety problem can be solved, and meanwhile, the complexity and extra cost of a third-party backup tool are avoided.

The invention provides a Hadoop cluster incremental backup recovery method based on data block optimization, and relates to the technical field of data management, and the method comprises the following steps: obtaining distribution state information and historical change records of data blocks in a distributed file system, extracting space-time correlation characteristics, and constructing a data block dependency graph containing dependency direction and dependency intensity; identifying the changed data blocks, performing topological sorting, and identifying key path data blocks and independent data block clusters; calculating a distribution entropy value according to a copy distribution position, and determining a backup granularity type; a backup execution sequence is generated according to a topological sorting result, key path data blocks are backed up preferentially, independent data block clusters are backed up in parallel, and backup metadata containing dependency relationship identifiers and distribution entropy values are generated; and performing dependency consistency verification after recovery based on the dependency relationship identifier. According to the method, the backup recovery efficiency is improved, the data consistency is guaranteed, and the storage overhead is reduced.

The invention discloses a data backup method and device, equipment, a medium and a computer program product, and relates to the technical field of data processing.The method comprises the steps that when a continuous protection snapshot is created for a source volume, the current backup generation of the source volume before the snapshot is created is set as a snapshot generation identifier; and synchronizing data by relying on mapping relation metadata including the current backup generation of the source volume, the last backup generation of the source volume, the storage backup data generation of the target volume and the water level field. Reading corresponding generation data of the source volume according to the water level mark in the first backup, writing into the target volume, and increasing the water level to the total number of source volume data blocks after completion; during incremental backup, a new snapshot is created, the water level is reset, only adjacent generations of difference data are synchronized, and a corresponding generation identifier is distributed for target volume data in each backup. In this way, no extra bitmap is needed to participate in difference marking, the synchronization efficiency is improved, the target volume keeps historical backup data of all generations in the synchronization period, and the problem that the target volume cannot effectively protect data in the traditional incremental backup synchronization stage is solved.

The invention relates to a database technology, in particular to a block incremental backup method based on a shared storage cluster, a product, a medium and equipment. The block incremental backup method comprises the steps that each node of a shared storage cluster independently stores block change information of the node by utilizing a respective mapping file, and the block change information comprises information of a modified data block on the node; when the block incremental backup is executed, based on the block change information of each node, integrating to obtain all modified data blocks; and performing incremental backup processing according to the modified data block to realize block incremental backup. According to the block incremental backup method, only the information of the modified data block is stored through the mapping file, and the block incremental backup is performed based on the block change information, so that the problem of large disk space occupation caused by storage of all data block information is avoided, the disk space occupation is reduced, efficient storage of the block change information is realized, and the storage efficiency is improved. And meanwhile, the backup efficiency is improved, so that the overall performance is improved.

The invention discloses a virtual machine data backup method and device of a cloud computing management platform, a program product, equipment and a medium, and relates to the technical field of computers. The method comprises the following steps: scanning file system metadata of a disk mirror image file of a virtual machine snapshot, screening out a current change file from the disk mirror image file, and determining a current change data block needing to be backed up in an incremental backup mode by comparing a target data block of the current change file with a corresponding data block of reference backup data; the reference backup data is a basic backup data set for incremental comparison; performing hierarchical compression processing on the current changed data block; and constructing a target storage directory in the object storage service according to the virtual machine identifier and the backup task identifier associated with the cloud computing management platform, and backing up the compressed data to the target storage directory. According to the invention, the backup data size and backup time are optimized, and the limitation of low backup function efficiency of the cloud computing management platform is effectively improved.

The invention discloses a data backup method and device, electronic equipment and a storage medium, and relates to the technical field of computers, the data backup method comprises the steps that a cloud hard disk backup interface of a block storage service is expanded, a local backup directory is configured, a snapshot reserved space can be dynamically calculated to optimize storage resource utilization, and the data backup efficiency is improved. In addition, unnecessary directories are eliminated through file system level incremental backup, redundant data transmission is reduced, backup file verification is calculated, data reliability is guaranteed, and therefore the technical problems that in an existing cloud hard disk backup method, due to the fact that a full disk backup strategy is adopted, backup efficiency is low, and storage space is seriously wasted can be solved. The technical effects of improving the backup efficiency of the cloud hard disk, reducing the waste of storage space and guaranteeing the consistency of backup data are achieved.

The invention discloses a distributed database backup method and device and a medium, and relates to the field of databases, the method comprises the following steps: receiving a backup instruction of a target database, analyzing the backup instruction, extracting a backup type and a backup target range in the backup instruction, and generating a corresponding backup task; when the full backup task is executed, an initial logic clock is generated, and an initial blood relationship topological graph is constructed; creating a full-amount atomic snapshot, partitioning the full-amount atomic snapshot and storing the full-amount atomic snapshot into a corresponding physical backup medium to generate full-amount metadata; when the incremental backup task is executed, historical backup metadata is obtained, a change log in the target database is scanned according to a historical logic clock, and the historical blood relationship topological graph is updated based on a change record; determining a newly-added storage unit, creating a newly-added atomic snapshot, and storing the newly-added atomic snapshot in a physical backup medium; incremental metadata is generated. The integrity and accuracy of incremental data are ensured, and the risk of data omission or wrong backup is reduced.

The embodiment of the invention provides a virtual machine data backup method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the one-time full backup of virtual machine data stored in a logical volume for a target virtual machine; detecting whether the storage space of the server exceeds a preset storage space threshold value or not; when it is detected that the storage space of the server exceeds a preset storage space threshold value, a snapshot is created for the logical volume at the current backup moment, and the snapshot comprises bitmap information of virtual machine data; wherein the bitmap information is used for marking data change information of the virtual machine; and determining changed virtual machine data based on the bitmap information so as to perform incremental backup on the changed virtual machine data. According to the technical scheme, the incremental backup can be performed on the virtual machine data of the target virtual machine when the server storage has pressure, and the storage space of the server is saved, so that the technical problems that the server storage pressure is caused and the performance and stability of the server are influenced due to the fact that the virtual machine data is subjected to multiple times of full backup are effectively relieved.

The invention discloses a stateless virtual machine backup method based on snapshots and a storage medium. The stateless virtual machine backup method comprises the following steps: acquiring a current mirror chain of each disk of a stateless virtual machine; judging whether a basic mirror image of the stateless virtual machine system disk is stored or not, and if not, storing the basic mirror image; judging whether the data disk is backed up or not, if yes, obtaining the position of the nearest backup data in the mirror chain, and performing incremental backup based on the backup data; if not, carrying out full-quantity backup on the data disk; updating the mirror chain; only the snapshot containing the data disk is allowed to be created in the limited startup state, and management data of the stateless virtual machine startup snapshot always points to the top end of a corresponding data disk mirror chain; while the restarted or shut-down system disk is ensured to be automatically restored, the full-amount and incremental backup of other disks of the stateless virtual machine is realized, and the influence of restoration is avoided.

The present invention provides a distributed backup method and system based on an open MPP database of a data warehouse, including: Step S1: Classify the backup tables in the database based on business processing logic; Step S2: Subdivide the classified tables into different ordered time granularities through time granularity; Step S3: According to the classification of the tables and the time granularity, determine the backup methods as incremental backup, full backup, and overall backup; Step S4: Perform distributed backup, and each write bandwidth is exclusively used through parallel writing. The backup efficiency of the present invention is greatly improved; different backup strategies are designed according to different database table types. While ensuring the integrity of the backup data, the actual backup is performed according to the changed data. The distributed backup mode solves the network bottleneck and improves the backup concurrent writing ability. Therefore, the backup time is greatly reduced to meet the requirements of large data volume backup.

This invention provides a method, system, device, and medium for data backup of power information communication nodes. The method includes classifying data on the communication node according to preset data classification rules to obtain important and non-important data; generating scan objects based on a preset scan object generator on the communication node and the important data; scanning incremental data on the communication node in real time using a preset scanner on a backup server; performing incremental data backup when the scanner detects the scan object; and deleting the scan object when the incremental data backup is complete. Through features such as data classification, incremental backup, and deletion of scan objects after backup, this invention provides an efficient and reliable data backup solution, effectively protecting important data on power information communication nodes and ensuring data availability and integrity.

This invention discloses a method, device, and storage medium for secure data backup and migration of storage devices, relating to the field of data backup technology. The method includes the following steps: dividing file data in the storage device using a file data partitioning method to obtain a set of file data blocks; obtaining feature parameters of all file data blocks in the set and obtaining feature vectors for each file data block, denoted as file data block feature information; constructing a data block filtering feature vector and building a document feature filtering table based on the file data block feature information, and performing an initial backup; and performing a second backup based on the file data partitioning method and the document feature filtering table. This invention addresses the problem that existing data backup technologies, when performing incremental backups of file data, cannot simultaneously guarantee backup efficiency and data reliability while avoiding the need to restore each backup individually during data recovery.

The invention provides an incremental backup method and system based on a file system operation log. The incremental backup method comprises the steps that whether current backup is first backup or not is judged; performing full-directory scanning on the backup target, reading the content of the target file, performing hash de-duplication on the data of the variable-length block target based on the content, storing the obtained block data and index information into the storage equipment, and ending the operation; reading data and an index of a preorder backup, synthesizing a complete directory view after the last backup, reading an operation sequence log which is actively recorded by a file system and aims at a target directory, and combining and constructing a modification tree; and traversing and accessing the modification information recorded in the modification tree, reading the data of the file and the block file which need to be backed up again, carrying out hash de-duplication, storing the obtained data to the storage equipment, and ending the operation. According to the method, the opportunity of incremental backup is freely selected through the method that the file system actively records the operation sequence log aiming at the target directory, and the flexibility of incremental backup is improved.

The invention belongs to the technical field of data backup, and provides a server backup method and system based on a Hash algorithm, and the method comprises the following steps: adopting an incremental backup mode, and only backing up data which changes after last backup; in combination with an event notification mechanism of a file system, capturing generated data in real time and backing up the data, and meanwhile, carrying out duplicate removal and blocking processing on the data; the processed data is sent to a specified storage position after being subjected to Hash encryption; carrying out distributed processing on the received data, and managing and distributing the data to the local and the cloud; in the backup process, the monitoring operation state is continuously kept, and logs of backup activities are recorded; data are captured in real time by combining an event notification mechanism of a file system, and security protection measures are set, so that viruses and malicious software are effectively prevented from infecting backup data. And meanwhile, the processed data is encrypted and then sent to a specified storage position, so that the data is further prevented from being illegally accessed.

The invention discloses a continuous data protection method, device and equipment based on a Linux complete machine and a storage medium, and the method comprises the steps: when a backup instruction is received, creating a backup plan, and determining a to-be-backed-up Linux system and an NFS storage end for backup processing; registering a corresponding request interface in the block device of the Linux system to be backed up, and intercepting the received BIO request based on the request interface; the request type of the BIO request is judged, and the request type comprises a write request and other requests; when it is judged that the request type is a write request, whether a backup instruction is executed or not is determined according to the BIO request, and when it is determined that the backup instruction is executed, the Linux system to be backed up is backed up to the NFS storage end. By directly intercepting a block device write request on a kernel level, realizing incremental backup based on a two-dimensional mapping table and combining a metadata management mechanism, the method has the advantages of improving backup universality, reducing system overhead and realizing block-level incremental backup.

The invention relates to the technical field of data processing, and discloses a data backup method, device, equipment, medium and product, the method comprises the following steps: in response to a closing instruction for a target virtual machine, obtaining a target bitmap corresponding to the target virtual machine; storing the target bitmap into a target storage space distributed for the target virtual machine in the shared block; the shared block is a pre-applied data block for recording bitmaps of a plurality of virtual machines; in response to a starting instruction for a target virtual machine, obtaining a target bitmap from a target storage space of the shared block, and importing the target bitmap; and in response to a backup instruction for the target virtual machine, performing incremental backup on the target virtual machine according to the target bitmap. According to the method and the device, the validity of incremental backup cannot be influenced when the virtual machine is shut down, the incremental backup can be continued after the virtual machine is started up, the backup efficiency can be improved, and the method and the device are suitable for various disk formats.

A request to restore a specific backup instance is received. In response to the received request to restore the specific backup instance, a new reference backup instance based on the specific backup instance stored at the storage controlled by the backup system is created at a storage controlled by a backup system. Data associated with the specific backup instance is provided to a recipient system from the storage associated with a backup system. A constructive incremental backup snapshot of the recipient system is performed based on the new reference backup instance.

The invention discloses a data backup method and device based on a skip list, and the method comprises the steps: carrying out the partitioning operation of initial backup data, and obtaining a plurality of initial backup data blocks; calculating a hash value of each initial backup data block, storing each initial backup data block, and generating storage description information of each initial backup data block; constructing skip list index information based on the hash value of each initial backup data block and the storage description information; wherein the skip list index information is composed of index nodes organized in a skip list form, and each index node takes a hash value of the corresponding initial backup data block as a sorting key and stores storage description information of the corresponding initial backup data block; and performing incremental backup operation on the updated backup data based on the skip list index information. According to the technical scheme, the backup efficiency and the utilization rate of the backup storage space are improved, and meanwhile the reliability, accuracy and operation convenience of data backup and recovery are guaranteed.

The present invention discloses a block-level data backup system, which includes a console, a client, and a backup server. The client includes a client service module, a backup task execution module, and a block change monitoring module that are connected in sequence. The console is used to manage the client and the backup server, formulate a backup plan and send it to the client and the backup server. The client service module is used to receive the full backup or incremental backup plan of the user. The backup task execution module is used to execute the backup task. The backup task execution module includes a full backup sub-module and an incremental backup sub-module, and each sub-module is implemented through a main thread, a read thread, a compression thread, an encryption thread, and a write thread. The block change monitoring module is used to monitor the block changes, save the block change information in the form of a bitmap and provide it for the backup execution module to use. The present invention uses block-level change tracking technology to monitor the changed blocks of the volume to be protected, and can obtain accurate change data, thereby ensuring the consistency of the backup data.

The application discloses an Oracle database management method and device based on VMware snapshots, equipment and a storage medium, and the method comprises the following steps: creating a target virtual machine on a VMware virtual platform, and restoring the target virtual machine based on full backup of an Oracle database; when full backup of the target virtual machine is restored, performing snapshot processing on the target virtual machine to generate a first VMware snapshot of the target virtual machine; when incremental backup is performed, obtaining incremental data of the Oracle database in a current backup stage, wherein the current backup stage is a stage between current backup and adjacent previous backup; performing incremental restoration in the target virtual machine to obtain a database copy of the target virtual machine when the adjacent previous incremental backup is completed, and restoring the incremental data into the database copy; and when the restoration processing is completed, updating the first VMware snapshot based on the incremental data. The backup and restoration efficiency is significantly improved.

The application discloses a data backup method and device, an electronic device and a storage medium, relates to the technical field of computers, and comprises a cloud hard disk backup interface extended by a block storage service and a local backup directory configured, can dynamically calculate a snapshot reserved space to optimize storage resource utilization, and can also exclude unnecessary directories through a file system level incremental backup to reduce redundant data transmission, and calculate a backup file checksum to guarantee data reliability, so that the technical problem of low backup efficiency and serious storage space waste caused by a full disk backup strategy in the prior cloud hard disk backup method can be solved, and the technical effects of improving cloud hard disk backup efficiency, reducing storage space waste, and guaranteeing backup data consistency are achieved.

The application discloses a data backup method, an electronic device, a storage medium and a program product, relates to the technical field of data processing, and comprises the following steps: when an exception is handled on a first node, determining access information of a data block of a first non-main copy, and creating a first shadow copy in a third node based on the access information, so that the purpose of creating the first shadow copy in the third node on demand is achieved, thereby reducing resource consumption for creating the copy; and the first shadow copy only performs incremental backup on changed data in the first non-main copy, thereby reducing resource consumption for data transmission, and in the case that the first node and the second node may be abnormal at the same time, emergency redundancy can be provided through the first shadow copy, and the problem that data is completely unavailable due to simultaneous failure of double copies is avoided. Therefore, the technical problem of high data backup resource consumption in the prior art can be solved, and the technical effect of reducing data backup resource consumption is achieved.

The present application relates to a data processing method, apparatus, computer device, readable storage medium, and program product. By traversing a preset binary search tree with an incremental data interval corresponding to incremental data, determining each target data interval overlapping with the incremental data interval therein, removing the part of the target data interval overlapping with the incremental data interval, determining the insertion position of the incremental data interval in the preset binary search tree according to the target data interval after removal, and inserting the incremental data interval according to the insertion position to back up the incremental data. Compared with the traditional method of storing each incremental data every time, which requires restoring the incremental data one by one in the order of each backup during recovery, this solution duplicates the backup data by using data interval comparison during incremental backup, so that when recovering, directly restoring the data corresponding to each data interval is the necessary data, improving the data recovery efficiency.

This invention discloses a data backup method, apparatus, device, and medium for cloud-native applications. The method includes: acquiring a cloud-native stateful application and its corresponding multiple components, as well as the backup priority of each component; acquiring incremental backup data for each stateful component and full backup data for each stateless component according to the backup priority of each component; and associating and storing the incremental backup data for each stateful component and the full backup data for each stateless component to complete the data backup of the cloud-native stateful application. The technical solution of this embodiment, by performing incremental backups on the stateful components included in the stateful application and full backups on the stateless components, and associating and storing the incremental backup data and full backup data to complete the data backup, can ensure the consistency of the backup data of the stateful application and improve the probability of successful application recovery.

Performing changed sector backups on a volume to improve the throughput of incremental backups for block-based backups by overwriting only modified data on each changed block. Latency reduction is achieved by not overwriting the changed block as a whole. The previous backup is cloned and the batch file in the clone is updated by considering the incremental block extents. The incremental data write is performed only on the changed data of each incremental block from a couple of offset values from the previous backup's clone. Dynamic disk rather than differencing disk containers are used for snapshots. Use of a previous backup clone eliminates the need for temporary virtual disk containers, and fixed-size segmentation at the target reduces fragmentation and eliminates the need to enforce variable-sized segmentation.

In some aspects, the techniques described herein relate to a method including: receiving, at a data management platform, incoming data; writing the incoming data to a primary database cluster; executing an incremental backup operation, wherein the incremental backup operation generates an incremental backup of the primary database cluster; storing the incremental backup of the primary database cluster in a storage location; after a predetermined amount of time, executing an incremental restore operation on a delayed database cluster, wherein the incremental restore operation restores the incremental backup of the primary database cluster to the delayed database cluster; determining a data anomaly in the incoming data; and executing a failover command, wherein the failover command redirects database queries from the primary database cluster to the delayed database cluster.

The present application belongs to the field of data incremental backup and restoration, and particularly relates to a data incremental backup and restoration method based on bit operation. The method comprises the following steps: 1. New backup: allocating a bit value to a new backup task, and matching the bit value with the existing data in the backup library, and using the bit of the repeated data in the matching result and the bit of the new differential data of the backup task; 2. Restoring backup: querying the backup data with the set bit in the backup library according to the bit value of the backup task to restore; 3. Deleting backup: removing the position of the backup data record with the set bit value of the backup task until 0, and then physically deleting. The present application uses a bit field as a carrier for storing the differential version of the backup task, and uses bit operation to process the data storage and extraction task of the backup and restoration process, thereby saving the rapid increase of the storage space occupied by the repeated data in the full backup, and effectively simplifying the logical design cost and physical storage cost of the data backup and restoration.