156 results about "Incremental backup" patented technology

The invention relates to the field of data backup, in particular to an intelligent data backup method and system based on an AI large model. The method comprises the following steps: acquiring an enterprise global data list, performing intelligent data structure deconstruction and dynamic attribute mapping modeling, and constructing a holographic data semantic perception model; performing real-time transient risk mutation detection on the holographic data semantic perception model, and constructing an intelligent backup triggering mechanism; carrying out storage resource demand prediction based on an intelligent backup trigger mechanism, carrying out multi-storage cloud environment resource dynamic scheduling, and constructing an elastic backup storage resource pool; carrying out incremental backup analysis and self-adaptive compression coding to obtain an incremental backup coding packet; and performing dynamic backup sequence adjustment and intelligent incremental backup decision on the incremental backup coding packet based on the elastic backup storage resource pool, and constructing an intelligent incremental backup execution engine. According to the method, the reliability, the accuracy and the traceability of a backup result are improved through self-adaptive intelligent incremental backup.

The invention discloses a permanent incremental backup method based on an S3 bucket-level virtual snapshot, and relates to the technical field of data storage and backup, the method comprises the following steps: initializing a backup system and starting a backup agent program, an index management service and an S3 object storage service; complete backup is executed, and a VID and S3 bucket-level virtual snapshoot are generated; efficiently managing a mapping relation between a file path and a snapshot identifier through a B + tree and an inverted index by utilizing a MongoDB index service; incremental backup is executed, and file changes are accurately recognized through Hash comparison and modification time comparison; a storage position is optimized by adopting an incremental storage and deduplication storage mechanism and an IncDSI optimization algorithm; executing backup chain integration and cleaning; and performing data recovery based on the VID of the file and the directory. According to the method, the backup efficiency is remarkably improved, the storage overhead is reduced, the data recovery process is optimized, and the method is suitable for data backup and management of a large-scale file system and has important application value and prospect.

The invention discloses a terminal data automatic backup and recovery method and system, and relates to the technical field of data backup and recovery, and the method comprises the steps: dynamically adjusting the priority, and generating a personalized backup strategy; capturing data change in real time and executing incremental backup; and encrypting the backup data for version recovery. According to the terminal data automatic backup and recovery method provided by the invention, accurate analysis and priority division are performed on the terminal data through the classification model, so that the backup plan can be dynamically adjusted according to the importance of the data in the backup process. Data change is captured in real time, incremental backup is executed, and the real-time performance and efficiency of backup are effectively improved. An incremental backup algorithm is adopted, only a file change part is recorded, and a change area of a data block is quickly positioned by utilizing hash value comparison, so that the requirement of a storage space is reduced, and meanwhile, the transmission overhead of backup data is reduced. According to the method, better effects are achieved in the aspects of backup real-time performance, backup accuracy, backup pertinence and backup efficiency.

The invention discloses an encryption protection method for network data backup and recovery, which relates to the technical field of data protection, and comprises the following steps: respectively implementing differential backup strategies by adopting a local, cloud and remote three-terminal collaborative backup architecture; and performing local data backup by a combined scheme of complete backup and incremental backup to generate a chained hash value sequence. Three-terminal key isolation and dynamic derivation are adopted to guarantee data security, an independent key system is adopted locally, cloud and remotely, a chain type key is generated locally based on a hash chain, version independent keys are generated at the cloud and remotely, and data security of other terminals is not affected by key leakage of any storage terminal. The recovery priority is automatically switched from local to cloud to remote, the local decrypts incremental data layer by layer through a hash chain, the cloud directly calls an independent key of a target version and uses a synthetic backup complete copy in remote, and the disaster recovery efficiency is improved through layered recovery and synthetic backup.

The invention relates to the technical field of database backup, and particularly provides a MySQL database incremental encryption backup method and device based on MySQLdump, and the device comprises a total backup module, an incremental backup module, an encryption module and a backup management module; the full backup module adopts a MySQL official tool mysqldump to realize complete backup of the database; the incremental backup module is realized on the basis of a MySQL binary log binlog, and data changes are captured by analyzing event records in the binlog; the encryption module is constructed based on an OpenSSL library and provides enterprise-level data protection capability; and the backup management module realizes backup full-life-cycle management. Compared with the prior art, the method has the advantages that the problem of high consumption of traditional total backup resources and the safety problem can be solved, and meanwhile, the complexity and extra cost of a third-party backup tool are avoided.

The invention relates to the technical field of large object data storage, and provides a method, system and equipment for storing large object data in a database, and the method comprises the steps: segmenting the large object data, and setting serial numbers for a plurality of data blocks obtained through segmentation; the data blocks with the serial numbers are stored in different data pages in a scattered mode; constructing a B tree index for each piece of large object data according to the serial number and the storage information; and performing incremental backup on the large object data, and performing positioning recovery on the large object data according to the constructed B-tree index. According to the method, the system and the equipment for storing the large object data in the database, the storage efficiency can be improved, the data access speed can be increased, the system stability can be enhanced, and the development, operation and maintenance efficiency can be improved.

The invention provides a Hadoop cluster incremental backup recovery method based on data block optimization, and relates to the technical field of data management, and the method comprises the following steps: obtaining distribution state information and historical change records of data blocks in a distributed file system, extracting space-time correlation characteristics, and constructing a data block dependency graph containing dependency direction and dependency intensity; identifying the changed data blocks, performing topological sorting, and identifying key path data blocks and independent data block clusters; calculating a distribution entropy value according to a copy distribution position, and determining a backup granularity type; a backup execution sequence is generated according to a topological sorting result, key path data blocks are backed up preferentially, independent data block clusters are backed up in parallel, and backup metadata containing dependency relationship identifiers and distribution entropy values are generated; and performing dependency consistency verification after recovery based on the dependency relationship identifier. According to the method, the backup recovery efficiency is improved, the data consistency is guaranteed, and the storage overhead is reduced.

Computing systems, methods, and non-transitory storage media are provided for determining raw data and additional information from a first storage space to be backed up, obtaining a first snapshot of the raw data and the additional information at a first time, determining one or more parameters of the backing up process based on current or historical network conditions, generate, according to the one or more parameters, a first backup corresponding to the first snapshot at a second storage space, obtaining a second snapshot of the raw data and the additional information at a second time; and generating an incremental backup corresponding to the second snapshot at the second storage space.

Techniques are disclosed relating to providing fast access to restored data in a cloud storage environment. A computing system stores multiple sets of incremental backup data that reflect changes in data being backed up between backup intervals and metadata that indicates which set of incremental backup data stores a given object. The computing system generates an endpoint for a requesting computing system, where the endpoint supports requests for restored backup data and data responses. In response to a request from the requesting computing system via the endpoint, the computing system queries the metadata based on the request and stores metadata retrieved from the query in a key / value store using object identification information as key data and the retrieved metadata as value data. The computing system provides requested data according to a lazy loading technique, including providing requested data via the endpoint based on the metadata in the key / value store.

The invention relates to an openGauss database mirror image backup recovery method and an openGauss database mirror image backup recovery device. The method comprises the following steps: executing full backup, and backing up a dependency item of database service, a data file and a WAL file; incremental backup is executed, and only the data pages and the WAL files which are changed since the last backup are backed up; and executing recovery operation: executing full-amount recovery and specified time point recovery, and supporting single-node recovery and cluster recovery. According to the openGauss database mirror image backup and recovery method based on the CDM technology flow, the backup and recovery efficiency is remarkably improved through the functions of original format backup, incremental backup, specified time point recovery and the like; the method is high in flexibility, supports full backup, incremental backup and specified time point recovery, and can meet backup requirements in different scenes; according to the method, the backup data is kept in a native format, additional processing is not needed during recovery, and data integrity and availability are ensured.

The invention discloses a data backup method and device, equipment, a medium and a computer program product, and relates to the technical field of data processing.The method comprises the steps that when a continuous protection snapshot is created for a source volume, the current backup generation of the source volume before the snapshot is created is set as a snapshot generation identifier; and synchronizing data by relying on mapping relation metadata including the current backup generation of the source volume, the last backup generation of the source volume, the storage backup data generation of the target volume and the water level field. Reading corresponding generation data of the source volume according to the water level mark in the first backup, writing into the target volume, and increasing the water level to the total number of source volume data blocks after completion; during incremental backup, a new snapshot is created, the water level is reset, only adjacent generations of difference data are synchronized, and a corresponding generation identifier is distributed for target volume data in each backup. In this way, no extra bitmap is needed to participate in difference marking, the synchronization efficiency is improved, the target volume keeps historical backup data of all generations in the synchronization period, and the problem that the target volume cannot effectively protect data in the traditional incremental backup synchronization stage is solved.

The invention relates to a data backup method and device, equipment, a storage medium and a program product. The method comprises the following steps: before executing data deletion processing, detecting whether a data slice corresponding to a fingerprint marked as a to-be-repaired state meets a data integrity condition or not; if at least one data slice corresponding to the fingerprint marked as the to-be-repaired state does not meet the data integrity condition, switching the data backup mode into a full backup mode; if the data slices corresponding to the fingerprints marked as the to-be-repaired state all meet the data integrity condition, switching the data backup mode into a first backup mode; wherein in the first backup mode, incremental backup of preset backup times is executed; and in the data backup process, performing backup processing on the target data according to the data backup mode. By adopting the method, the data backup flexibility can be improved.

An in-place data recovery method and system include receiving a user request to restore a virtual machine to a version corresponding to a first point in time, identifying a first snapshot of the virtual machine based on the user request, generating a second snapshot of the virtual machine, identifying a second data block in the second snapshot that includes modified data derived from data content of a first data block in the first snapshot, generating reverse incremental backup data including the first data block, and restoring the virtual machine in-place based on the reverse incremental backup data.

The invention relates to a database technology, in particular to a block incremental backup method based on a shared storage cluster, a product, a medium and equipment. The block incremental backup method comprises the steps that each node of a shared storage cluster independently stores block change information of the node by utilizing a respective mapping file, and the block change information comprises information of a modified data block on the node; when the block incremental backup is executed, based on the block change information of each node, integrating to obtain all modified data blocks; and performing incremental backup processing according to the modified data block to realize block incremental backup. According to the block incremental backup method, only the information of the modified data block is stored through the mapping file, and the block incremental backup is performed based on the block change information, so that the problem of large disk space occupation caused by storage of all data block information is avoided, the disk space occupation is reduced, efficient storage of the block change information is realized, and the storage efficiency is improved. And meanwhile, the backup efficiency is improved, so that the overall performance is improved.

The invention discloses a virtual machine data backup method and device of a cloud computing management platform, a program product, equipment and a medium, and relates to the technical field of computers. The method comprises the following steps: scanning file system metadata of a disk mirror image file of a virtual machine snapshot, screening out a current change file from the disk mirror image file, and determining a current change data block needing to be backed up in an incremental backup mode by comparing a target data block of the current change file with a corresponding data block of reference backup data; the reference backup data is a basic backup data set for incremental comparison; performing hierarchical compression processing on the current changed data block; and constructing a target storage directory in the object storage service according to the virtual machine identifier and the backup task identifier associated with the cloud computing management platform, and backing up the compressed data to the target storage directory. According to the invention, the backup data size and backup time are optimized, and the limitation of low backup function efficiency of the cloud computing management platform is effectively improved.

The invention discloses a data backup method and device, electronic equipment and a storage medium, and relates to the technical field of computers, the data backup method comprises the steps that a cloud hard disk backup interface of a block storage service is expanded, a local backup directory is configured, a snapshot reserved space can be dynamically calculated to optimize storage resource utilization, and the data backup efficiency is improved. In addition, unnecessary directories are eliminated through file system level incremental backup, redundant data transmission is reduced, backup file verification is calculated, data reliability is guaranteed, and therefore the technical problems that in an existing cloud hard disk backup method, due to the fact that a full disk backup strategy is adopted, backup efficiency is low, and storage space is seriously wasted can be solved. The technical effects of improving the backup efficiency of the cloud hard disk, reducing the waste of storage space and guaranteeing the consistency of backup data are achieved.

A first backup of source data is performed. A second backup of the source data is determined to be performed at least in part by determining a plurality of objects that have changed since the first backup and determining a corresponding backup type for each of the plurality of objects that have changed since the first backup. Based on the determined corresponding backup types, a second backup of the source data is performed including by performing an incremental backup of a first portion of the plurality of objects that have changed since the first backup and a full backup of a second portion of the plurality of objects that have changed since the first backup.

The invention discloses a high-fault-tolerance double-line bus control system based on hot backup and self-adaptive diagnosis, and relates to the technical field of double-line bus control, sequence simulation analysis is carried out on single data through a server I, so that incremental backup is carried out on part of the single data, global backup is carried out on the remaining part of the single data, and thus the reliability of the single data is improved. The backup data is stored in the distributed storage unit, the recovery speed and the size of the memory value occupied by the backup data can be considered in the backup mode, and a balance degree is taken from the recovery speed and the size of the memory value occupied by the backup data for operation; meanwhile, by means of analysis on the backup data, the size of the backup data can be further compressed, and the backup data can be recovered as soon as possible when needing to be recovered.

The invention discloses a distributed database backup method and device and a medium, and relates to the field of databases, the method comprises the following steps: receiving a backup instruction of a target database, analyzing the backup instruction, extracting a backup type and a backup target range in the backup instruction, and generating a corresponding backup task; when the full backup task is executed, an initial logic clock is generated, and an initial blood relationship topological graph is constructed; creating a full-amount atomic snapshot, partitioning the full-amount atomic snapshot and storing the full-amount atomic snapshot into a corresponding physical backup medium to generate full-amount metadata; when the incremental backup task is executed, historical backup metadata is obtained, a change log in the target database is scanned according to a historical logic clock, and the historical blood relationship topological graph is updated based on a change record; determining a newly-added storage unit, creating a newly-added atomic snapshot, and storing the newly-added atomic snapshot in a physical backup medium; incremental metadata is generated. The integrity and accuracy of incremental data are ensured, and the risk of data omission or wrong backup is reduced.

The invention discloses a method for improving NTFS incremental backup speed, which comprises the following steps: firstly, creating a snapshot for an NTFS partition needing to be backed up by a user, reading DBR information of the NTFS partition needing to be backed up, and judging whether a file system is normal or not according to the DBR information of the partition; reconstructing a block bitmap of the backup mirror image file by reading bitmap information; loading the MFT file record and the MFT record of the NTFS partition in the mirror image file into a memory, comparing the MFT file record of the NTFS partition on the disk with the MFT file record of the NTFS partition in the mirror image file, and generating a new mirror image file bitmap; and executing backup according to the new mirror image file bitmap. According to the method and the device, the snapshot technology is adopted, the state snapshot of the partition can be quickly created under the condition that the system performance is not influenced, the MFT record on the current partition is compared with the record in the mirror image file, the file which is changed since the last backup is intelligently identified, and then only the changed part is backed up, so that the backup efficiency is improved. Therefore, the storage space and time are saved.

The embodiment of the invention provides a virtual machine data backup method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the one-time full backup of virtual machine data stored in a logical volume for a target virtual machine; detecting whether the storage space of the server exceeds a preset storage space threshold value or not; when it is detected that the storage space of the server exceeds a preset storage space threshold value, a snapshot is created for the logical volume at the current backup moment, and the snapshot comprises bitmap information of virtual machine data; wherein the bitmap information is used for marking data change information of the virtual machine; and determining changed virtual machine data based on the bitmap information so as to perform incremental backup on the changed virtual machine data. According to the technical scheme, the incremental backup can be performed on the virtual machine data of the target virtual machine when the server storage has pressure, and the storage space of the server is saved, so that the technical problems that the server storage pressure is caused and the performance and stability of the server are influenced due to the fact that the virtual machine data is subjected to multiple times of full backup are effectively relieved.

The invention discloses a draft incremental backup method and device, and the method comprises the steps: responding to an initial material selection operation of a user in an editor, constructing and initializing a double linked list, and storing the selected initial material to an initial state node of the double linked list; responding to a draft backup operation of a user, determining a current node of the double linked list according to a current pointer of the double linked list, comparing the draft with node contents stored from the initial state node to the current node, and determining incremental data of the draft; constructing a new node, storing the incremental data to the new node, storing the new node as a next node of the current node of the double linked list, and pointing the current pointer to the new node; and responding to draft revocation operation or redo operation of the user, determining a current node of the double linked list according to a current pointer of the double linked list, obtaining node content of a previous node or a next node of the current node, and returning the node content to the editor so that the editor can operate according to the node content.

The invention discloses a stateless virtual machine backup method based on snapshots and a storage medium. The stateless virtual machine backup method comprises the following steps: acquiring a current mirror chain of each disk of a stateless virtual machine; judging whether a basic mirror image of the stateless virtual machine system disk is stored or not, and if not, storing the basic mirror image; judging whether the data disk is backed up or not, if yes, obtaining the position of the nearest backup data in the mirror chain, and performing incremental backup based on the backup data; if not, carrying out full-quantity backup on the data disk; updating the mirror chain; only the snapshot containing the data disk is allowed to be created in the limited startup state, and management data of the stateless virtual machine startup snapshot always points to the top end of a corresponding data disk mirror chain; while the restarted or shut-down system disk is ensured to be automatically restored, the full-amount and incremental backup of other disks of the stateless virtual machine is realized, and the influence of restoration is avoided.

The present invention provides a distributed backup method and system based on an open MPP database of a data warehouse, including: Step S1: Classify the backup tables in the database based on business processing logic; Step S2: Subdivide the classified tables into different ordered time granularities through time granularity; Step S3: According to the classification of the tables and the time granularity, determine the backup methods as incremental backup, full backup, and overall backup; Step S4: Perform distributed backup, and each write bandwidth is exclusively used through parallel writing. The backup efficiency of the present invention is greatly improved; different backup strategies are designed according to different database table types. While ensuring the integrity of the backup data, the actual backup is performed according to the changed data. The distributed backup mode solves the network bottleneck and improves the backup concurrent writing ability. Therefore, the backup time is greatly reduced to meet the requirements of large data volume backup.

This invention provides a method, system, device, and medium for data backup of power information communication nodes. The method includes classifying data on the communication node according to preset data classification rules to obtain important and non-important data; generating scan objects based on a preset scan object generator on the communication node and the important data; scanning incremental data on the communication node in real time using a preset scanner on a backup server; performing incremental data backup when the scanner detects the scan object; and deleting the scan object when the incremental data backup is complete. Through features such as data classification, incremental backup, and deletion of scan objects after backup, this invention provides an efficient and reliable data backup solution, effectively protecting important data on power information communication nodes and ensuring data availability and integrity.

The invention provides a data processing method and system and a computing device cluster, and belongs to the technical field of databases. The time attribute is introduced into the write record of the preset log WAL file, so that the data can be recovered to any time point. The method comprises the steps that data of a database is fully backed up to a backup space; after full backup, the WAL file is subjected to incremental backup to a backup space, the WAL file is used for storing a write record, and the write record comprises data and a timestamp of the data; when the data of the database needs to be recovered to the target time point, obtaining full-amount backup data and an incremental backup target WAL file from the backup space; and on the basis of recovering the total backup data, by comparing the target time point with the timestamp of the data in the write record of the target WAL file, playing back the write record of which the timestamp of the data in the target WAL file is located before the target time point so as to recover the data of the database to the target time point.

This invention discloses a method, device, and storage medium for secure data backup and migration of storage devices, relating to the field of data backup technology. The method includes the following steps: dividing file data in the storage device using a file data partitioning method to obtain a set of file data blocks; obtaining feature parameters of all file data blocks in the set and obtaining feature vectors for each file data block, denoted as file data block feature information; constructing a data block filtering feature vector and building a document feature filtering table based on the file data block feature information, and performing an initial backup; and performing a second backup based on the file data partitioning method and the document feature filtering table. This invention addresses the problem that existing data backup technologies, when performing incremental backups of file data, cannot simultaneously guarantee backup efficiency and data reliability while avoiding the need to restore each backup individually during data recovery.

The invention provides an incremental backup method and system based on a file system operation log. The incremental backup method comprises the steps that whether current backup is first backup or not is judged; performing full-directory scanning on the backup target, reading the content of the target file, performing hash de-duplication on the data of the variable-length block target based on the content, storing the obtained block data and index information into the storage equipment, and ending the operation; reading data and an index of a preorder backup, synthesizing a complete directory view after the last backup, reading an operation sequence log which is actively recorded by a file system and aims at a target directory, and combining and constructing a modification tree; and traversing and accessing the modification information recorded in the modification tree, reading the data of the file and the block file which need to be backed up again, carrying out hash de-duplication, storing the obtained data to the storage equipment, and ending the operation. According to the method, the opportunity of incremental backup is freely selected through the method that the file system actively records the operation sequence log aiming at the target directory, and the flexibility of incremental backup is improved.

The invention belongs to the technical field of data backup, and provides a server backup method and system based on a Hash algorithm, and the method comprises the following steps: adopting an incremental backup mode, and only backing up data which changes after last backup; in combination with an event notification mechanism of a file system, capturing generated data in real time and backing up the data, and meanwhile, carrying out duplicate removal and blocking processing on the data; the processed data is sent to a specified storage position after being subjected to Hash encryption; carrying out distributed processing on the received data, and managing and distributing the data to the local and the cloud; in the backup process, the monitoring operation state is continuously kept, and logs of backup activities are recorded; data are captured in real time by combining an event notification mechanism of a file system, and security protection measures are set, so that viruses and malicious software are effectively prevented from infecting backup data. And meanwhile, the processed data is encrypted and then sent to a specified storage position, so that the data is further prevented from being illegally accessed.

The invention discloses a continuous data protection method, device and equipment based on a Linux complete machine and a storage medium, and the method comprises the steps: when a backup instruction is received, creating a backup plan, and determining a to-be-backed-up Linux system and an NFS storage end for backup processing; registering a corresponding request interface in the block device of the Linux system to be backed up, and intercepting the received BIO request based on the request interface; the request type of the BIO request is judged, and the request type comprises a write request and other requests; when it is judged that the request type is a write request, whether a backup instruction is executed or not is determined according to the BIO request, and when it is determined that the backup instruction is executed, the Linux system to be backed up is backed up to the NFS storage end. By directly intercepting a block device write request on a kernel level, realizing incremental backup based on a two-dimensional mapping table and combining a metadata management mechanism, the method has the advantages of improving backup universality, reducing system overhead and realizing block-level incremental backup.