40 results about "Incremental backup" patented technology

The invention relates to the technical field of database backup, and particularly provides a MySQL database incremental encryption backup method and device based on MySQLdump, and the device comprises a total backup module, an incremental backup module, an encryption module and a backup management module; the full backup module adopts a MySQL official tool mysqldump to realize complete backup of the database; the incremental backup module is realized on the basis of a MySQL binary log binlog, and data changes are captured by analyzing event records in the binlog; the encryption module is constructed based on an OpenSSL library and provides enterprise-level data protection capability; and the backup management module realizes backup full-life-cycle management. Compared with the prior art, the method has the advantages that the problem of high consumption of traditional total backup resources and the safety problem can be solved, and meanwhile, the complexity and extra cost of a third-party backup tool are avoided.

The invention provides a Hadoop cluster incremental backup recovery method based on data block optimization, and relates to the technical field of data management, and the method comprises the following steps: obtaining distribution state information and historical change records of data blocks in a distributed file system, extracting space-time correlation characteristics, and constructing a data block dependency graph containing dependency direction and dependency intensity; identifying the changed data blocks, performing topological sorting, and identifying key path data blocks and independent data block clusters; calculating a distribution entropy value according to a copy distribution position, and determining a backup granularity type; a backup execution sequence is generated according to a topological sorting result, key path data blocks are backed up preferentially, independent data block clusters are backed up in parallel, and backup metadata containing dependency relationship identifiers and distribution entropy values are generated; and performing dependency consistency verification after recovery based on the dependency relationship identifier. According to the method, the backup recovery efficiency is improved, the data consistency is guaranteed, and the storage overhead is reduced.

This invention provides a method, system, device, and medium for data backup of power information communication nodes. The method includes classifying data on the communication node according to preset data classification rules to obtain important and non-important data; generating scan objects based on a preset scan object generator on the communication node and the important data; scanning incremental data on the communication node in real time using a preset scanner on a backup server; performing incremental data backup when the scanner detects the scan object; and deleting the scan object when the incremental data backup is complete. Through features such as data classification, incremental backup, and deletion of scan objects after backup, this invention provides an efficient and reliable data backup solution, effectively protecting important data on power information communication nodes and ensuring data availability and integrity.

This invention discloses a method, device, and storage medium for secure data backup and migration of storage devices, relating to the field of data backup technology. The method includes the following steps: dividing file data in the storage device using a file data partitioning method to obtain a set of file data blocks; obtaining feature parameters of all file data blocks in the set and obtaining feature vectors for each file data block, denoted as file data block feature information; constructing a data block filtering feature vector and building a document feature filtering table based on the file data block feature information, and performing an initial backup; and performing a second backup based on the file data partitioning method and the document feature filtering table. This invention addresses the problem that existing data backup technologies, when performing incremental backups of file data, cannot simultaneously guarantee backup efficiency and data reliability while avoiding the need to restore each backup individually during data recovery.

The invention belongs to the technical field of data backup, and provides a server backup method and system based on a Hash algorithm, and the method comprises the following steps: adopting an incremental backup mode, and only backing up data which changes after last backup; in combination with an event notification mechanism of a file system, capturing generated data in real time and backing up the data, and meanwhile, carrying out duplicate removal and blocking processing on the data; the processed data is sent to a specified storage position after being subjected to Hash encryption; carrying out distributed processing on the received data, and managing and distributing the data to the local and the cloud; in the backup process, the monitoring operation state is continuously kept, and logs of backup activities are recorded; data are captured in real time by combining an event notification mechanism of a file system, and security protection measures are set, so that viruses and malicious software are effectively prevented from infecting backup data. And meanwhile, the processed data is encrypted and then sent to a specified storage position, so that the data is further prevented from being illegally accessed.

The invention relates to the technical field of data processing, and discloses a data backup method, device, equipment, medium and product, the method comprises the following steps: in response to a closing instruction for a target virtual machine, obtaining a target bitmap corresponding to the target virtual machine; storing the target bitmap into a target storage space distributed for the target virtual machine in the shared block; the shared block is a pre-applied data block for recording bitmaps of a plurality of virtual machines; in response to a starting instruction for a target virtual machine, obtaining a target bitmap from a target storage space of the shared block, and importing the target bitmap; and in response to a backup instruction for the target virtual machine, performing incremental backup on the target virtual machine according to the target bitmap. According to the method and the device, the validity of incremental backup cannot be influenced when the virtual machine is shut down, the incremental backup can be continued after the virtual machine is started up, the backup efficiency can be improved, and the method and the device are suitable for various disk formats.

The application discloses an Oracle database management method and device based on VMware snapshots, equipment and a storage medium, and the method comprises the following steps: creating a target virtual machine on a VMware virtual platform, and restoring the target virtual machine based on full backup of an Oracle database; when full backup of the target virtual machine is restored, performing snapshot processing on the target virtual machine to generate a first VMware snapshot of the target virtual machine; when incremental backup is performed, obtaining incremental data of the Oracle database in a current backup stage, wherein the current backup stage is a stage between current backup and adjacent previous backup; performing incremental restoration in the target virtual machine to obtain a database copy of the target virtual machine when the adjacent previous incremental backup is completed, and restoring the incremental data into the database copy; and when the restoration processing is completed, updating the first VMware snapshot based on the incremental data. The backup and restoration efficiency is significantly improved.

The application discloses a data backup method and device, an electronic device and a storage medium, relates to the technical field of computers, and comprises a cloud hard disk backup interface extended by a block storage service and a local backup directory configured, can dynamically calculate a snapshot reserved space to optimize storage resource utilization, and can also exclude unnecessary directories through a file system level incremental backup to reduce redundant data transmission, and calculate a backup file checksum to guarantee data reliability, so that the technical problem of low backup efficiency and serious storage space waste caused by a full disk backup strategy in the prior cloud hard disk backup method can be solved, and the technical effects of improving cloud hard disk backup efficiency, reducing storage space waste, and guaranteeing backup data consistency are achieved.

This invention discloses a data backup method, apparatus, device, and medium for cloud-native applications. The method includes: acquiring a cloud-native stateful application and its corresponding multiple components, as well as the backup priority of each component; acquiring incremental backup data for each stateful component and full backup data for each stateless component according to the backup priority of each component; and associating and storing the incremental backup data for each stateful component and the full backup data for each stateless component to complete the data backup of the cloud-native stateful application. The technical solution of this embodiment, by performing incremental backups on the stateful components included in the stateful application and full backups on the stateless components, and associating and storing the incremental backup data and full backup data to complete the data backup, can ensure the consistency of the backup data of the stateful application and improve the probability of successful application recovery.

The invention relates to the technical field of data backup, in particular to a data asset security management-oriented data incremental backup method and system. According to the access frequency, the update frequency and the security level of different types of core asset data, the distinction degree of each type of core asset data is obtained; for any kind of core asset data, forming a to-be-analyzed data group by the data at each moment, the attribute data and the security management data; obtaining a plurality of to-be-analyzed data group clusters according to the attribute data corresponding to different to-be-analyzed data groups and the network transmission state data and the backup record information data in the security management data; according to the data distribution and the distinction degree in all the to-be-analyzed data groups in different to-be-analyzed data group clusters, obtaining the backup significance of each type of core asset data; and obtaining candidate incremental data, and carrying out incremental data backup. According to the method, the safety of the backup data is improved by accurately obtaining the incremental data of different core asset data assets.

The application discloses a virtual machine data backup method, device, program product, equipment and medium of a cloud computing management platform, relates to the technical field of computers, and comprises the following steps: generating a virtual machine snapshot; filtering out current change files from a disk image file of the virtual machine snapshot by scanning file system metadata of the disk image file, and determining current change data blocks that need to be backed up in an incremental backup mode by comparing target data blocks of the current change files with corresponding data blocks of reference backup data; the reference backup data is a basic backup data set used for incremental comparison; performing hierarchical compression processing on the current change data blocks; constructing a target storage directory in an object storage service according to virtual machine identifiers and backup task identifiers associated with the cloud computing management platform, and backing up the compressed data into the target storage directory. The application optimizes the backup data size and the backup time, and effectively improves the low-efficiency limitation of the backup function of the cloud computing management platform.

The embodiment of the invention provides a data backup method. The data backup method comprises a plurality of rounds of incremental backups, any round of incremental backup comprises the following steps: determining a plurality of incremental data blocks to be backed up according to a current baseline index set and a plurality of incremental index sets; the plurality of incremental index sets are index sets of incremental data blocks corresponding to a plurality of rounds of incremental backups completed after the baseline index set is generated. And executing backup on the plurality of incremental data blocks, and generating a current round of incremental index set according to the indexes corresponding to the data blocks subjected to backup. And judging whether a merging condition is met or not based on the plurality of increment index sets and the current round of increment index set, and if the merging condition is met, merging the current baseline index set, the plurality of increment index sets and the current round of increment index set to serve as an updated baseline index set.

The utility model discloses a device for integrating a distributed TMS (Transport Management System) upgrading system, which belongs to the technical field of terminal management and comprises an intelligent networking module which has an automatic discovery function and can identify all local TMS system equipment capable of participating in upgrading in the same network segment through a broadcast type detection means according to a network protocol; a temporary distributed upgrading network is automatically established; the upgrade package intelligent management module is used for carrying out full-life-cycle management on the TMS system upgrade package; the upgrading process regulation and control module is used for coordinating and monitoring the upgrading process of each local TMS system; the data security guarantee module is used for accurately backing up important data in the local TMS system by adopting an advanced incremental backup technology before the TMS system is upgraded; according to the utility model, network resources in the same network segment are fully utilized through the distributed upgrading architecture, the network bottleneck caused by centralized upgrading is avoided, the upgrading speed is greatly accelerated, and the time required for upgrading is shortened.

This application provides a method, device, storage medium, and program product for parallel merging of database backup sets, relating to the field of distributed systems. The method includes: obtaining the dependency chain of the backup sets to be merged; obtaining data block penetration markers based on the backup set dependency chain; processing data blocks in the full backup set in parallel to a temporary directory through multiple first sub-processes; processing at least one file dependent on an incremental backup set in parallel to a temporary directory through multiple second sub-processes; merging incremental data blocks from at least one incremental backup set in parallel to a temporary directory through multiple third sub-processes; and organizing and generating a merged full backup set based on the contents of the temporary directory. This method adds parallel scheduling capabilities based on data block penetration markers, improving the execution efficiency of merging backup sets.

Techniques are disclosed relating to providing fast access to restored data in a cloud storage environment. A computing system stores multiple sets of incremental backup data that reflect changes in data being backed up between backup intervals and metadata that indicates which set of incremental backup data stores a given object. The computing system generates an endpoint for a requesting computing system, where the endpoint supports requests for restored backup data and data responses. In response to a request from the requesting computing system via the endpoint, the computing system queries the metadata based on the request and stores metadata retrieved from the query in a key / value store using object identification information as key data and the retrieved metadata as value data. The computing system provides requested data according to a lazy loading technique, including providing requested data via the endpoint based on the metadata in the key / value store.

The invention discloses a file backup recovery method and system, and the method comprises the steps: creating a backup directory corresponding to a to-be-backed-up directory structure of a source end at a target end, and completely synchronizing a specified file or directory of the source end to the backup directory in an original format and structure; after each time of successful full backup or incremental backup, creating a time point snapshot for the data volume where the backup directory is located at the target end; when data needs to be recovered, a snapshot at a specific time point is selected from the existing snapshot list, and a writable clone volume is created in time based on the snapshot; and mounting the clone volume to a specified recovery target mounting point through a network storage protocol, so that the backup data can be immediately accessed and used in a native format. By utilizing the embodiment of the invention, the backup storage efficiency can be remarkably improved, the recovery process can be accelerated, and the backup data can be instantly accessed and used in a native format.

Techniques are provided for incremental backup to an object store. A request may be received from an application to perform a backup from a volume hosted by a node to a backup target within the object store. A set of changed files within the volume since a prior backup of the volume was performed to the backup target is identified, along with metadata associated with the set of changed files. The metadata is utilized to identify changed data blocks comprising data of the set of changed files that was modified since the prior backup. The changed data blocks are backed up to the object store.

The invention relates to a software maintenance method and device. The method comprises the following steps: generating difference metadata according to a software upgrade package and a current version; generating incremental backup data according to the difference metadata, and storing the incremental backup data in a backup directory; recording the feature data of the backup in the backup data link file, adding the upgrade version node as a child node to the current version node in the version tree structure, and recording a change path between the nodes as a backup directory; and when the software needs to roll back, rolling back the software to the target version according to the version tree structure, the backup data link file and the change path. By the adoption of the method, only the changed incremental data are backed up in the software upgrading process, and the storage space occupied by the backup data is reduced; the relation between the versions in the software iteration process is established, cross-level rollback of the software versions is achieved, and convenience and reliability of software maintenance are improved.

The invention discloses a mining portable instrument intelligent management system, which belongs to the technical field of mining equipment management, and comprises a central control unit, an intelligent issuing terminal, a network communication unit, a user interaction interface and a data security storage module, wherein the intelligent issuing terminal integrates a multi-mode biological recognition module, a self-adaptive intelligent storage issuing module, an equipment health monitoring module and a dual security verification module, and the data security storage module adopts a strategy of combining incremental backup, remote backup and disaster recovery plans and is matched with a high-reliability storage medium and a redundancy architecture. High-precision non-inductive identity authentication is realized through a multi-mode biological recognition technology, an equipment distribution process is optimized in combination with a self-adaptive storage and distribution mechanism, key data is guaranteed not to be lost and recoverable by depending on an omnibearing data security policy, and security risks are reduced by utilizing equipment health monitoring and dual security verification. The portable instrument issuing efficiency and the management standardization can be remarkably improved, and the full life cycle safety of data is ensured.

The application discloses a data backup method, device, equipment, medium and computer program product, relates to the technical field of data processing, and sets the backup generation of the source volume before creating a snapshot as the snapshot generation identifier when creating a continuous protection snapshot for the source volume; and synchronizes the mapping relationship metadata containing the backup generation of the source volume, the last backup generation, the backup data generation of the target volume and the water level field. The corresponding generation data of the source volume is read according to the water level mark and written into the target volume during the first backup, and after completion, the water level is incremented to the total number of data blocks of the source volume; a new snapshot is created and the water level is reset during the incremental backup, only the difference data between adjacent generations is synchronized, and the corresponding generation identifier is allocated to the target volume data during each backup. In this way, the difference mark does not need to involve an additional bitmap, the synchronization efficiency is improved, the target volume retains the historical backup data of each generation during synchronization, and the problem that the target volume cannot effectively protect data during the synchronization stage of the traditional incremental backup is solved.

This application provides a data backup method and electronic device, relating to the field of cloud computing technology. The method includes: determining a first estimated data recovery time for unbacked-up data and backed-up data on an edge server; if the first estimated data recovery time exceeds a preset time threshold, acquiring and backing up the data to be backed up corresponding to the unbacked-up data to obtain incremental backup data; the incremental backup data and the backed-up data are used for data recovery on the edge server. In this embodiment, backing up the unbacked-up data when the first estimated data recovery time exceeds the preset time threshold satisfies the data recovery needs of the edge server while reducing the number of backups and minimizing resource consumption caused by frequent backups.

The invention discloses a block-level additional backup method and system supporting file exclusion, and relates to the technical field of data backup and recovery, and the method comprises the following steps: deploying and initializing a file system filter driver; configuring an exclusion file rule, and creating an initial exclusion bitmap; dynamically monitoring the change of the storage space of the excluded file; in cooperation with a block-level backup driver, backup data filtering is achieved; according to the method, a file system sensing layer is introduced into a block-level backup process, data blocks corresponding to files located in an exclusion list can be accurately recognized before and after backup, the data blocks are skipped in a backup data set, and the data blocks in the backup data set are subjected to consistency verification and exclusion bitmap maintenance. According to the method, transmission and storage of invalid data are eliminated from the source, particularly for data which are written frequently but have no reserved value, the reduction effect of the backup data volume is particularly remarkable, and consistency processing is synchronously carried out on file system metadata while specified file data blocks are eliminated.

The invention provides a distributed database incremental backup method based on RDMA, and belongs to the technical field of distributed databases. Incremental data needing to be backed up are accurately positioned through an incremental data detection module of a database main node in combination with a dual recognition mechanism of data block check value comparison and transaction log LSN number marking, and the backup efficiency is improved. Resource waste of total data transmission is avoided; an RDMA reliable connection transmission mode is adopted, so that a backup node can directly access a registered memory area where incremental data of a main node is located, multiple rounds of data copying are omitted, and a database main node CPU does not need to participate in a transmission process; meanwhile, a continuity verification module based on an LSN number is deployed at a backup node, the integrity of received data can be verified in real time, and if data missing exists, rapid supplementary transmission is conducted through RDMA connection, and the integrity of backup data is guaranteed. And the backup task and the user service task have no resource competition, so that an efficient, low-consumption and reliable incremental backup solution is provided for the distributed database.

System and method for implementing parallel Change File Tracking (CFT) between a distributed File Server Virtual Machine (FSVM) system and a scale-out backup system using underlying snapshot technology. The FSVM system executes efficient assignments of backup streams between worker nodes of the backup system and computing nodes of the FSVM system based on the number of available worker nodes at the backup system. The assignment of backup streams allows for parallel processing of incremental backup data based on successive data file snapshots. The parallel incremental backup may, for example, be per node, per share, or per data size across nodes or shares.

An incremental backup agent performs backup operations that synchronize database on client side to a server database. In one embodiment, such backup operations are incremental backups, where the agent may identify differences between the current directory with the latest backed up version. The agent may issue a direct RPC using SMB protocols or NFS protocols to fetch all entries of directories with metadata in a single RPC call, instead of issuing one call to fetch metadata for each directory entry. The agent may identify changes with efficiency by performing checksum changes in a DFS manner. Starting from a root directory, the agent may generate a checksum for each directory and compare the checksums on the client side with the retrieved fingerprints, and if the backup agent identifies that the fingerprints match, the backup agent may then go to a deeper level and compare the fingerprints for child directories.

This application discloses a snapshot processing method, apparatus, and electronic device based on object storage buckets. The method includes: responding to a snapshot comparison command via an object storage gateway to determine a first snapshot and a second snapshot corresponding to the object storage bucket; obtaining a target log based on the generation time of the first snapshot and the generation time of the second snapshot, wherein the target log is stored in a preset area and consists of object operation records sorted according to the completion time of modification operations; determining a first object difference set between the first snapshot and the second snapshot based on the target log, wherein the first object difference set includes objects that differ between the second snapshot and the first snapshot, and the objects are data stored in the object storage bucket; and performing incremental backup of the data generated by the object storage bucket during a target time period based on the first object difference set. This application solves the technical problem of low backup efficiency in existing technologies for backing up object storage buckets.

This invention discloses a remote backup method and system suitable for narrow bandwidth environments, relating to the field of data backup and recovery technology. The method includes the following steps: deploying a cache server to build a centralized relay architecture; receiving backup instructions and determining the backup type; if it is an incremental backup, entering incremental caching mode; if it is the first or full backup, entering full pass-through mode; performing sparse file, bitmap, and metadata collaborative capture for incremental backup; performing pass-through forwarding mode for full backup; and using QoS-based intelligent bandwidth utilization and transmission priority scheduling. This invention accurately captures incremental data through a dual-file mechanism of sparse files and bitmaps, avoiding storage resource waste. Combined with a dual QoS strategy of snapshot pre-transmission and dynamic priority scheduling, it maximizes narrow bandwidth resource utilization, balances fairness in multi-client backup with core business priority, and efficiently adapts to narrow bandwidth, high latency cross-data center backup scenarios.

The application discloses a data backup method and system of an in-memory database, and belongs to the technical field of in-memory database backup.The application determines consistent data and log data of each data partition in the in-memory database through a write-time copy mechanism; then, the consistent data is split to obtain a plurality of data blocks, and hash fingerprint data of each data block is calculated, and then a current hash signature digest tree of each data partition is constructed based on the hash fingerprint data; subsequently, by comparing nodes of a historical hash signature digest tree and the current hash signature digest tree, incremental data of the data partition is obtained; then, the incremental data and the hash fingerprint data are used to generate incremental backup data, and the incremental backup data is associated with the log data to form backup metadata, and the in-memory database is backed up with the backup metadata, so that the efficiency of data backup of the in-memory database can be improved, and the storage space occupation and consumption can be reduced.

The application discloses a kind of firmware non-inductive backup and upgrading method and system of electric two-wheeled vehicle, it is related to electric two-wheeled vehicle upgrading technical field, the independent storage area of the Bluetooth chip is used as the firmware backup area of controller MCU in the present application, user terminal background non-inductive periodic acquisition backup area firmware version and integrity state, dynamic trigger complete backup or incremental backup process;User terminal is directly transmitted new firmware to controller MCU when OTA upgrading, without first backup then upgrading, controller MCU automatically rolls back firmware of the backup area of Bluetooth chip to local running area when upgrading interruption or failure.The backup process uses page-by-page difference comparison, packet transmission, multiple check and breakpoint resume mechanism, to ensure data reliability.The present application discards traditional MCU dual-zone backup architecture, reduces hardware cost, greatly shortens OTA upgrading time, improves backup efficiency, realizes background non-inductive backup and safe upgrading.

The invention discloses a time sequence database-based backup restoration method and system, and belongs to the technical field of time sequence databases, the time sequence database-based backup restoration method comprises full-amount backup restoration and incremental backup restoration, and the content of full-amount backup comprises all metadata information and storage data information of a target from establishment to current backup execution moment; the content of the incremental backup is all metadata change information and storage data information of the target from the last backup moment to the current backup moment. All backup and restoration operations comprise a plurality of hierarchies, namely an SQL (Structured Query Language) layer used for analyzing backup and restoration grammar; the JOB layer is used for starting a backup restoration task; the metadata layer is used for backing up and restoring metadata information of the database / table; the distributed layer is used for sending the backup and restoration task to each node; and the storage layer is used for acquiring the data falling into the disk. According to the method, the problem of data migration of the database system can be solved, and a better effect on data disaster recovery is achieved, so that the product competitiveness is improved.