39 results about "Continuous data protection" patented technology

In a method for data recovery in a continuous data protection system, delta values representing an exclusive disjunction between successive values of data block contents of a content fragment of a dataset at a time t(n) and a time t(n−1) for n=1 to i, where i is selected according to a predetermined data protection profile, are generated. The delta values can be used to recover a dataset to a value at the selected point in time in association with a snapshot that is selected as a starting point for recovery based on a cost analysis associated with a volume of disk activity to restore.

The invention discloses a high-reliability continuous data protection method and system based on a local disk, and the protection method achieves a dual-backup mechanism of data redundancy by configuring the architecture of a main disk and a dual-backup disk. When the main disk runs normally, the two standby disks record the write operation data at the same time, and the failure of any one of the standby disks cannot cause breakage of the backup chain, so that the problem of single-point failure of a single standby storage medium in a traditional CDP scheme is effectively solved. In addition, the synchronization mechanism of the double standby disks ensures the feasibility of data recovery at any time point, and the data security guarantee capability in a core service scene is remarkably improved.

The invention discloses a continuous data protection method, device and equipment based on a Linux complete machine and a storage medium, and the method comprises the steps: when a backup instruction is received, creating a backup plan, and determining a to-be-backed-up Linux system and an NFS storage end for backup processing; registering a corresponding request interface in the block device of the Linux system to be backed up, and intercepting the received BIO request based on the request interface; the request type of the BIO request is judged, and the request type comprises a write request and other requests; when it is judged that the request type is a write request, whether a backup instruction is executed or not is determined according to the BIO request, and when it is determined that the backup instruction is executed, the Linux system to be backed up is backed up to the NFS storage end. By directly intercepting a block device write request on a kernel level, realizing incremental backup based on a two-dimensional mapping table and combining a metadata management mechanism, the method has the advantages of improving backup universality, reducing system overhead and realizing block-level incremental backup.

One example method includes performing delta operations to protect data. A delta queue is provided that allows a replica volume to be rolled forwards and backwards in time. When rolling the replica volume forward, an undo delta is created such that the replica volume can be moved backwards after being moved forward. When rolling the replica volume backwards, a forward delta is created such that the replica volume can be moved forwards after being moved backwards.

The invention relates to a data transmission method and device, computer equipment and a storage medium. The method comprises the following steps: acquiring a disaster recovery virtual machine list, and dividing the priority of the disaster recovery virtual machines by marking priority identifiers on the virtual machines; according to the priority of the disaster-tolerant virtual machine and a storage capacity threshold value of a cache storage pool corresponding to the host, presetting a disaster-tolerant virtual machine level adjustment strategy; acquiring input data and monitoring a current capacity value of the cache storage pool; dynamically adjusting the level of a continuous data protection execution thread according to the virtual machine priority corresponding to the input data, the current capacity value of a cache storage pool and the disaster recovery virtual machine level adjustment strategy; and transmitting the input data according to the adjusted level of the continuous data protection execution thread. By adopting the method, the virtual machine can be accurately upgraded and degraded, and the influence on the performance of the virtual machine is reduced.

Example embodiments relate generally to systems and methods for continuous data protection (CDP) and more specifically to an input and output (I / O) filtering framework and log management system to seek a near-zero recovery point objective (RPO).

A stream of data changes to content of an object associated with a source system is received. A hot standby version of at least a portion of the object maintained at a recovery system is updated by streaming the received stream of data changes to the recovery system. It is determined that a gap exists in the stream of data changes. In response to determining that the gap exists in the stream of data changes, a reference snapshot is requested from the source system. A current state of the hot standby version of at least the portion of the object maintained at the recovery system is caused to be updated to a state of the portion of the object associated with the reference snapshot.

A method of grouping together Continuous Data Protection (CDP) stream entries into a plurality of buffers, where each buffer stores consecutive CDP stream entries such that the entries are sorted in order in each buffer so that an earlier write entry in the CDP stream precedes a write entry which is dependent upon the earlier write entry. Furthermore, indexing each of the CDP Stream entries, in CDP stream order, in the plurality of buffers using a Large Key Value Store (LKVS). Furthermore, as a result of the indexing, identifying CDP Stream entries which have a valid entry in the LKVS as data which has been changed. Thereafter, marking a previous buffer where the data which has been changed has been located, as being stale data.

The invention discloses a multi-time-point rollback complete machine disaster recovery system and method based on continuous data protection, and relates to the technical field of computer data disaster recovery. The system comprises a source host, a target machine, a control center, a synchronous engine and a switching engine, and full-amount and incremental data capture, transmission and multi-version management are achieved through the synchronous engine; and the switching engine supports one-key switching to a specified time point, dynamically modifies the starting sequence of the target machine to load a source host system, and supports target machine resetting to realize multiple switching. The method covers target machine environment preparation, data synchronization, fault switching and multiple rollback processes, storage occupation is reduced through file backup and difference comparison, and the problems that traditional disaster recovery switching is low in efficiency, high in environment dependence and limited in single-time switching are solved.

The application discloses a generation synchronization method and system of a data volume, relates to the technical field of computers, and is applied to a target cluster, wherein the target cluster comprises a management server for cluster management and a plurality of to-be-synchronized controllers for executing cluster services; through interaction between the management server and the plurality of controllers, generation synchronization of the plurality of controllers about the same data volume is realized, and meanwhile, the creation time of the configuration controller about the continuous data protection of the data volume is taken as a benchmark to ensure generation consistency of all the controllers, thereby solving the technical problem of generation synchronization performance decline of high-density snapshots and achieving the technical effect of improving generation synchronization performance.

This application discloses a highly reliable continuous data protection method and system based on local disks. This protection method implements a dual-backup mechanism for data redundancy by configuring a primary disk and dual backup disks. When the primary disk is operating normally, both backup disks simultaneously record write operation data. Failure of either backup disk will not cause a break in the backup chain, effectively resolving the single-point-of-failure issue of a single backup storage medium in traditional CDP solutions. Furthermore, the synchronization mechanism of the dual backup disks ensures the feasibility of data recovery at any point in time, significantly enhancing data security in core business scenarios.

To restore a file system, activity of ransomware in a master file system is detected that uses a file system level continuous data protection (CDP) system that logs all file operations for backing up the master file system to a backup memory. Further, ransomware activity is blocked by rejecting new input and output, and the last explicit point in time (PIT) and one or more files infected by the ransomware prior to the ransomware activity are determined. For each of the files, an uninfected version is obtained, an operation is selected from log files of the CDP system that is not associated with the detected ransomware activity, the operation being recorded for the uninfected version of the file after the last explicit PIT, and the selected operation is associated with the detected ransomware activity. And applying only the selected operation to the uninfected version of the file for recovery of the file.

The application discloses a network-based scalable continuous data protection method, comprising the following steps: a client node intercepts a local write operation request and sends the request to a server system through a network; a monitoring module of the server receives the request and forwards the request to a data storage module, the module appends data to one or more physical block devices in a received order; when a current device storage space is exhausted, the monitoring module automatically switches to a next available device to continue appending data, thereby realizing dynamic expansion of the storage capacity. The method solves the problem that a traditional CDP system cannot realize recovery at an arbitrary time point due to the limitation of fixed storage space through a seamless expansion mechanism without interrupting service.

In response to determining that continuous data protection is to be enabled for a particular table of a database service, a service component verifies that automated transmission of change records of the table to a log-structured journal has been configured. A given change record comprises a before-image and an after-image associated with a committed database write, and is assigned a unique sequence number. In response to a determination to restore the table as of a specified point in time, a restore record set is identified from the journal with respect to a selected snapshot of the table. The restore record set includes change records which are not represented in the snapshot and are to be represented in the restored table. A restore result table is created using the selected snapshot and the restore record set.

The invention provides a spaceflight task display system and method, electronic equipment and a storage medium, and the display system comprises a data processing module which is used for recording data of a spaceflight task in real time, and recovering the data based on a continuous data protection technology when the data fails; the central control module is used for storing the received recovered data and the data without faults in a data engine process, performing playback processing on a space task based on an improved continuity situation display technology, and sending a processing result to a corresponding display page for display; and the display page is used for subscribing the data of the spaceflight task from the data engine process, analyzing the data of the spaceflight task based on a display page editing tool, generating a monitoring data page and displaying the monitoring data page in the display page in real time. The display system integrates data processing, interface management and multi-task support, and can provide reliable technical guarantee for execution of complex aerospace tasks.

The application discloses a data migration method and device, electronic equipment, a storage medium and a program product, relates to the technical field of computers, and actively identifies a target volume corresponding to each snapshot, and extracts a set of to-be-migrated snapshot data blocks therefrom, so that historical snapshot content can be systematically included in a migration process, and by migrating snapshots in turn from early to late according to creation time, data recovery abnormalities caused by disordered migration order of snapshots are avoided. The application introduces a current generation value and processes the un-migrated snapshots in turn according to the snapshot creation time sequence, solves the technical problem that the mirror volume technology cannot synchronously migrate snapshot data during cross-storage pool migration, and associates the ordinary snapshots with the generation value and continuously writes the snapshots into a target storage space during the migration process, so that conversion to a continuous data protection mechanism is realized. After the migration is completed, the data protection function of the source volume in the new pool occupies less resources and is more advantageous.

Methods and systems for performing an authenticated boot; performing a continuous data protection; performing automatic protection and optionally a consolidation; and performing other defenses and protection of a protected computing device (such as a computer system) are provided. The aspects include integrating security mechanisms (which may include a “call home” function, role and rule-based policies, validating technologies, encryption and decryption technologies, data compression technologies, protected and segmented boot technologies, and virtualization technologies. Booting and operating (either fully or in a restricted manner) are permitted only under a control of a specified role-set, rule-set, and / or a controlling supervisory process or server system(s). The methods and systems make advantageous use of hypervisors and other virtual machine monitors or managers.

Changes made to a database table are accumulated, in durable storage, and snapshots of partitions of the table are obtained. For successive snapshots of a partition, the system accesses a previous snapshot, applies changes from the accumulated changes, and stores the updated snapshot to a durable data store. The accumulated changes and the successive partition snapshots are made available to restore the database to any point in time across a continuum between successive snapshots. Although each partition of the table may have a backup snapshot that was generated at a time different from when other partition snapshots were generated, changes from respective change logs may be selectively log-applied to distinct partitions of a table to generate an on-demand backup of the entire table at common point-in-time across partitions. Point-in-time restores of a table may rely upon a similar process to coalesce partition snapshots that are not aligned in time.

The data processing method and the electronic equipment of the application relate to the technical field of data processing, and through responding to a snapshot instruction, a data protection identifier is generated in real time and its mapping relationship with a list file is updated, so that the creation of a transient snapshot without freezing a memory table and copying a data block is realized, and the write blocking and performance jitter problems caused by the copy-on-write mechanism are overcome; through directly associating the real-time generated data protection identifier with to-be-written data, the accurate binding of data and identifier information is ensured, which provides a basis for efficient management of data; through selecting different storage strategies based on the data size and recording corresponding index information in the data file, the metadata size is compressed, the problem of excessive consumption of storage resources caused by recording full-amount operation metadata is solved, and the effect of high-performance writing and low storage overhead while ensuring continuous data protection capability is realized.

Continuous data protection, including sending, to a target data repository from a source data repository, metadata describing one or more updates to one or more datasets stored within the source data repository; generating, based on the metadata describing the one or more updates to the one or more datasets, an ordered log of metadata describing an ordered application of the one or more updates to the one or more datasets; and generating, on the source data repository and based on the ordered log of metadata, the one or more datasets in accordance with the one or more updates corresponding to a specified point in time.

The application discloses a KVM automatic emergency recovery method based on a continuous data protection technology, a backup module performs continuous data protection on a source host, generates a backup snapshot point at a historical moment, and uniformly manages the backup snapshot point; a trigger module detects the latest backup snapshot point, creates / updates an emergency hot backup virtual machine based on an emergency pre-configuration template, and the virtual machine is in a shutdown standby takeover state; a listening module detects whether a source host business application and network connectivity with the source host exist faults or abnormities; and an emergency starting module performs a starting operation on the emergency hot backup virtual machine, provides services outwardly, takes over the source host business, and the like, wherein the application sets corresponding emergency virtual machine configuration information according to source host parameters for backup protection by pre-setting an emergency pre-configuration template, can shorten an emergency recovery configuration time if a fault occurs, simplifies an emergency recovery operation process, shortens a business interruption time, and guarantees continuous business operation.

The invention discloses a virtual machine data transmission method and device, equipment and a medium, and relates to the technical field of cloud computing, and the method comprises the steps: judging whether to-be-transmitted data is hot data or not after a virtual machine starts continuous data protection; the hot data is data of which the virtual machine disk block access frequency is greater than a target frequency threshold; if the data is hot data, reading and transmitting the first to-be-transmitted data in real time; the first to-be-transmitted data comprises a hot data input / output log and a bitmap in the cache pool; if the data is not the hot data, whether a metadata mark exists in the reflink configuration file or not is judged, and corresponding second to-be-transmitted data is transmitted according to a corresponding judgment result; the metadata mark is a mark used for identifying whether the virtual machine has an effective reflink snapshot chain or not; in the data transmission process, the transmission strategy of the data to be transmitted is adjusted according to the health degree of the virtual machine, so that data transmission is completed. The problem that the performance of the virtual machine is reduced is solved.

The invention discloses a network-based expandable continuous data protection method, which comprises the following steps that: a client node intercepts a local write operation request and sends the local write operation request to a server system through a network; a monitoring module of the server side receives and forwards the request to a data storage module, and the data storage module additionally writes data into one or more physical block devices according to a receiving sequence; and when the storage space of the current equipment is used up, the monitoring module automatically switches to the next available equipment to continue additional writing, so that the dynamic expansion of the storage capacity is realized. According to the method, through a seamless capacity expansion mechanism, the problem that a traditional CDP system cannot be recovered at any time point due to limitation of a fixed storage space can be solved without interrupting service.

The application relates to the technical field of virtual machines, and particularly discloses a continuous data protection method and device, electronic equipment and a storage medium, wherein the method comprises the following steps: temporarily creating a copy image file and taking the copy image file as a disk medium of a virtual machine; starting the virtual machine, performing data operation and recording based on continuous data protection, and simultaneously performing data initialization operation; after the data initialization operation is completed, switching the disk image file to the disk medium of the virtual machine; performing backfill processing on the disk image file; performing data operation and recording based on continuous data protection; the method temporarily creates a copy image file before starting the virtual machine, takes the copy image file as the disk medium used by the virtual machine in the initial stage, and simultaneously performs data initialization operation, so that the virtual machine does not need to pause running to record a data source in the initial stage, the starting rate of the virtual machine can be greatly improved, and the problem of initialization time consumption existing in continuous data protection is effectively solved.

The present application provides a display system, method, electronic device and storage medium for a space mission. The display system includes: a data processing module for recording space mission data in real time and restoring data based on continuous data protection technology when a data failure occurs; a central control module for storing the received restored data and data that has not failed in a data engine process, replaying the space mission based on an improved continuous situation display technology, and sending the processing results to a corresponding display page for display; a display page for subscribing to space mission data from the data engine process, parsing the space mission data based on a display page editing tool, generating a monitoring data page for real-time display on the display page. The display system integrates data processing, interface management and multi-task support, and can provide reliable technical support for the execution of complex space missions.

The invention discloses a security increment synchronization method for continuous data protection, which belongs to the technical field of cloud storage and data protection, and comprises the following steps: S1, when a client initiates a write operation for updating a local file, comparing a client version number with a cloud version number; s2, generating incremental content, and distributing a unique block ID for each formula block according to the file formula; s3, encrypting the data blocks to obtain encrypted data blocks, and disrupting the sequence of the encrypted data blocks; s4, the client uploads the encrypted data blocks and the block IDs corresponding to the encrypted data blocks, and updates a deletion formula of the cloud; and S5, the cloud end manages the encrypted data block uploaded in the step S4 through a key value storage system, updates the version number of the cloud end, and notifies the client to update the corresponding version number at the same time. According to the method, the advantages of Rsync and Dsync are combined, an informed redundancy detection mechanism is provided, byte-level redundancy is ensured to be eliminated, calculation and bandwidth overhead is remarkably reduced, and an encryption protection mechanism of a data and synchronization mode is introduced.

The invention relates to a CDP-based data fusion method and system. Comprising a multi-source heterogeneous data real-time acquisition and preprocessing module, a cross-platform identity recognition module based on a graph neural network, a dynamic label management and customer portrait construction module, a privacy protection and data security control module, a continuous data protection and rapid recovery module and a data service and application interface module, customer data is collected from a multi-source heterogeneous system through a self-adaptive data connector, real-time and batch processing is performed by adopting a stream batch integrated processing engine, cross-platform customer identity recognition is realized based on a graph neural network, customer tags are generated and managed through a dynamic tag management system, and data security is protected by applying a privacy computing technology. And realizing data tracking and recovery by utilizing a continuous data protection mechanism. According to the method, the federated learning framework, the real-time stream processing engine, the dynamic label management system and the privacy computing technology are introduced, so that the data fusion efficiency, the real-time performance and the compliance of the CDP system are remarkably improved.

Example embodiments relate generally to systems and methods for continuous data protection (CDP) and more specifically to an input and output (I / O) filtering framework and log management system to seek a near-zero recovery point objective (RPO).

The present invention proposes a data intelligent capture method and system for volume-level continuous data protection, which can effectively solve the problems in traditional CDP technology, including: a volume-level driver module, an intelligent capture and replication module for system volume-level data, which is used to transmit the captured change data to the backup end and apply it. According to different data change log file information, different methods will be used to transmit the corresponding changed data to the backup end, and the changed data will be applied. The data capture mode switching module and the application layer module monitor the disk IO status, network status, cache space size and other information of the protected server, and flexibly switch the data capture mode of the driver module to solve the cache space overflow problem, and make a good balance between cache space usage and recoverable points so that the protection plan can work normally.