30 results about "Continuous data protection" patented technology

The invention discloses a high-reliability continuous data protection method and system based on a local disk, and the protection method achieves a dual-backup mechanism of data redundancy by configuring the architecture of a main disk and a dual-backup disk. When the main disk runs normally, the two standby disks record the write operation data at the same time, and the failure of any one of the standby disks cannot cause breakage of the backup chain, so that the problem of single-point failure of a single standby storage medium in a traditional CDP scheme is effectively solved. In addition, the synchronization mechanism of the double standby disks ensures the feasibility of data recovery at any time point, and the data security guarantee capability in a core service scene is remarkably improved.

The invention discloses a continuous data protection method, device and equipment based on a Linux complete machine and a storage medium, and the method comprises the steps: when a backup instruction is received, creating a backup plan, and determining a to-be-backed-up Linux system and an NFS storage end for backup processing; registering a corresponding request interface in the block device of the Linux system to be backed up, and intercepting the received BIO request based on the request interface; the request type of the BIO request is judged, and the request type comprises a write request and other requests; when it is judged that the request type is a write request, whether a backup instruction is executed or not is determined according to the BIO request, and when it is determined that the backup instruction is executed, the Linux system to be backed up is backed up to the NFS storage end. By directly intercepting a block device write request on a kernel level, realizing incremental backup based on a two-dimensional mapping table and combining a metadata management mechanism, the method has the advantages of improving backup universality, reducing system overhead and realizing block-level incremental backup.

One example method includes performing delta operations to protect data. A delta queue is provided that allows a replica volume to be rolled forwards and backwards in time. When rolling the replica volume forward, an undo delta is created such that the replica volume can be moved backwards after being moved forward. When rolling the replica volume backwards, a forward delta is created such that the replica volume can be moved forwards after being moved backwards.

Example embodiments relate generally to systems and methods for continuous data protection (CDP) and more specifically to an input and output (I / O) filtering framework and log management system to seek a near-zero recovery point objective (RPO).

A stream of data changes to content of an object associated with a source system is received. A hot standby version of at least a portion of the object maintained at a recovery system is updated by streaming the received stream of data changes to the recovery system. It is determined that a gap exists in the stream of data changes. In response to determining that the gap exists in the stream of data changes, a reference snapshot is requested from the source system. A current state of the hot standby version of at least the portion of the object maintained at the recovery system is caused to be updated to a state of the portion of the object associated with the reference snapshot.

A method of grouping together Continuous Data Protection (CDP) stream entries into a plurality of buffers, where each buffer stores consecutive CDP stream entries such that the entries are sorted in order in each buffer so that an earlier write entry in the CDP stream precedes a write entry which is dependent upon the earlier write entry. Furthermore, indexing each of the CDP Stream entries, in CDP stream order, in the plurality of buffers using a Large Key Value Store (LKVS). Furthermore, as a result of the indexing, identifying CDP Stream entries which have a valid entry in the LKVS as data which has been changed. Thereafter, marking a previous buffer where the data which has been changed has been located, as being stale data.

The application discloses a generation synchronization method and system of a data volume, relates to the technical field of computers, and is applied to a target cluster, wherein the target cluster comprises a management server for cluster management and a plurality of to-be-synchronized controllers for executing cluster services; through interaction between the management server and the plurality of controllers, generation synchronization of the plurality of controllers about the same data volume is realized, and meanwhile, the creation time of the configuration controller about the continuous data protection of the data volume is taken as a benchmark to ensure generation consistency of all the controllers, thereby solving the technical problem of generation synchronization performance decline of high-density snapshots and achieving the technical effect of improving generation synchronization performance.

This application discloses a highly reliable continuous data protection method and system based on local disks. This protection method implements a dual-backup mechanism for data redundancy by configuring a primary disk and dual backup disks. When the primary disk is operating normally, both backup disks simultaneously record write operation data. Failure of either backup disk will not cause a break in the backup chain, effectively resolving the single-point-of-failure issue of a single backup storage medium in traditional CDP solutions. Furthermore, the synchronization mechanism of the dual backup disks ensures the feasibility of data recovery at any point in time, significantly enhancing data security in core business scenarios.

The application discloses a network-based scalable continuous data protection method, comprising the following steps: a client node intercepts a local write operation request and sends the request to a server system through a network; a monitoring module of the server receives the request and forwards the request to a data storage module, the module appends data to one or more physical block devices in a received order; when a current device storage space is exhausted, the monitoring module automatically switches to a next available device to continue appending data, thereby realizing dynamic expansion of the storage capacity. The method solves the problem that a traditional CDP system cannot realize recovery at an arbitrary time point due to the limitation of fixed storage space through a seamless expansion mechanism without interrupting service.

The application discloses a data migration method and device, electronic equipment, a storage medium and a program product, relates to the technical field of computers, and actively identifies a target volume corresponding to each snapshot, and extracts a set of to-be-migrated snapshot data blocks therefrom, so that historical snapshot content can be systematically included in a migration process, and by migrating snapshots in turn from early to late according to creation time, data recovery abnormalities caused by disordered migration order of snapshots are avoided. The application introduces a current generation value and processes the un-migrated snapshots in turn according to the snapshot creation time sequence, solves the technical problem that the mirror volume technology cannot synchronously migrate snapshot data during cross-storage pool migration, and associates the ordinary snapshots with the generation value and continuously writes the snapshots into a target storage space during the migration process, so that conversion to a continuous data protection mechanism is realized. After the migration is completed, the data protection function of the source volume in the new pool occupies less resources and is more advantageous.

Methods and systems for performing an authenticated boot; performing a continuous data protection; performing automatic protection and optionally a consolidation; and performing other defenses and protection of a protected computing device (such as a computer system) are provided. The aspects include integrating security mechanisms (which may include a “call home” function, role and rule-based policies, validating technologies, encryption and decryption technologies, data compression technologies, protected and segmented boot technologies, and virtualization technologies. Booting and operating (either fully or in a restricted manner) are permitted only under a control of a specified role-set, rule-set, and / or a controlling supervisory process or server system(s). The methods and systems make advantageous use of hypervisors and other virtual machine monitors or managers.

Changes made to a database table are accumulated, in durable storage, and snapshots of partitions of the table are obtained. For successive snapshots of a partition, the system accesses a previous snapshot, applies changes from the accumulated changes, and stores the updated snapshot to a durable data store. The accumulated changes and the successive partition snapshots are made available to restore the database to any point in time across a continuum between successive snapshots. Although each partition of the table may have a backup snapshot that was generated at a time different from when other partition snapshots were generated, changes from respective change logs may be selectively log-applied to distinct partitions of a table to generate an on-demand backup of the entire table at common point-in-time across partitions. Point-in-time restores of a table may rely upon a similar process to coalesce partition snapshots that are not aligned in time.

The data processing method and the electronic equipment of the application relate to the technical field of data processing, and through responding to a snapshot instruction, a data protection identifier is generated in real time and its mapping relationship with a list file is updated, so that the creation of a transient snapshot without freezing a memory table and copying a data block is realized, and the write blocking and performance jitter problems caused by the copy-on-write mechanism are overcome; through directly associating the real-time generated data protection identifier with to-be-written data, the accurate binding of data and identifier information is ensured, which provides a basis for efficient management of data; through selecting different storage strategies based on the data size and recording corresponding index information in the data file, the metadata size is compressed, the problem of excessive consumption of storage resources caused by recording full-amount operation metadata is solved, and the effect of high-performance writing and low storage overhead while ensuring continuous data protection capability is realized.

Continuous data protection, including sending, to a target data repository from a source data repository, metadata describing one or more updates to one or more datasets stored within the source data repository; generating, based on the metadata describing the one or more updates to the one or more datasets, an ordered log of metadata describing an ordered application of the one or more updates to the one or more datasets; and generating, on the source data repository and based on the ordered log of metadata, the one or more datasets in accordance with the one or more updates corresponding to a specified point in time.

The application discloses a KVM automatic emergency recovery method based on a continuous data protection technology, a backup module performs continuous data protection on a source host, generates a backup snapshot point at a historical moment, and uniformly manages the backup snapshot point; a trigger module detects the latest backup snapshot point, creates / updates an emergency hot backup virtual machine based on an emergency pre-configuration template, and the virtual machine is in a shutdown standby takeover state; a listening module detects whether a source host business application and network connectivity with the source host exist faults or abnormities; and an emergency starting module performs a starting operation on the emergency hot backup virtual machine, provides services outwardly, takes over the source host business, and the like, wherein the application sets corresponding emergency virtual machine configuration information according to source host parameters for backup protection by pre-setting an emergency pre-configuration template, can shorten an emergency recovery configuration time if a fault occurs, simplifies an emergency recovery operation process, shortens a business interruption time, and guarantees continuous business operation.

The invention discloses a virtual machine data transmission method and device, equipment and a medium, and relates to the technical field of cloud computing, and the method comprises the steps: judging whether to-be-transmitted data is hot data or not after a virtual machine starts continuous data protection; the hot data is data of which the virtual machine disk block access frequency is greater than a target frequency threshold; if the data is hot data, reading and transmitting the first to-be-transmitted data in real time; the first to-be-transmitted data comprises a hot data input / output log and a bitmap in the cache pool; if the data is not the hot data, whether a metadata mark exists in the reflink configuration file or not is judged, and corresponding second to-be-transmitted data is transmitted according to a corresponding judgment result; the metadata mark is a mark used for identifying whether the virtual machine has an effective reflink snapshot chain or not; in the data transmission process, the transmission strategy of the data to be transmitted is adjusted according to the health degree of the virtual machine, so that data transmission is completed. The problem that the performance of the virtual machine is reduced is solved.

The invention discloses a network-based expandable continuous data protection method, which comprises the following steps that: a client node intercepts a local write operation request and sends the local write operation request to a server system through a network; a monitoring module of the server side receives and forwards the request to a data storage module, and the data storage module additionally writes data into one or more physical block devices according to a receiving sequence; and when the storage space of the current equipment is used up, the monitoring module automatically switches to the next available equipment to continue additional writing, so that the dynamic expansion of the storage capacity is realized. According to the method, through a seamless capacity expansion mechanism, the problem that a traditional CDP system cannot be recovered at any time point due to limitation of a fixed storage space can be solved without interrupting service.

The application relates to the technical field of virtual machines, and particularly discloses a continuous data protection method and device, electronic equipment and a storage medium, wherein the method comprises the following steps: temporarily creating a copy image file and taking the copy image file as a disk medium of a virtual machine; starting the virtual machine, performing data operation and recording based on continuous data protection, and simultaneously performing data initialization operation; after the data initialization operation is completed, switching the disk image file to the disk medium of the virtual machine; performing backfill processing on the disk image file; performing data operation and recording based on continuous data protection; the method temporarily creates a copy image file before starting the virtual machine, takes the copy image file as the disk medium used by the virtual machine in the initial stage, and simultaneously performs data initialization operation, so that the virtual machine does not need to pause running to record a data source in the initial stage, the starting rate of the virtual machine can be greatly improved, and the problem of initialization time consumption existing in continuous data protection is effectively solved.

The present application provides a display system, method, electronic device and storage medium for a space mission. The display system includes: a data processing module for recording space mission data in real time and restoring data based on continuous data protection technology when a data failure occurs; a central control module for storing the received restored data and data that has not failed in a data engine process, replaying the space mission based on an improved continuous situation display technology, and sending the processing results to a corresponding display page for display; a display page for subscribing to space mission data from the data engine process, parsing the space mission data based on a display page editing tool, generating a monitoring data page for real-time display on the display page. The display system integrates data processing, interface management and multi-task support, and can provide reliable technical support for the execution of complex space missions.

The invention discloses a security increment synchronization method for continuous data protection, which belongs to the technical field of cloud storage and data protection, and comprises the following steps: S1, when a client initiates a write operation for updating a local file, comparing a client version number with a cloud version number; s2, generating incremental content, and distributing a unique block ID for each formula block according to the file formula; s3, encrypting the data blocks to obtain encrypted data blocks, and disrupting the sequence of the encrypted data blocks; s4, the client uploads the encrypted data blocks and the block IDs corresponding to the encrypted data blocks, and updates a deletion formula of the cloud; and S5, the cloud end manages the encrypted data block uploaded in the step S4 through a key value storage system, updates the version number of the cloud end, and notifies the client to update the corresponding version number at the same time. According to the method, the advantages of Rsync and Dsync are combined, an informed redundancy detection mechanism is provided, byte-level redundancy is ensured to be eliminated, calculation and bandwidth overhead is remarkably reduced, and an encryption protection mechanism of a data and synchronization mode is introduced.

The invention relates to a CDP-based data fusion method and system. Comprising a multi-source heterogeneous data real-time acquisition and preprocessing module, a cross-platform identity recognition module based on a graph neural network, a dynamic label management and customer portrait construction module, a privacy protection and data security control module, a continuous data protection and rapid recovery module and a data service and application interface module, customer data is collected from a multi-source heterogeneous system through a self-adaptive data connector, real-time and batch processing is performed by adopting a stream batch integrated processing engine, cross-platform customer identity recognition is realized based on a graph neural network, customer tags are generated and managed through a dynamic tag management system, and data security is protected by applying a privacy computing technology. And realizing data tracking and recovery by utilizing a continuous data protection mechanism. According to the method, the federated learning framework, the real-time stream processing engine, the dynamic label management system and the privacy computing technology are introduced, so that the data fusion efficiency, the real-time performance and the compliance of the CDP system are remarkably improved.

Example embodiments relate generally to systems and methods for continuous data protection (CDP) and more specifically to an input and output (I / O) filtering framework and log management system to seek a near-zero recovery point objective (RPO).

The present invention proposes a data intelligent capture method and system for volume-level continuous data protection, which can effectively solve the problems in traditional CDP technology, including: a volume-level driver module, an intelligent capture and replication module for system volume-level data, which is used to transmit the captured change data to the backup end and apply it. According to different data change log file information, different methods will be used to transmit the corresponding changed data to the backup end, and the changed data will be applied. The data capture mode switching module and the application layer module monitor the disk IO status, network status, cache space size and other information of the protected server, and flexibly switch the data capture mode of the driver module to solve the cache space overflow problem, and make a good balance between cache space usage and recoverable points so that the protection plan can work normally.

This application provides a method, apparatus, device, medium, and product for continuous data protection, relating to the field of data processing technology. The method involves acquiring write input / output requests from a target device and copying the original request and the copy request. The original request is submitted to the target device, and write records are generated based on the copy request. This ensures both normal business processing by the target device and complete recording of data changes. Next, the write records are cached in a data cache and aggregated when preset batch processing conditions are triggered. This avoids a large number of fine-grained write operations directly impacting the storage system, reducing the inefficiency of data protection caused by frequent disk access and network transmission. Subsequently, the aggregated batch is first persistently stored in a local cache device, and then sent to a remote distributed object storage cluster after successful batch persistence. This improves storage I / O operation efficiency and enhances the reliability and flexibility of data protection.

The invention relates to the field of cloud computing and data backup, and particularly provides a cloud desktop virtual machine disk incremental backup implementation method and device, and the method comprises the following steps: S1, calling a libvirt interface to create checkpoint C1 and recording a current disk bitmap B1 during the first full backup; s2, executing incremental backup at the T2 moment; s3, a two-stage COW chain of a scratch file is adopted; s4, introducing a deduplication index module; s5, backup consistency is guaranteed; s6, strategy arrangement; and S7, recovering the process. Compared with the prior art, efficiency and resource bottlenecks caused by a traditional virtual machine file disk and full backup can be solved, and continuous data protection of minute-level RPO and low network occupation is achieved.

This invention belongs to the field of data protection technology, specifically referring to a continuous data protection method based on a multi-cloud architecture. The technical solution is a continuous data protection method based on a multi-cloud architecture, comprising the following steps: constructing a distributed continuous data protection system across multiple cloud nodes, each cloud node including a data capture module, a log storage module, a metadata management module, and a cross-cloud synchronization module; when the virtual machine disk is in continuous data protection mode, the data capture module intercepts write I / O operations of the virtual machine disk at the virtualization layer, extracts the modified disk data to generate a data change block, and simultaneously generates corresponding metadata records; improving system reliability by synchronizing data logs across multiple cloud nodes, so that data can still be recovered from other cloud nodes when a single cloud node fails.

The invention discloses a data migration method and device, electronic equipment, a storage medium and a program product, and relates to the technical field of computers, the data migration method actively identifies a target volume corresponding to each snapshot, extracts a snapshot data block set to be migrated from the target volume, ensures that historical snapshot contents can be systematically incorporated into a migration process, and improves the migration efficiency. And the snapshots are migrated in sequence from morning to evening according to the creation time, so that data recovery abnormity caused by disordered snapshot migration sequence is avoided. According to the method and the device, the current generation value is introduced, and the snapshots which are not migrated are processed one by one according to the snapshot creation time sequence, so that the technical problem that snapshot data cannot be synchronously migrated during cross-storage-pool migration in a mirror image volume technology is solved, and the common snapshots are associated with the generation value in the migration process and are continuously written into the target storage space; and conversion to a continuous data protection mechanism is realized. After migration is completed, resources occupied by the data protection function of the source volume in the new pool are fewer, and the method has more advantages.

The invention discloses a generation synchronization method and system of a data volume, and relates to the technical field of computers, the generation synchronization method of the data volume is applied to a target cluster, and the target cluster comprises a management server used for cluster management and a plurality of controllers to be synchronized used for executing cluster services. Through the interaction between the management server and the plurality of controllers, the generations of the plurality of controllers about the same data volume are synchronized, and the generations of all the controllers are ensured to be consistent by configuring the creation time of continuous data protection of the controllers about the data volume, so that the technical problem that the generations of high-density snapshots are reduced in performance is solved, and the reliability of the high-density snapshots is improved. The technical effect of improving the generation synchronization performance is achieved.

According to the data processing method and the electronic equipment, the data protection identifier is generated in real time by responding to the snapshot instruction, and the mapping relation between the data protection identifier and the list file is updated, so that instant snapshot creation without freezing a memory table and copying a data block is realized; the problems of write blocking and performance jitter caused by a copy-on-write mechanism are solved; by directly associating the data protection identifier generated in real time with the to-be-written data, accurate binding of the data and the identifier information is ensured, and a basis is provided for efficient management of the data; different storage strategies are selected on the basis of the data size, corresponding index information is recorded in a data file, the metadata scale is compressed, the problem that storage resources are excessively consumed due to recording of full-amount operation metadata is solved, the continuous data protection capability is guaranteed, and meanwhile the storage efficiency is improved. The method has the effects of high-performance writing and low storage overhead.