19 results about "Asynchronous replication" patented technology

Techniques can include: establishing an asynchronous replication configuration for a replication session of a source volume group VG1 and a target volume group VG2; and performing processing to transition the replication session to a low RPO (recovery point objective) replication mode comprising: setting the replication session to an alternative asynchronous replication (AAR) mode; transitioning the replication session to a hybrid mode; creating a first snapset of snapshots of source volumes of VG1; replicating each snapshot of the first snapset from a source to a target system in either the low RPO replication mode or the AAR mode based on an associated member level asynchronous replication mode corresponding to said each snapshot; and constructing a second snapset of snapshots of target volumes of VG2, wherein each snapshot in the second snapset denotes a same point in time copy as a corresponding snapshot in the first snapset.

A method for use in a storage system including a primary storage system and a secondary storage system, the method comprising: starting an asynchronous replication manager; detecting that an intrusion detector has detected an intrusion in the primary storage system; in response to the intrusion being detected, causing the asynchronous replication manager to stop transmission, to a secondary storage system, of replication data associated with any data buckets that are collected by the asynchronous replication manager while allowing the asynchronous replication manager to continue collecting new data buckets; generating an alert that indicates that the intrusion detector has detected the intrusion; receiving a response that is indicative of whether the intrusion is confirmed; when the response indicates that the intrusion is not confirmed, resuming the asynchronous replication manager, and when the intrusion is confirmed, causing the asynchronous replication manager to stop collecting data buckets.

The application relates to the technical field of land and resource data processing, in particular to a land and resource planning data storage method, system, device and medium, which comprises the following steps: carrying out fragmentation processing on land and resource data to obtain data fragmentation information; carrying out real-time analysis on the data fragmentation information to obtain hot data and cold data, carrying out synchronous replication processing on the hot data, and carrying out asynchronous replication processing on the cold data; obtaining memory state information, dividing the memory state information to obtain hierarchical information, adjusting the hierarchical information according to the hot data, and storing the hot data into a plurality of hierarchical caches; obtaining data access traffic information in real time, dynamically adjusting the data fragmentation information according to the data access traffic information to obtain distribution update information for updating the hot data and the cold data, enabling the land and resource to be stably stored, improving the consistency of the data, and thus improving the reliability of the system and the user experience.

The application provides a data disaster backup method and system of a security system, relates to the technical field of data backup, and comprises the following steps: obtaining a segment sequence by performing content-based segmentation on a data object; generating a fingerprint sequence and constructing a verifiable ordered index; encrypting the segment sequence by using a session key and generating an authentication tag to form an encrypted package; performing cross-domain asynchronous replication based on a multi-dimensional evaluation strategy; performing consistency checking by submitting a serial number and the ordered index, and if the checking is passed, performing persistent storage, otherwise, rolling back and retransmitting. The method realizes a data disaster backup mechanism with high security, verifiability and flexibility.

A method for use in a storage system including a primary storage system and a secondary storage system, the method comprising: starting an asynchronous replication manager; detecting that an intrusion detector has detected an intrusion in the primary storage system; in response to the intrusion being detected, causing the asynchronous replication manager to stop transmission, to a secondary storage system, of replication data associated with any data buckets that are collected by the asynchronous replication manager while allowing the asynchronous replication manager to continue collecting new data buckets; generating an alert that indicates that the intrusion detector has detected the intrusion; receiving a response that is indicative of whether the intrusion is confirmed; when the response indicates that the intrusion is not confirmed, resuming the asynchronous replication manager, and when the intrusion is confirmed, causing the asynchronous replication manager to stop collecting data buckets.

The invention discloses a distributed acquisition data consistency processing method, and belongs to the technical field of data acquisition and network management. The distributed acquisition data consistency processing method comprises the following steps: acquiring target data; calculating the priority of the target data to obtain high-priority data, medium-priority data and low-priority data; carrying out data processing on the high-priority data by adopting a practical Byzantine fault-tolerant algorithm to obtain first consistency data; performing data processing on the middle-priority data by adopting an asynchronous replication and periodic compensation strategy to obtain second consistency data; performing master-slave replication consistency and causal consistency processing on the low-priority data to obtain third consistency data; and summarizing the first consistency data, the second consistency data and the third consistency data to obtain consistency data.

The described technology is generally directed towards automatic storage of data / digital objects in a self-adaptive replication system. Data replication can be switched between synchronous (sync) replication and asynchronous (async) replication between a local storage system and a remote storage system. Latency between writing data to the local storage system and the remote storage system can be determined. In the event of the latency is less than a threshold value, sync replication can be utilized, and in the event of the latent is greater than the threshold value, async replication can be utilized. Accordingly, data replication can adapt based on infrastructure, volume of data to be write, period(s) of no-data writes, etc. Async replication can use a buffer to temporarily store data during a write operation at the remote storage system. Alternatively, a list can be maintained for data to write to the remote storage system for subsequent replication.

Techniques can include: establishing an asynchronous replication configuration for a replication session of a source volume group VG1 and a target volume group VG2; and performing processing to transition the replication session to a low RPO (recovery point objective) replication mode comprising: setting the replication session to an alternative asynchronous replication (AAR) mode; transitioning the replication session to a hybrid mode; creating a first snapset of snapshots of source volumes of VG1; replicating each snapshot of the first snapset from a source to a target system in either the low RPO replication mode or the AAR mode based on an associated member level asynchronous replication mode corresponding to said each snapshot; and constructing a second snapset of snapshots of target volumes of VG2, wherein each snapshot in the second snapset denotes a same point in time copy as a corresponding snapshot in the first snapset.

The described technology is generally directed towards automatic storage of data / digital objects in a self-adaptive replication system. Data replication can be switched between synchronous (sync) replication and asynchronous (async) replication between a local storage system and a remote storage system. Latency between writing data to the local storage system and the remote storage system can be determined. In the event of the latency is less than a threshold value, sync replication can be utilized, and in the event of the latent is greater than the threshold value, async replication can be utilized. Accordingly, data replication can adapt based on infrastructure, volume of data to be write, period(s) of no-data writes, etc. Async replication can use a buffer to temporarily store data during a write operation at the remote storage system. Alternatively, a list can be maintained for data to write to the remote storage system for subsequent replication.

Techniques are provided for transitioning a first storage object and a second storage object from an asynchronous replication state to a synchronous replication state. Metadata operations are logged into a metadata log. Dirty data, modified by data operations executed upon the first storage object, are tracked using a dirty region log. Metadata operations are replicated from the metadata log to the second storage object during a metadata drain phase. During the metadata drain phase, incoming operations are logged into the metadata log when the metadata log has a non-zero size, otherwise, the metadata operations are replicated to the second storage object. After the metadata drain phase, a data drain phase is performed using the dirty region log.

The invention discloses a fault-tolerant distributed storage method and system supporting asynchronous and synchronous replication, and the method comprises the steps: deploying to-be-stored data to a main node, splitting the data into a plurality of sub-data, deploying the sub-data to a standby node by the main node, deploying a standby node of the sub-data and deploying redundant copies of other sub-data except the sub-data in all the sub-data at the same time; judging whether the data replication request adopts an asynchronous replication mode or a synchronous replication mode; when the judgment result is synchronous replication, the access flow of the data replication request is distributed to the main node, and when the judgment result is asynchronous replication, the access flow of the data replication request is distributed to the standby node; and when a difference value between the copied standby node data and the corresponding data of the main node exceeds a preset value, taking the corresponding data of the main node as the data responding to the data copying request. The method has the advantages that the balance between meeting user requirements and saving node resources can be realized, and the like.

The invention relates to a data synchronization method and device, computer equipment, a readable storage medium and a program product. When a data synchronization condition is met, a data level determined based on attributes of data and access information for the data is obtained, a corresponding target synchronization strategy is determined based on the data level, and the to-be-synchronized data is synchronized to a target data center according to the target synchronization strategy. Compared with a traditional method of synchronizing all the data according to an asynchronous copying mode, the method has the advantages that the data grades of the data are determined by combining the attributes of the data and the access information of the data, and different synchronization strategies are determined for different data grades, so that the data with different importance degrees are synchronized according to the graded synchronization strategies, and the synchronization efficiency is improved. And the synchronization consistency of important data is improved, so that the data synchronization efficiency is improved.

Techniques can include: establishing an asynchronous replication configuration of a volume V1 of a first system and a volume V2 of a second system; determining data changes between a successive pair of snapshots of V1; transferring the data changes from the first system to the second system; determining an average data transfer rate and an average data change rate; determining, based at least in part, on the average data transfer rate and the average data change rate, a predicted time denoting an amount of time expected to complete a final processing phase that transitions the asynchronous replication configuration from a first state to a second state; determining whether the predicted time exceeds a threshold; and responsive to determining that the predicted time does not exceed the threshold, performing the final processing phase that transitions the asynchronous replication configuration from the first state to the second state.

Systems and methods for asynchronously replicating mutable metadata fields in distributed environments comprise a lineage-based approach, wherein individual changes to metadata fields are stored as timestamped entries in lineage tables that enable efficient tracking and replication of updates. Advantageously, this approach to replicates individual entries independently, allows updates to be replied in any order while maintaining consistency across source and destination systems, and eliminates the need for strict sequencing, synchronization, or exactly-once delivery, which ensured reliability even in active-active configurations or high-latency networks. Metadata queries retrieve the most recent values based on timestamps to ensure consistency and eventual alignment of data between databases. Various embodiments support bidirectional replication, concurrent updates, and error handling, making them suitable for geographically distributed systems, hybrid cloud environments, and disaster recovery applications.

The application provides a server cluster energy efficiency balanced load migration method and system, and relates to the technical field of distributed computing. The application obtains power consumption data of distributed cache nodes in a server cluster, identifies high-power consumption and low-power consumption nodes; simultaneously obtains access frequency data of cache data fragments, performs cross-node unified sorting to generate a global access heat result; based on the heat sorting and the power consumption data, determines the fragment with the highest access heat in the high-power consumption node as a to-be-migrated fragment, selects a low-power consumption node with sufficient resources as a target node, forms a migration decision; updates cluster metadata mapping relationships, establishes a data transmission channel, and asynchronously replicates data blocks in batches and performs verification; after completion, switches client routing and points requests to the target node. The application can realize energy efficiency balance of the server cluster, effectively reduce overall power consumption, and improve resource utilization.

Techniques can include: configuring stretched volumes to perform asynchronous replication in a first mode using a first replication technique that uses a write tracking cache to track locations that are written between successive replication-related snapshots of respective source volumes of the stretched volumes; performing asynchronous replication for the stretched volumes in accordance with the first replication technique; and monitoring resource consumption of the write tracking cache during asynchronous replication processing using the first replication technique, wherein said monitoring includes: determining that a current amount of write tracking cache consumed exceeds a high watermark threshold; and responsive to determining that the current amount of write tracking cache consumed exceeds a high watermark threshold, selecting, in accordance with criteria, one or more of the stretched volumes for demotion from the first replication mode to a second replication mode that uses a second replication technique that does not use the write tracking cache.

The application relates to the technical field of data storage, and discloses a data asynchronous replication method and device, computer equipment and a storage medium, the method comprises the following steps: screening a service bearing node from a plurality of nodes of a storage system, and creating a timer on the service bearing node; obtaining configuration information of an asynchronous replication relationship, configuring the asynchronous replication relationship of the plurality of nodes based on the configuration information, determining a configuration state of the plurality of nodes and a data synchronization period of data asynchronous replication of the plurality of nodes based on the configuration information, starting the timer on the service bearing node in the case that the configuration state is a starting state, determining whether a data synchronization moment of the data synchronization period is reached based on the timer, and publishing data synchronization information to the plurality of nodes through the service bearing node in the case that the data synchronization moment of the data synchronization period is reached, so that the plurality of nodes perform data asynchronous replication based on the data synchronization information. The application improves the precision of the timer, and has strong data recovery capability.

The invention relates to a data service continuity guarantee method based on a multi-level disaster recovery strategy, and the method comprises the steps: distributing a service level according to a key index of a service system, and generating a differential disaster recovery strategy template; according to the disaster recovery strategy template, deploying an intra-city active-active cluster for high-priority services, deploying main and standby asynchronous replication for medium-priority services, and deploying timing snapshot backup for low-priority services; and according to the disaster recovery strategy template, constructing a remote disaster recovery center through asynchronous log copying and incremental snapshots, and supporting hybrid recovery of snapshots and logs to guarantee cross-regional service continuity. According to the invention, resource and demand matching is realized through service grading planning, and cost and efficiency are optimized; a city-wide active-active mechanism is combined with a distributed consistency protocol to ensure second-level switching and zero data loss; different-place disaster recovery adopts snapshot and log mixed recovery, so that the cross-regional recovery efficiency is improved; automatic fault sensing and closed-loop response are achieved, manual intervention is remarkably reduced, and the reliability and usability of the system are improved.

A procedure (400) involves accessing a distributed database (140) containing a plurality of clusters (210), each cluster containing a plurality of partitions (212), and each cluster being configured to receive read and write operations (20, 21). The procedure involves receiving, on a second cluster (210B), a plurality of changes (350) for a second table (250B) and storing the plurality of changes in a replication log (351). The procedure also involves asynchronously replicating the plurality of changes from the second table to a first table (250A) and maintaining a respective change stream position (214A) that tracks a respective position in the replication log indicating one or more changes that have been replicated.The procedure involves receiving a read request at the first cluster (210A) requesting one or more rows of the first table, and returning the respective change stream position.