File Replication Snapshot Scheduling for Data Consistency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data replication techniques in file storage systems are inefficient and inaccurate, leading to excessive resource usage and inconsistency across multiple target storage systems due to the lack of separation between dataset creation and replication processes.
Innovation Solution
Implementing a data storage system with independent replication scheduling and snapshotting components that allow for separate dataset creation and replication processes, enabling shared snapshots and incremental snapshots to reduce the number of snapshots and improve consistency across multiple target systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If separate snapshots are created for each target storage system, then data consistency across targets is improved, but computational resources and storage resources are excessively consumed
Solution Approach 1:
The patent merges the snapshot creation process into a single unified operation that serves multiple target storage systems simultaneously. Instead of creating separate snapshots for each target, the system creates one snapshot and distributes it to all targets, reducing computational overhead while maintaining data consistency across all destinations.
Solution Approach 2:
The snapshot creation mechanism is designed to serve multiple functions and multiple targets universally. A single snapshot creation operation produces a snapshot that can be distributed to any number of target storage systems, making the snapshotting process multi-functional and eliminating redundant computational work.
2Reliability
If separate snapshots are created for each target storage system, then data consistency across targets is improved, but storage resources are excessively consumed
Solution Approach 1:
The patent merges the snapshot storage operation into a single unified process. Instead of creating and storing separate snapshot copies for each target system, the system creates one snapshot and efficiently distributes it, significantly reducing the total storage resources consumed while ensuring all targets receive consistent data.
Solution Approach 2:
The system creates a single master snapshot copy and then distributes copies to multiple target storage systems. This approach minimizes the total number of snapshot copies that need to be created and maintained, reducing storage resource consumption while ensuring data consistency across all targets through controlled copying.
3Measurement precision
If snapshots are created at the same time as replication, then replication accuracy is improved, but replication efficiency deteriorates due to resource contention
Solution Approach 1:
The patent segments the replication process into two distinct phases: first, create the snapshot independently at the optimal time; second, replicate the snapshot to target systems. This segmentation allows snapshot creation and replication to occur separately without resource contention, improving overall efficiency while maintaining accuracy through the use of consistent snapshot data.
Solution Approach 2:
The system performs the snapshot creation action in advance, before the replication process begins. By preparing the snapshot beforehand at a time when resource demands are lower, the system ensures accurate data capture without interfering with the subsequent replication operations, thereby improving both accuracy and efficiency.
4Use of energy by moving object
If a single snapshot is shared across multiple targets, then resource usage is reduced, but the ability to handle different replication schedules deteriorates
Solution Approach 1:
The patent implements a dynamic system where a single snapshot can be distributed to multiple targets according to their individual replication schedules. The system adapts the distribution timing and progression for each target while maintaining the underlying snapshot consistency, enabling both resource efficiency and schedule flexibility through dynamic coordination.
Data Source
AI summary
Systems and methods facilitating separation of dataset creation from movement in file replication are described herein. A method as described herein can include scheduling, by a first system operatively coupled to a processor, a first transfer of a dataset to a second system at a first time according to a first replication schedule; scheduling, by the first system, a second transfer of the dataset to a third system at the first time according to a second replication schedule; creating, by the first system, a snapshot of the dataset at a second time that is distinct from the first time according to a snapshot schedule that is distinct from the first replication schedule and the second replication schedule; and transferring, by the first system, at least a portion of the snapshot to the second system and the third system at the first time.