Multi-Cloud Storage Replication via Object Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current cloud computing platforms face inefficiencies in data replication, requiring the transfer of entire data storage disks when only a subset of data is needed, leading to increased time, cost, and exposure to data loss, and often necessitate data conversion due to differing conventions between platforms.
Innovation Solution
A system and method for replicating data between cloud platforms using a storage replicator component that identifies changes in data files, modifies attributes to conform to the target platform's conventions, encrypts the data, and transfers only the necessary data, leveraging application programming interfaces and rules engines to manage data formatting and transfer efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If block copy is used to copy data from one cloud platform to another, then data transfer is achieved, but the time required increases and more data is transferred than necessary
Solution Approach 1:
The patent segments data at the object level rather than copying entire blocks or disks. The storage replicator identifies individual objects (files, folders, databases) that need replication and transfers only those specific objects, enabling selective data copying that reduces both transfer volume and time compared to traditional block copy methods
Solution Approach 2:
The invention extracts only the necessary data objects from the source cloud platform for replication to the destination platform. The storage replicator analyzes data dependencies and event triggers to determine which specific objects need to be copied, separating useful data transfer from unnecessary data movement associated with full disk or block copying
2Reliability
If entire data storage disks are copied, then data replication is achieved, but resource usage increases and cost increases
Solution Approach 1:
Instead of copying entire disks, the patent segments data into individual objects and replicates only those objects that have changed or need to be transferred. This segmentation approach maintains replication reliability for critical data while significantly reducing the resources consumed for data transfer and storage
Solution Approach 2:
The invention applies partial action by copying only the necessary portion of data (changed objects, selected objects) rather than the entire disk. The storage replicator uses event triggers and data dependency analysis to determine the minimal set of objects required for replication, avoiding excessive resource usage
3Adaptability or versatility
If data is copied between cloud platforms with different conventions, then data transfer is achieved, but data conversion is required increasing complexity
Solution Approach 1:
The patent introduces a storage replicator as an intermediary component between source and destination cloud platforms. This replicator handles the complexity of data conversion by analyzing source data formats, mapping them to destination platform conventions, and transforming data structures accordingly. The intermediary absorbs the complexity of platform differences, enabling seamless data transfer without requiring complex manual conversion processes
4Loss of information
If more data is transferred during replication, then data completeness is improved, but exposure to potential loss increases
Solution Approach 1:
The invention extracts only the necessary data objects for replication based on event triggers and data dependencies. By identifying and transferring only the specific objects that have changed or are required, the system reduces the data transfer volume and consequently the exposure to potential data loss during transmission, while maintaining data completeness for the replicated objects
Data Source
AI summary
Disclosed are systems, apparatuses and techniques for replicating data between different cloud computing platforms. Examples include storage replicator components operable in different cloud computing platforms. The first storage replicator component may identify the second cloud computing platform as a location to copy a data file in response to an event related to the data file stored in a first cloud computing platform. The first storage replicator component may request a copy of the data file via an application programming interface of the first cloud computing platform. The attributes of the copy of the data file which involve modification to conform to data management conventions of the second cloud computing platform may be determined and modified to comply with conventions of the second cloud computing platform. The modified copy of the data file may be forwarded to the second cloud computing platform for storage.