Multi-Cloud Data Storage Conflict Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multi-cloud storage systems face challenges in detecting and resolving data conflicts due to the lack of a central controller, limited communication between clients, and absence of processing resources, leading to inconsistencies and potential data losses when multiple clients modify the same file simultaneously.
Innovation Solution
A method that partitions data files into multiple parts, generates lock files to manage conflicts, and uses erasure coding to distribute and encrypt data across multiple cloud storage nodes without requiring inter-client or inter-server communication, ensuring data consistency and availability even in the absence of a central controller.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is distributed across multiple cloud storage nodes without a central controller, then system reliability and security are improved, but conflict detection and data consistency become more difficult
Solution Approach 1:
The system segments the data file into multiple data parts and distributes them across different cloud storage nodes. Each node independently stores and manages its segment, enabling distributed storage without a central controller while maintaining the ability to detect conflicts through lock files associated with each segment.
Solution Approach 2:
Lock files are introduced as intermediary objects that mediate between multiple clients accessing the same data parts. These lock files, stored on cloud storage nodes, enable conflict detection and resolution without requiring direct client-to-client communication or a central coordinator.
2Stability of the object's composition
If lock files are used to manage concurrent modifications, then data consistency is improved, but system complexity and communication overhead increase
Solution Approach 1:
Each cloud storage node autonomously manages its own lock files and data parts without requiring coordination with other nodes or a central controller. When a client uploads a data part, the node independently checks for existing lock files, creates new ones if necessary, and handles conflict resolution locally, reducing overall system complexity.
3Reliability
If erasure coding is used to distribute data across multiple nodes, then data availability and security are improved, but processing complexity and storage overhead increase
Solution Approach 1:
The data file is segmented into multiple parts that are then encoded using erasure coding and distributed across cloud storage nodes. This segmentation approach enables the system to reconstruct the original data from any sufficient subset of nodes, improving availability while managing processing complexity through modular operations.
Data Source
AI summary
Data storage methods and systems for use with multiple cloud storage systems. The methods and systems use passive metadata files which are stored on cloud storage systems to eliminate the risk of a data conflict when data is being written to the multi-cloud storage system. The methods and systems enable a multi-cloud storage system to function safely without data corruption or loss due to potential conflicts. The methods and systems achieve this without the need for a central control server and without the need for the cloud storage systems or the clients to communicate with one another.