Distributed Fragments File System for Secure Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional distributed computer file systems and cloud storage solutions are prone to data loss and security vulnerabilities due to single-point failures, lack of redundancy, and increased attack vectors from replication across multiple providers.
Innovation Solution
The Distributed Fragments Storage System (DFSS) breaks files into fragments and distributes them across multiple, potentially heterogeneous storage systems, using encryption and interleaving for security and block FEC codes for redundancy, eliminating the need for full replication and reducing storage requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If file data is stored entirely on a single drive or file system, then storage simplicity is maintained, but data loss risk increases when the underlying system fails
Solution Approach 1:
The patent divides file data into multiple fragments and stores them across different drives or file systems. Each fragment is a portion of the original file, and no single fragment contains the complete data. This segmentation approach ensures that the failure of any single storage system does not result in total data loss, as long as enough fragments are recovered from surviving systems.
2Reliability
If RAID systems replicate and stripe data over multiple drives, then protection against single drive failures is achieved, but multiple disk-drive failures occur more frequently due to identical aging profiles and environmental factors
Solution Approach 1:
The patent distributes file fragments across heterogeneous storage systems that may have different characteristics, locations, and environmental conditions. By placing fragments in geographically or environmentally dispersed locations rather than clustering them in identical RAID arrays, the system reduces the correlation between failures. Different storage systems experience different aging profiles and environmental stressors, making simultaneous failures less likely.
3Ease of operation
If file data is located in a conventional single file system, then access simplicity is maintained, but security vulnerability increases as intruders only need to discover vulnerabilities of that particular file system
Solution Approach 1:
The patent segments file data into fragments distributed across multiple file systems or storage locations. An intruder would need to compromise multiple different file systems and reconstruct the fragments to access complete data, significantly increasing the security barrier. The system maintains ease of operation by providing a unified namespace and transparent fragment management, so users experience simple file access while the underlying fragmentation provides security.
4Reliability
If data is replicated across multiple cloud providers, then risk of loss of access during provider outages is reduced, but storage costs and attack vectors increase
Solution Approach 1:
The patent stores only fragments of data at each cloud provider rather than complete replicas. Each provider holds a portion of the total data, and the system requires fragments from multiple providers to reconstruct complete files. This partial storage approach provides fault tolerance during provider outages while reducing total storage overhead compared to full replication, as the same storage capacity serves both as primary and backup across the distributed system.
Data Source
AI summary
The present invention relates to a distributed storage scheme, wherein every file is optionally encrypted, optionally interleaved, fragmented, and the various fragments stored on different constituent storage systems commensurate with the storage mechanisms supported by those storage providers.