Distributed File System Consensus via Paxos Index-Nodes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed file systems do not scale well in distributed environments, lacking flexibility and efficiency in storing data across multiple storage units.
Innovation Solution
A file system and method utilizing distributed tables with key-identifiers, index-nodes, and the Paxos algorithm to provide consensus and consistency across distributed devices, leveraging Kademlia and Paxos algorithms for data allocation and consensus in a distributed hash table framework.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional distributed file systems are used, then data storage across multiple storage units is achieved, but the system does not scale well and lacks flexibility and efficiency
Solution Approach 1:
The patent segments data into data-blocks that can be independently stored and retrieved across distributed devices. Each data-block is assigned a key-identifier enabling independent addressing and access, allowing the system to scale by adding more storage units without affecting the overall structure or performance of existing data storage operations.
Solution Approach 2:
The patent introduces a hierarchical dimension by creating index-nodes that organize and manage data-blocks across the distributed system. This additional layer of organization enables efficient data location and retrieval by transforming the flat distributed storage structure into a hierarchical namespace, improving both scalability and access efficiency.
2Quantity of substance
If data is stored across multiple distributed devices, then storage capacity increases, but maintaining consistency and reliability becomes more difficult
Solution Approach 1:
The patent implements the Paxos algorithm to establish feedback loops among distributed devices for consensus management. This feedback mechanism ensures that all devices agree on the state of data-blocks and index-nodes, maintaining consistency and reliability even as the system scales to include more storage units.
Solution Approach 2:
The patent uses key-identifiers as unique parameters to track and manage data-blocks across the distributed system. These identifiers enable reliable reference and tracking of data elements, ensuring that data remains consistent across multiple storage devices while allowing the system to expand its capacity.
3Productivity
If distributed tables with key-identifiers are used, then data organization and access efficiency improve, but system complexity increases
Solution Approach 1:
The patent introduces index-nodes as intermediary structures between the data-blocks and the distributed storage devices. These index-nodes act as mediators that organize data-blocks into hierarchical namespaces, improving data access efficiency by enabling targeted retrieval while distributing the complexity management across multiple manageable units rather than a monolithic system.
Data Source
AI summary
A system and method for storing data-files stored on distributed devices connected to a network. Data-elements of the data-files are allocated to data-blocks stored on the distributed devices. Key-identifiers are calculated for each of the data-blocks based on the allocated data-elements. The key-identifiers are stored in distributed tables stored on the distributed devices. Index-nodes are generated for the data-files based on the data-blocks. A Paxos algorithm is executed for the index-nodes based on the key-identifiers to provide a consensus of the data-files that are stored on the plurality of distributed devices.