Torus Network Distributed File System Switchless Topology
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in developing cost-effective, high-capacity cloud storage solutions, particularly in achieving exabyte-level storage with existing network topologies like fat-tree, which are costly and complex, and lack efficient torus network implementations for storage nodes.
Innovation Solution
A distributed file system is designed with a torus network topology where storage servers are directly interconnected without switches, and clients are connected through a switch, utilizing metadata and data servers managed by a central server to provide high availability and efficient data management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a fat-tree network topology with switches is used to construct cloud storage, then high availability can be supported, but the system complexity and cost increase significantly
Solution Approach 1:
The patent extracts and removes the switch components from the storage node interconnection network, creating a switchless torus topology where storage nodes are directly interconnected. This eliminates the complexity and cost associated with switches while maintaining network functionality through direct peer-to-peer connections between storage nodes.
Solution Approach 2:
The patent transitions from a traditional hierarchical fat-tree topology to a dimensional torus topology, organizing storage nodes in a multi-dimensional grid structure. This dimensional reorganization enables direct interconnections between nodes without requiring centralized switching infrastructure, thereby reducing system complexity while preserving high availability through multiple routing paths.
2Reliability
If a fat-tree network topology with switches is used, then high availability is supported, but the cost increases
Solution Approach 1:
The patent removes switches from the storage node interconnection architecture, eliminating the need to purchase, deploy, and maintain expensive switching infrastructure. The switchless torus topology achieves high availability through direct peer-to-peer connections, significantly reducing system cost while maintaining reliability.
3Device complexity
If storage servers are directly interconnected to form a torus topology without switches, then system complexity and cost are reduced, but efficient data management and high availability must be maintained
Solution Approach 1:
The patent implements a management server that continuously monitors the status of storage nodes and dynamically routes data operations. This feedback mechanism ensures high availability by detecting node failures and redistributing data loads, compensating for the lack of centralized switching infrastructure in the switchless torus topology.
Solution Approach 2:
The management server performs multiple functions including node monitoring, data routing, failure detection, and load balancing. This multi-functional approach ensures high availability and efficient data management without requiring complex specialized infrastructure, maintaining reliability while using the simplified switchless torus topology.
Data Source
AI summary
A distributed file system based on a torus network includes a plurality of metadata servers configured to store metadata of files, a plurality of data servers configured to divide data and store the divided data in a distributed manner, and at least one management server configured to manage the metadata servers and the data servers. The plurality of metadata servers, the plurality of data servers, and the at least one management server are disposed on first to nth planes each of which consists of a plurality of nodes, and the first plane is connected to a plurality of clients through a switch.