Namespace Mapping via In-Band Out-of-Band IO Path Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed file systems in virtual machine environments face challenges in optimizing data transfer speed and namespace mapping during file operations, particularly in managing the interactions between virtual machines, central storage, and switching layers.
Innovation Solution
A distributed file system architecture that includes a host computer with virtual machines, a switching layer computer for managing namespace maps, and a central storage unit, where file operations are selectively routed through in-band and out-of-band IO paths, with a primary namespace map maintained by the switching layer and a partial map by the host computer, enabling efficient data and metadata operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all file operations are routed through the switching layer computer for namespace mapping, then namespace mapping consistency is improved, but data transfer speed deteriorates due to additional routing steps
Solution Approach 1:
The patent segments file operations into two types: metadata operations (file create, delete, rename) that require namespace mapping and go through the switching layer computer, and data operations (read, write) that bypass the switching layer and go directly to central storage. This segmentation allows each operation type to follow the optimal path, resolving the contradiction between namespace mapping consistency and data transfer speed.
Solution Approach 2:
The patent introduces a host computer as an intermediary that maintains a partial namespace map locally. For data operations, the host computer acts as a mediator that can directly access central storage without routing through the switching layer computer, thereby improving data transfer speed while still maintaining namespace mapping consistency through the partial namespace map.
2Loss of time
If a complete namespace map is maintained at the host computer, then namespace mapping speed is improved, but device complexity increases
Solution Approach 1:
Instead of maintaining a complete namespace map at the host computer, the patent implements a partial namespace map that contains only the necessary mapping information for local virtual machines. This partial action approach reduces the complexity burden on the host computer while still enabling fast namespace mapping for the required operations.
Solution Approach 2:
The switching layer computer serves as an intermediary that maintains the complete namespace map and provides namespace mapping services to host computers. This distributed approach allows the host computer to maintain only a partial namespace map, reducing its complexity while still achieving fast namespace mapping through local caching.
3Reliability
If data operations go through the switching layer computer, then namespace mapping is centralized, but productivity decreases due to additional routing steps
Solution Approach 1:
The patent segments file operations into metadata operations that require centralized namespace management and data operations that benefit from direct access. By segmenting operations, the system can maintain centralized namespace management for reliability while improving productivity by allowing data operations to bypass the switching layer computer.
Solution Approach 2:
The patent extracts data operations from the centralized routing path by allowing them to go directly from the host computer to central storage, eliminating the unnecessary routing step through the switching layer computer. This extraction improves productivity while the switching layer computer continues to provide centralized namespace management for metadata operations.
Data Source
AI summary
A file management system includes a host computer having one or more virtual machines, a switching layer computer configured to manage a namespace map for the virtual machines in the host computer, and a central storage unit. The host computer is connected indirectly to the central storage unit through an in-band IO path that includes the switching layer computer and directly to the central storage unit through an out-of-band IO path. When a virtual machines issues a file operation, a file operation including a data operation is routed to the central storage unit along an out-of-band IO path and a file operation including a metadata operation is routed to the central storage unit along an in-band IO path that includes the switching layer computer.