Dynamic Data Path Selection for Storage Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data path selection methods in computer systems, which rely solely on data size thresholds, fail to optimize performance as they do not consider factors like cache availability and operation types, leading to inefficiencies in handling large files through the file system server and small files through the storage system.
Innovation Solution
Implement a dynamic data path selection method that chooses between a file system server path and a direct storage system path based on whether the data is likely to be in the cache, the type of operation (read/write), and performance characteristics, allowing for adjustable parameters to optimize path selection in response to changing system conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data path selection is based solely on data size thresholds, then the selection process is simple, but system performance is not optimized because cache availability and operation types are not considered
Solution Approach 1:
The patent implements dynamic data path selection that adapts to changing system conditions. The selection process considers multiple factors including cache availability, operation type (read/write), and data size, rather than relying on fixed thresholds. This dynamic approach allows the system to optimize performance by selecting the most appropriate data path (through file system server or direct to storage system) based on real-time conditions, thereby resolving the contradiction between simple selection and optimized performance.
2Productivity
If large files are transferred through the file system server, then file system management is maintained, but transfer efficiency decreases due to the extra processing step
Solution Approach 1:
The patent segments the data transfer process into two distinct paths: transfers through the file system server for small files requiring management overhead, and direct transfers to the storage system for large files where efficiency is paramount. This segmentation allows the system to maintain file system management capabilities when needed while achieving high transfer efficiency for large files by bypassing the server, thus resolving the contradiction between management ease and transfer efficiency.
3Speed
If small files are transferred through the storage system directly, then transfer speed increases, but file system interface functionality is bypassed
Solution Approach 1:
The patent applies local quality by tailoring the data path selection to the specific characteristics of each transfer operation. Small files that require file system interface compliance are routed through the file system server, while large files prioritizing speed are routed directly to the storage system. This localized optimization ensures that file system interface functionality is maintained where necessary while achieving high transfer speeds where appropriate, resolving the contradiction between speed and interface compliance.
Data Source
AI summary
Embodiments of the present invention are directed to techniques for selecting a data path over which to exchange information between a client device and a storage system by making a selection between a file system server (NAS) data path type (a first data path type) and a direct (SAN) data path type (a second data path type) based on one or more adjustable path selection factors and/or information regarding components of the computer system. For example, a data path may be selected based on a type of an input/output operation to be executed (i.e., whether the operation is a read operation or write operation) and/or any other suitable path selection factor.