File System Architecture Bandwidth Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing parallel file system architecture, such as Lustre, faces performance issues due to network heterogeneity and multi-network coexistence, leading to inconsistent data transmission channels and suboptimal bandwidth, which current methods fail to effectively address.
Innovation Solution
A performance adjusting method and apparatus that determine internet bandwidths between clients, Object Storage Servers, and storage controllers, calculate IO processing capabilities, and adjust the number of Object Storage Targets or Servers to match transmission bandwidth with IO processing capabilities, optimizing overall system performance by reevaluating and adjusting based on network heterogeneity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If old devices are used in an enterprise network, then device compatibility and cost are maintained, but network bandwidth consistency deteriorates due to multi-network coexistence
Solution Approach 1:
The patent applies parameter changes by dynamically adjusting the number of OSS nodes and storage arrays based on measured network bandwidth characteristics. The system monitors actual network performance and modifies system configuration parameters (number of OSS, number of storage arrays) to optimize performance under heterogeneous network conditions, thereby resolving the contradiction between maintaining device compatibility and achieving consistent network bandwidth.
2Productivity
If the number of storage arrays is increased, then storage capacity and IO processing capability are improved, but system complexity increases
Solution Approach 1:
The patent implements feedback by measuring actual network bandwidth and IO performance, then using these measurements to dynamically adjust the number of OSS nodes and storage arrays. The system continuously monitors performance metrics and modifies configuration based on real-time feedback, optimizing the balance between productivity and complexity rather than statically increasing components.
Solution Approach 2:
The patent applies dynamics by making the system configuration adaptive rather than fixed. The number of OSS nodes and storage arrays is dynamically adjusted based on measured network characteristics and performance requirements, allowing the system to optimize its structure according to actual operating conditions rather than maintaining a static complex architecture.
3Productivity
If direct client access to OST is enabled, then IO performance is improved, but network heterogeneity impact worsens due to inconsistent bandwidth
Solution Approach 1:
The patent applies the intermediary principle by introducing OSS nodes as mediators between clients and storage arrays. These OSS nodes act as performance optimization intermediaries that buffer the impact of network heterogeneity, dynamically adjusting data routing and access patterns to maintain stable performance across heterogeneous network environments while preserving high IO performance.
Data Source
AI summary
A performance adjusting method and apparatus for a file system architecture. The method includes: determining a plurality of internet bandwidths among a client, an Object Storage Server (OSS), and a storage controller in a file system architecture; determining an overall network architecture of the file system architecture and a maximum transmission bandwidth of the file system architecture; testing read-write performance of a single Object Storage Target (OST) to calculate an Input/Output (IO) processing capability of a storage node; determining whether the maximum transmission bandwidth matches the IO processing capability of the storage node to add or reduce a storage array accordingly to adjust a number of OSTs; executing a performance benchmark test to determine IO read-write performance of the file system architecture; and determining whether the maximum transmission bandwidth matches the IO read-write performance to adjust a number of OSSs or a number of storage arrays accordingly.