Adaptive Fuzzy Rule Control for Software Defined Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud storage systems face bottlenecks due to high latency and insufficient Input/output Operations Per Second (IOPS) in Hard Disk Drive (HDD) systems, leading to increased costs from unnecessary hardware reservations and power consumption, especially when workload demands are unpredictable and require manual reconfiguration by human intervention.
Innovation Solution
An adaptive fuzzy rule controlling system for software defined storage that dynamically adjusts the configuration of storage devices using a traffic monitoring module, adaptive neural fuzzy inference module, traffic forecasting module, and fuzzy rule control module to achieve specified performance parameters like IOPS, latency, and throughput without human intervention, leveraging membership functions and fuzzy logic to optimize HDD and SSD usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If more HDDs are reserved to meet unexpected workload demands, then system reliability and service availability are improved, but hardware cost and power consumption increase significantly
Solution Approach 1:
The system dynamically adjusts storage configuration by transitioning between different operational modes (e.g., performance mode, capacity mode, balanced mode) based on real-time workload characteristics and performance metrics. This allows the storage system to optimize the balance between service availability and power consumption by activating additional HDDs only when workload demands require them, rather than keeping all HDDs constantly powered and ready.
Solution Approach 2:
The system changes operational parameters such as spindle rotation speeds, cache allocation, and I/O scheduling policies based on detected workload patterns. By adjusting these parameters dynamically, the system can maintain service availability during peak demands while reducing power consumption during low-activity periods, avoiding the need to reserve excessive hardware capacity.
2Adaptability or versatility
If manual reconfiguration of HDDs is performed by authorized staff, then adaptability to workload changes is improved, but operation complexity and response time increase
Solution Approach 1:
The storage system performs self-configuration and self-optimization by automatically detecting workload patterns, analyzing performance metrics, and adjusting its own configuration without human intervention. The system includes automated controllers that monitor I/O patterns, identify performance bottlenecks, and reconfigure storage resources dynamically, replacing the need for manual intervention while maintaining high adaptability to workload changes.
Solution Approach 2:
The system continuously monitors performance parameters such as IOPS, latency, and throughput, and uses this feedback to automatically adjust storage configuration. The feedback loop enables the system to learn from historical workload patterns and make proactive adjustments, achieving high adaptability while eliminating the complexity of manual reconfiguration processes.
3Productivity
If HDD system capacity is increased to meet higher IOPS requirements, then productivity is improved, but device complexity and cost increase
Solution Approach 1:
The storage system is divided into multiple independent storage pools or tiers with different performance characteristics. By segmenting the storage resources, the system can allocate specific segments to handle high-IOPS workloads while keeping other segments in lower-power states or dedicated to capacity workloads. This segmentation allows the system to achieve high productivity when needed without requiring the entire system to operate at maximum complexity and power consumption continuously.
Data Source
AI summary
An adaptive fuzzy rule controlling system for a software defined storage (SDS) system to control performance parameters in a storage node is disclosed. The system includes: a traffic monitoring module, for acquiring observed values of performance parameters in the storage node; an adaptive neural fuzzy inference module, for learning a dynamic relationship between configurations of a plurality of storage devices in the storage node and the performance parameters during a period of time, and outputting fuzzy rules which is built according to the dynamic relationship; a traffic forecasting module, for providing forecasted values of the performance parameters in a particular point in time in the future; and a fuzzy rule control module, for arranging the configuration of the storage devices in the storage node in the particular point in time in the future according to the fuzzy rules and the forecasted values.