Storage System IO Mode Switching for Testing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional storage system testing requires significant time due to limited prefilling rates, necessitating prolonged testing times or increased numbers of storage nodes, as existing methods rely on emulating real-world workloads through journaling processes that introduce latency and data protection delays.
Innovation Solution
A computer-implemented method that allows the storage system to switch between normal and testing IO write modes, bypassing journaling and metadata operations to accelerate data prefilling by writing directly to cache memory and then to the storage array, enabling faster data processing without compromising data integrity during testing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional prefilling methods are used with journaling processes, then data integrity is protected, but testing time is significantly prolonged
Solution Approach 1:
The patent implements dynamic IO mode switching that allows the storage system to transition between normal mode (with journaling for data integrity) and testing mode (without journaling for speed). This dynamic adaptation resolves the contradiction by enabling the system to exhibit different behaviors based on operational context, achieving both data integrity protection during normal operation and rapid prefilling during testing.
Solution Approach 2:
The patent changes the operational parameters of the storage system by disabling journaling and metadata operations specifically during testing mode. This parameter change allows the system to bypass latency-introducing operations when data integrity risks are minimal (during controlled testing), thereby resolving the contradiction between protecting data integrity and reducing testing time.
2Reliability
If journaling operations are performed during prefilling, then data protection is ensured, but prefilling rate is limited
Solution Approach 1:
The system dynamically adjusts its operational characteristics by switching to testing mode during prefilling operations, where journaling is disabled. This allows the prefilling rate to increase significantly while maintaining data protection during normal operational modes, resolving the contradiction between data protection and prefilling rate.
Solution Approach 2:
During testing mode prefilling, the system applies partial action by selectively disabling only the journaling and metadata operations that limit speed, while maintaining other essential data protection mechanisms. This partial modification allows excessive prefilling rates needed for testing without completely sacrificing data protection.
3Reliability
If metadata operations are performed during testing, then data consistency is maintained, but testing efficiency is reduced
Solution Approach 1:
The patent extracts and removes metadata operations from the prefilling process during testing mode. By taking out these operations that maintain data consistency but reduce testing efficiency, the system achieves rapid prefilling while accepting that metadata consistency checks are suspended during the controlled testing environment.
Solution Approach 2:
The system dynamically controls metadata operations by disabling them during testing mode and enabling them during normal operation. This dynamic control resolves the contradiction by allowing metadata operations to be present only when needed for data consistency, absent during testing when they would reduce efficiency.
Data Source
AI summary
A method, computer program product, and computing system for defining a normal IO write mode for writing data to a storage system, the normal IO writing mode including: writing the data to a cache memory system, writing the data to a journal, in response to writing the data to the journal, sending an acknowledgment signal to a host device, and writing the data from the cache memory system to a storage array. A request may be received to enter a testing IO write mode. In response to receiving the request, the data may be written to the cache memory system. The writing of the data to the journal may be bypassed. The acknowledgment signal may be sent to the host device in response to writing the data to the cache memory system. The data may be written from the cache memory system to the storage array.