Redundant Mass Storage Scrubbing for Data Integrity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage systems with redundancy face challenges in promptly detecting and correcting data integrity issues, particularly with recently modified data that is more likely to become corrupted or unavailable, as traditional scrubbing processes are infrequent and may take weeks to complete.
Innovation Solution
A data storage system that implements scrubbing mechanisms as background processes of low priority to frequently check data integrity, using redundancy to correct faulty data, with multiple scrubbing implementations that can run in parallel or successively based on system activity, and criteria such as time since last scrubbing and overall activity load to identify and repair faulty data portions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional scrubbing processes are used to check data integrity, then data correctness is maintained, but the scrubbing frequency is too low (taking weeks to complete) to promptly detect and correct corruption in recently modified data
Solution Approach 1:
The patent segments the scrubbing process into multiple independent scrubbing implementations, each targeting specific data portions with different scrubbing frequencies. Recently modified data portions are scrubbed more frequently than older data, allowing the system to maintain high reliability for critical data without requiring all data to be scrubbed at maximum frequency, thus reducing overall scrubbing time.
Solution Approach 2:
The patent implements dynamic scrubbing frequencies based on data characteristics. Data portions are classified into different categories (e.g., recently modified vs. older data) and assigned different scrubbing intervals. This dynamic approach ensures that data most susceptible to corruption is checked promptly while reducing unnecessary frequent checks on stable data, resolving the contradiction between thoroughness and time consumption.
2Reliability
If scrubbing frequency is increased to promptly detect corruption, then data integrity is improved, but system resource consumption and scrubbing process complexity increase
Solution Approach 1:
The patent applies different scrubbing strategies to different data portions based on their local characteristics. Recently modified data portions receive more frequent and thorough scrubbing, while older, stable data portions are scrubbed less frequently. This localized quality approach improves overall data integrity detection capability without requiring uniformly high-frequency scrubbing across all data, thereby reducing system complexity and resource overhead.
Solution Approach 2:
The system automatically classifies data portions and assigns appropriate scrubbing frequencies without requiring manual intervention or complex centralized scheduling. Each scrubbing implementation independently manages its own execution based on data characteristics, simplifying the overall control mechanism while maintaining effective data integrity monitoring.
3Reliability
If multiple scrubbing implementations are run in parallel to improve data checking coverage, then data integrity maintenance is enhanced, but system activity load and resource usage increase
Solution Approach 1:
The patent implements multiple scrubbing implementations that operate periodically with different frequencies and schedules. Instead of running all scrubbing operations simultaneously at maximum intensity, the system distributes scrubbing tasks across different time periods, with some implementations running more frequently than others. This periodic action approach maintains comprehensive data integrity coverage while preventing overwhelming system activity load at any single moment.
Data Source
AI summary
A method for maintaining integrity of data in a redundant mass storage system is provided that includes selecting a plurality of scrubbing selections for a memory system in which each of the scrubbing selections selects a data section on the memory system. The method also includes selecting a respective scrubbing implementation for each scrubbing selection in which each of the scrubbing implementations determines a data check. Another exemplary method is provided for ensuring integrity of data stored in a redundant mass storage system. An apparatus is provided for maintaining data integrity in a redundant mass storage system. A computer-readable storage medium containing a set of instructions for a general purpose computer is provided. The set of instructions include a method for ensuring data integrity in a redundant mass storage system.