Data Scrubbing Subsystem Concurrent Access Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data scrubbing methods in data storage subsystems either incur additional expenses due to caching or significantly increase data access latency by suspending access during scrubbing operations.
Innovation Solution
A method and system that processes access requests and performs data scrubbing simultaneously using separate processing modules, modifying access permission metadata to allow read access while maintaining data consistency, enabling scrubbing of active and inactive data without interrupting access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a redundant (cached) copy of data is provided for access during scrubbing operations, then data access continuity is maintained, but additional expense and system complexity increase
Solution Approach 1:
The system divides data management into two separate processing modules: one dedicated to handling data access requests and another dedicated to performing scrubbing operations. This segmentation allows both operations to proceed concurrently without requiring a cached copy of the data, thereby maintaining access continuity while avoiding the complexity and cost of additional caching infrastructure.
2Reliability
If access to data is suspended during scrubbing operations, then data consistency is ensured, but data access latency significantly increases
Solution Approach 1:
The system introduces access permission metadata as an intermediary mechanism to coordinate between data access operations and scrubbing operations. This metadata tracks the state of data and controls access permissions, allowing the system to ensure data consistency during scrubbing without completely suspending access, thereby reducing latency while maintaining reliability.
3Loss of time
If access permission metadata is modified to allow read access during scrubbing, then data access latency is reduced, but data consistency may be compromised
Solution Approach 1:
The system implements a feedback mechanism where the scrubbing processing module continuously updates access permission metadata based on the current state of scrubbing operations. This feedback loop allows the system to dynamically adjust access permissions - allowing read access when scrubbing is complete or in progress on different data segments - thereby reducing latency while maintaining data consistency through real-time coordination.
Data Source
AI summary
A method and system for scrubbing data within a data storage subsystem is disclosed. According to one embodiment, a method is provided for scrubbing data of a storage element within a data storage subsystem. In the described method embodiment, a request to access the storage element is processed utilizing a first processing module and access permission metadata associated with the storage element. A data scrub process is concurrently performed utilizing a second processing module by modifying the access permission metadata and validating data of the storage element substantially simultaneously with the processing.