Synchronized Safe Data Commit Scans in Distributed Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed data storage systems, safe data commit scans across multiple data storage systems often lead to significant system resource consumption, causing noticeable slowdowns in response times for concurrent input/output operations due to independent and asynchronous timing of these scans across different systems.
Innovation Solution
Implementing synchronized safe data commit scans across multiple data storage systems by initiating a scan in one system and propagating a start message to others, allowing all scans to overlap within a single synchronized interval, either through a start message or a timer expiration, but not both, to reduce resource consumption and response time slowdowns.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If safe data commit scans are performed independently in each data storage system, then data safety is ensured through periodic destaging, but system response time deteriorates due to multiple concurrent scans consuming significant resources
Solution Approach 1:
The patent merges independent safe data commit scan operations across multiple data storage systems into a single synchronized scan operation. The storage manager coordinates scans so that all systems perform their destaging operations simultaneously during a unified time window, rather than independently and concurrently. This consolidation maintains data safety requirements while eliminating the cumulative resource consumption that caused response time deterioration.
2Reliability
If safe data commit scans are performed frequently to ensure data safety, then data destaging reliability improves, but system resource consumption increases causing performance degradation
Solution Approach 1:
The patent implements a coordinated periodic action where safe data commit scans are performed simultaneously across all data storage systems at predetermined time intervals. The storage manager synchronizes these periodic operations so that all systems execute their destaging tasks during the same time window, ensuring data safety requirements are met while preventing continuous or overlapping scans that would degrade system performance.
Data Source
AI summary
In one aspect of the present description, safe data commit scan operations of individual data storage systems of a distributed data storage system may be synchronized to reduce the occurrence of reductions in input/output (I/O) response times. In one embodiment, a set of safe data commit scan operations of the individual data storage systems of a distributed data storage system are synchronously timed to substantially overlap in time within a single synchronized safe data commit scan set interval to reduce or eliminate the occurrences of reductions in input/output response times outside the synchronized safe data commit scan set interval. Other features and aspects may be realized, depending upon the particular application.