Disk Sector Failure Prediction via Adjacent Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Magnetic disk drives face data loss due to undetected latent sector errors, which are not typically detected until data is read, leading to reduced data durability in redundant storage systems, and current scrubbing methods to address these errors incur disk head movement and performance costs.

Innovation Solution

A predictive analysis system that monitors sector access data to determine the likelihood of sector failure by utilizing adjacent sector access data, employing a Bayesian belief-propagation model to identify sectors with high error likelihood and optimize scrubbing operations, thereby reducing data loss without increasing scrubbing speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If disk scrubbing is performed to detect latent sector errors, then data durability is improved, but disk head movement and storage system performance deteriorate

Engineering Contradiction:
Improvedata durabilityVSAvoidstorage system performance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs preliminary analysis of sector access patterns and error histories to predict which sectors are most likely to fail before actual scrubbing occurs. This allows the system to prioritize scrubbing operations on high-risk sectors only, rather than performing comprehensive scrubbing of all sectors, thereby maintaining data durability while reducing the performance impact on storage systems.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of applying uniform scrubbing to all disk sectors, the system identifies and targets specific local areas (sectors) that show signs of degradation through their access patterns and error histories. This localized approach to scrubbing reduces the overall scrubbing workload and minimizes impact on storage system performance while effectively addressing latent errors where they are most likely to occur.

Inventive Principle:
Principle #3Local quality

2Reliability

If comprehensive disk scrubbing is performed to ensure data readability, then data durability is improved, but disk wear and I/O bandwidth consumption increase

Engineering Contradiction:
Improvedata durabilityVSAvoiddisk wear
Core Design Contradiction:
ReliabilityVSLoss of substance

Solution Approach 1:

The system uses preliminary prediction models based on sector access patterns and error histories to identify high-risk sectors before comprehensive scrubbing is needed. This allows targeted scrubbing operations that focus only on sectors showing signs of degradation, reducing unnecessary I/O operations and disk wear while maintaining data durability through proactive error detection.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Rather than performing complete disk scrubbing, the system applies partial scrubbing only to the subset of sectors that prediction models identify as high-risk. This partial action approach reduces the total I/O bandwidth consumption and disk wear associated with comprehensive scrubbing while still providing effective error detection and data durability protection where it is most needed.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9105308B2System and method for disk sector failure prediction
Publication Date: 2015.08.11 AMAZON TECH INC
  • US9105308B2 patent drawing
  • US9105308B2 patent drawing
  • US9105308B2 patent drawing

AI summary

A system and method for predicting the likelihood of failure of the individual sectors of a magnetic storage disk based upon the monitoring of adjacent sector performance in responding to access requests. The prediction for a specific target sector's fidelity can be made through the gathering of sector performance data that occurs during normal read/write actions to the adjacent sectors, without a recent access request necessarily being made to the target sector. Scrubbing of the sectors can also be directed based upon the needed sector access data for target sector fidelity prediction.