Storage Appliance Fault Domain and Deduplication Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Storage appliances with multiple fault domains restrict data deduplication across volume families, leading to potential system downtime upon detection of a single fault, as each fault domain is isolated, preventing effective data reduction and increasing the likelihood of the system being taken offline.

Innovation Solution

Implementing a single fault domain for multiple filesystems that handle files across volume families, allowing data deduplication across these families, while recording and analyzing fault data to determine immediate or deferred recovery actions, thereby reducing unnecessary system downtime.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple fault domains are created for isolation, then system reliability is improved, but data deduplication effectiveness deteriorates

Engineering Contradiction:
Improvesystem reliabilityVSAvoiddata reduction
Core Design Contradiction:
ReliabilityVSLoss of substance

Solution Approach 1:

The system segments fault domains to isolate failures while maintaining a unified deduplication domain. Each filesystem operates within its own fault domain for reliability, but the deduplication engine spans across fault domain boundaries to enable comprehensive data reduction. This segmentation allows independent failure containment without sacrificing deduplication efficiency.

Inventive Principle:
Principle #1Segmentation

2Loss of substance

If a single fault domain is used for data deduplication across volume families, then data reduction is improved, but system availability deteriorates

Engineering Contradiction:
Improvedata reductionVSAvoidsystem availability
Core Design Contradiction:
Loss of substanceVSReliability

Solution Approach 1:

The system divides the storage architecture into multiple fault domains while maintaining a logical unified deduplication space. When a fault is detected in one domain, only that specific domain is isolated and taken offline, while other fault domains continue operating normally. This segmentation prevents single-point-failure propagation while preserving deduplication effectiveness across remaining healthy domains.

Inventive Principle:
Principle #1Segmentation

3Reliability

If fault isolation is implemented across filesystems, then fault impact is reduced, but deduplication domain scope is restricted

Engineering Contradiction:
Improvefault impactVSAvoiddeduplication domain scope
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system introduces a hierarchical dimension to fault domain management, where filesystem-level fault isolation coexists with a global deduplication dimension. Fault domains are organized in layers: individual filesystem fault domains for isolation, and an overarching deduplication domain that spans multiple fault domains. This dimensional approach allows simultaneous fault containment and broad deduplication coverage.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11416330B2Lifecycle of handling faults in next generation storage systems
Publication Date: 2022.08.16 EMC IP HLDG CO LLC
  • US11416330B2 patent drawing
  • US11416330B2 patent drawing
  • US11416330B2 patent drawing

AI summary

Techniques for providing lifecycle handling of faults associated with a storage appliance. The techniques can include recording information or details of one or more detected faults associated with a storage appliance in a fault database, analyzing the recorded fault information/details by an analytic tool, and determining whether to perform immediate recovery or defer recovery of the detected fault(s) based at least on a recommendation of the analytic tool. In this way, taking the storage appliance offline upon occurrence of a single fault can, for the most part, be avoided. In addition, because the detection of faults is not performed within a fault domain for a filesystem handling files for a single or limited number of volume families, a deduplication domain for the files of the filesystem is not restricted to the single or limited number of volume families.