Unified Metadata Reconstruction in Distributed Storage Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current storage management systems face challenges in managing and reconstructing metadata across a network, particularly in identifying and collecting metadata for data integrity and system maintenance, especially when data is missing, deleted, or corrupted.

Innovation Solution

A system and method for identifying, collecting, and reconstructing metadata in an electronic storage network using a master storage manager that interconnects storage operation cells, assigning unique identifiers to metadata sets, and storing them centrally to facilitate data reconstruction and maintenance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If metadata is distributed across multiple storage operation cells, then system scalability and operational independence are improved, but data integrity and reconstruction capability deteriorate when metadata is lost or corrupted

Engineering Contradiction:
Improvesystem scalabilityVSAvoiddata integrity
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent creates a unified metadata repository that maintains copies of metadata from multiple storage operation cells. When metadata is lost or corrupted in one cell, the unified repository provides reconstructed copies to restore data integrity while preserving the distributed architecture's scalability.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The unified metadata repository acts as an intermediary between distributed storage operation cells. It collects, consolidates, and manages metadata from multiple cells, providing a central coordination point that enables reconstruction of lost metadata while maintaining the independence and scalability of individual cells.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If metadata is stored centrally in a unified repository, then data reconstruction capability is improved, but system complexity and single point of failure risk increase

Engineering Contradiction:
Improvedata reconstruction capabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The unified metadata repository is implemented as a modular component that can be integrated incrementally into the distributed storage system. The repository is segmented into functional modules for metadata collection, consolidation, and reconstruction, reducing overall system complexity while maintaining reconstruction capability.

Inventive Principle:
Principle #1Segmentation

3Reliability

If metadata from multiple storage operation cells is collected and merged, then unified data view and reconstruction capability are improved, but processing time and computational resources increase

Engineering Contradiction:
Improveunified data viewVSAvoidmetadata processing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by continuously collecting and consolidating metadata from storage operation cells into the unified repository during normal operations. This advance preparation ensures that when metadata reconstruction is needed, the unified view is already available, minimizing processing time during recovery operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9996430B2Systems and methods of unified reconstruction in storage systems
Publication Date: 2018.06.12 COMMVAULT SYSTEMS INC
  • US9996430B2 patent drawing
  • US9996430B2 patent drawing
  • US9996430B2 patent drawing

AI summary

Systems and methods for reconstructing unified data in an electronic storage network are provided which may include the identification and use of metadata stored centrally within the system. The metadata may be generated by a group of storage operation cells during storage operations within the network. The unified metadata is used to reconstruct data throughout the storage operation cells that may be missing, deleted or corrupt.