File System Container Map Replication for Deduplicated Storage

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing deduplicated storage systems face challenges in effectively replicating data across networks due to the complexity of managing deduplicated data blocks and maintaining data integrity during replication processes, which can lead to inefficiencies and security risks.

Innovation Solution

A method for file system-based replication is implemented, where a source file system container map is received and used to create an active target file system container map, allowing for the efficient transfer and synchronization of data from a deduplicated source storage system to a target storage system, utilizing a replication manager to manage the mapping and population of containers, ensuring data integrity and security.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is replicated from a deduplicated storage system using traditional methods, then data copies can be made at offsite locations, but the process becomes labor-intensive, error-prone, and slow for data recovery

Engineering Contradiction:

Improvedata protectionVSAvoiddata recovery speed

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent replaces the mechanical process of physical tape shipping with an automated electronic data replication system. The replication manager automatically identifies deduplicated data blocks, retrieves them from source containers, and transfers them to target containers through electronic communication, eliminating manual labor and significantly accelerating data recovery operations.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system implements self-service through automated identification and tracking of deduplicated data blocks. The replication manager autonomously monitors the source storage system, identifies which data blocks need replication, and executes the replication process without human intervention, improving both reliability and productivity.

Inventive Principle:

Principle #25Self-service

2Reliability

If traditional backup applications are used to copy data to tapes, then data can be stored at offsite locations, but the process introduces security risks and is extremely slow

Engineering Contradiction:

Improvedata protectionVSAvoiddata transfer time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces the mechanical tape copying and physical shipping process with electronic data transfer through a network. The replication manager directly transfers deduplicated data blocks from source to target storage systems through electronic communication channels, reducing transfer time from days to minutes or seconds while maintaining security through controlled access protocols.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates electronic copies of deduplicated data blocks and transfers them through network infrastructure rather than physical tape copies. This electronic copying mechanism significantly reduces transfer time while maintaining data integrity through verification protocols.

Inventive Principle:

Principle #26Copying

3Quantity of substance

If data deduplication is applied to improve storage utilization, then storage efficiency increases, but replicating data from a deduplicated storage system becomes challenging

Engineering Contradiction:

Improvestorage utilizationVSAvoidreplication management complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent extracts the complexity of managing deduplicated data blocks by creating a dedicated replication manager that专门 handles deduplication-aware replication operations. This separate management layer isolates the complexity from the general storage system, allowing efficient replication without compromising storage utilization benefits.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The replication manager acts as an intermediary between the deduplicated storage system and the replication target. It translates the deduplicated data block structure into a format suitable for replication, managing the mapping between source and target containers while preserving storage efficiency.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS9798486B1Method and system for file system based replication of a deduplicated storage system

Publication Date: 2017.10.24 EMC IP HLDG CO LLC

AI summary

A computer-implemented method of replicating a file system is disclosed. The method starts with receiving a source file system container map at a target storage system, the source file system container map including mapping between a source file system and containers containing data of the source file system. An active target file system container map is then created based on the source file system container map to map data of the source file system to containers of the target storage system storing the data of the source file system. The data corresponding to the containers mapping to the source file system are received. The active target file system container map is then populated as containers of the target storage system are populated with data from the deduplicated source storage system, wherein the source and target container maps are utilized in subsequent restoration of data of the source file system.