NDMP Intermediary for Incremental Deletion Migration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The Network Data Management Protocol (NDMP) fails to correctly migrate deletions from a source device to a storage device during incremental 'NDMP copy' procedures, leading to mismatched backup data and inefficient resource utilization due to unsupported data formats and lack of deletion handling.
Innovation Solution
An EMC cloud tiering appliance is introduced to perform data format conversions and handle deletions by connecting to both source and storage devices via NDMP, parsing backup data, converting formats, and streaming corrected data for proper restoration, ensuring accurate migration of deletions and incremental file and directory updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If NDMP is used for incremental backup between heterogeneous devices with incompatible data formats, then backup functionality is provided, but deletion migration fails and data consistency deteriorates
Solution Approach 1:
The patent introduces an intermediary component that sits between the NDMP backup process and the storage device. This intermediary intercepts backup streams, parses them to identify deleted files, and actively manages deletion propagation to the storage device. The intermediary acts as a mediator that translates NDMP's limited incremental backup capability into complete deletion migration, resolving the contradiction between heterogeneous device compatibility and data consistency.
2Productivity
If NDMP incremental backup is used, then only modified files are copied improving efficiency, but deleted files are not tracked causing data mismatch
Solution Approach 1:
The patent implements a feedback mechanism where the intermediary continuously monitors the source device's file system state between incremental backup operations. By comparing the current state with the previous backup state, the intermediary receives feedback about deleted files and actively propagates this deletion information to the storage device. This feedback loop ensures that deletion information is captured without requiring full backup operations, maintaining both efficiency and data accuracy.
3Adaptability or versatility
If NDMP copy process is used between devices with incompatible formats, then migration is enabled, but deletion handling fails due to protocol limitations
Solution Approach 1:
The patent applies preliminary action by having the intermediary parse and analyze the backup stream data structure before the actual restore operation occurs. By pre-processing the backup stream to identify deleted files and their metadata, the intermediary prepares deletion information in advance. This preliminary action ensures that when the restore operation executes, deletion handling is already prepared and integrated, making the process as seamless as standard NDMP operations while adding deletion migration capability.
Data Source
AI summary
Deletion handling for incremental file migration is described. Data is received from a storage device. A modified directory is identified in the data. A list is created of files associated with the modified directory in the source device. Any files associated with the modified directory that are absent from the list of files are deleted from a storage device.