Filesystem Bookmarking for Point-in-Time Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Point-in-time replication systems, such as Dell EMC RecoverPoint, create numerous snapshots but lack convenient visibility and efficient searching mechanisms, making it difficult to locate specific data changes or states of interest, which is time-consuming and impractical due to the complexity of traditional filesystem indexing.
Innovation Solution
A system and method that capture filesystem events at the filesystem level, translating them into metadata with timestamps and bookmarks, allowing for easy visibility and searching within a journal to locate specific data changes, enabling quick recovery and replication of files or data states.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional filesystem indexing is used to index point-in-time snapshots, then completeness of indexing is improved, but time consumption and system complexity increase significantly
Solution Approach 1:
The patent applies partial indexing by selectively indexing only specific filesystem events (create, delete, modify operations) rather than attempting to index all possible events. This partial action approach provides sufficient visibility into snapshot contents without the excessive time cost of complete indexing, resolving the contradiction between indexing completeness and time consumption
2Productivity
If complete filesystem indexing is implemented to enable quick searching of snapshots, then searching efficiency is improved, but system complexity and implementation difficulty increase
Solution Approach 1:
The patent extracts only the essential indexing information (filesystem event types, filenames, timestamps) from the complex filesystem metadata and stores it in a simplified index structure. This extraction approach enables efficient searching without requiring the full complexity of a complete filesystem index, thus improving searching efficiency while reducing system complexity
Solution Approach 2:
The patent introduces an intermediary indexing layer that sits between the filesystem events and the snapshot data. This intermediary index contains simplified references to snapshot contents, enabling efficient searching without directly implementing a complex complete filesystem index, thereby resolving the contradiction between searching efficiency and system complexity
3Measurement precision
If periodic indexing of snapshots is performed, then indexing accuracy is improved, but implementation complexity and granularity control become difficult
Solution Approach 1:
The patent implements periodic indexing by indexing filesystem events at regular intervals (e.g., every N events or every T time units) rather than attempting to index every single event. This periodic approach provides sufficient accuracy for locating snapshots of interest while avoiding the excessive complexity of event-by-event indexing, effectively resolving the contradiction between indexing accuracy and implementation complexity
Data Source
AI summary
An agent executing on a processor at a data production site detects filesystem events and creates a list of bookmarks describing the filesystem events in user-understandable strings. Each bookmark is associated with metadata about the filesystem event that includes a timestamp and a point-in-time (PiT) snapshot of the filesystem at the time of occurrence of the event. The bookmarks and associated metadata are transferred to a recovery site and the bookmark set is recorded in storage. The storage can be searched for bookmarks in the set that reference the filename of a file of interest, and the file recovered and replicated using an associated PiT.