Delta Log Entries for Lazy Snapshot Dependency Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In storage clusters with delta log-based architectures, the de-staging order of delta updates for parent and child metadata pages can impose constraints, leading to inefficiencies and potential loss of original delta updates, especially in snapshot replication scenarios where parent metadata pages become writable, making it difficult to maintain dependency relationships and resulting in high algorithmic complexity and processing overhead.
Innovation Solution
The introduction of specialized delta update entries with formats like 'LI1:EI1:NON-INHERITED:OLD_VALUE-NEW_VALUE' in the metadata delta log, which preserve both new and original delta update values, allows for reduced constraints on de-staging order by creating a dependency relationship between parent and child metadata pages, enabling efficient de-staging and maintaining original values.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the parent metadata page is de-staged before the child metadata page to satisfy dependency constraints, then the dependency relationship is maintained, but the processing overhead and algorithmic complexity increase significantly
Solution Approach 1:
The patent applies preliminary action by pre-recording the dependency relationship between parent and child metadata pages in specialized delta update entries (format: LI1:IS_PARENT_OF:LI2 and LI2:IS_CHILD_OF:LI1) before de-staging operations. This allows the system to plan and execute de-staging in an optimal order without complex runtime calculations, reducing algorithmic complexity while maintaining dependency integrity.
2Productivity
If the parent metadata page is de-staged before the child metadata page, then de-staging can proceed, but original delta updates of the parent page may be irretrievably lost
Solution Approach 1:
The patent records the dependency relationship and identifies the base page requirements in advance through specialized delta update entries. This preliminary action allows the system to retrieve the necessary base page before de-staging the parent metadata page, ensuring original delta updates are preserved while maintaining high de-staging productivity.
Solution Approach 2:
The patent introduces the base page as an intermediary element that mediates between the parent and child metadata pages. By obtaining the base page (a version of the parent page that existed before the dependency relationship was created) and applying it to reconstruct the child page, the system prevents loss of original delta updates while enabling efficient de-staging operations.
3Reliability
If the de-staging order is constrained by parent-child dependency relationships, then data integrity is maintained, but the processing overhead increases
Solution Approach 1:
The patent applies preliminary action by pre-recording all dependency relationships in specialized delta update entries during the snapshot creation process. This allows the de-staging operation to proceed with minimal overhead, as the system only needs to follow the pre-established dependency order rather than calculating it dynamically, thus maintaining data integrity while reducing processing time.
4Loss of information
If specialized delta update entries are written to preserve both old and new values, then original values are maintained, but the data log complexity increases
Solution Approach 1:
The patent applies local quality by using specialized delta update entries with a specific format (LI1:IS_PARENT_OF:LI2) only where needed to record dependency relationships, rather than complicating the entire data log structure. This localized approach preserves original values where necessary while keeping the overall log structure simple and manageable.
Data Source
AI summary
Techniques for providing dependency resolution for lazy snapshots in a storage cluster with a delta log-based architecture. The techniques include creating a dependency relationship between a parent metadata page and a child metadata page, receiving one or more new delta updates of the parent metadata page, and writing, to a metadata delta log, the new delta updates of the parent metadata page as specialized delta update entries that preserve or maintain the new delta update values and their corresponding original (old) delta update values. By preserving or maintaining both the new delta update values and the corresponding old delta update values of the parent metadata page in the metadata delta log, constraints pertaining to the order of de-staging the delta updates of the parent and child metadata pages can be reduced.