Log-Structured Metadata Access with Fine-Grained Translation Table Updates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional metadata access designs in storage systems require exclusive access to entire metadata pages for changes, leading to contention between threads and increased latency, exacerbated by the introduction of log-structured systems that increase metadata page access.
Innovation Solution
A method for generating entries in a translation table page of a log-structured metadata store, allowing metadata page deltas to be flushed to persistent memory without accessing other entries, and updating the translation table page associated with the metadata page without locking other entries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If exclusive access to entire metadata pages is required for changes, then data consistency is maintained, but thread contention increases and latency increases
Solution Approach 1:
The patent segments the metadata page into multiple regions, each associated with a different translation table page. This allows threads to access different regions simultaneously without requiring exclusive access to the entire metadata page, thereby reducing thread contention while maintaining data consistency within each segment.
Solution Approach 2:
The patent implements fine-grained locking at the region level rather than page level. Each region can be locked independently based on the specific translation table page being accessed, allowing other regions to be accessed concurrently. This localizes the quality of protection to exactly where it is needed.
2Adaptability or versatility
If log-structured system processes more metadata pages, then translation functionality is improved, but number of contested metadata pages increases
Solution Approach 1:
The patent divides the metadata page into multiple regions that can be independently accessed. This segmentation allows multiple translation operations to proceed concurrently on different regions, improving overall productivity while maintaining the enhanced translation functionality of the log-structured system.
3Adaptability or versatility
If translation table is introduced for log-structured metadata, then mapping capability is enhanced, but metadata page access contention increases
Solution Approach 1:
The patent segments the metadata page based on translation table page associations. Each region is tied to a specific translation table page, allowing fine-grained concurrent access. This maintains the enhanced mapping capability while reducing contention by allowing simultaneous access to regions associated with different translation table pages.
Solution Approach 2:
The patent introduces a new dimension of organization by associating regions with translation table pages. This creates a two-dimensional access structure where access patterns can be optimized along both the metadata page dimension and the translation table page dimension, reducing contention through better spatial organization.
Data Source
AI summary
A method, computer program product, and computing system for receiving a metadata page for storage within a log-structured metadata store. An entry may be generated within a translation table page of a translation table within the log-structured metadata store, wherein each entry of a plurality of entries within the translation table page is associated with a separate metadata page. One or more metadata page deltas for the metadata page may be recorded in the log-structured metadata store. The one or more metadata page deltas for the metadata page may be flushed to a persistent memory storage. In response to flushing the one or more metadata page deltas for the metadata page, the entry within the translation table page that is associated with the metadata page may be updated without accessing any other entry within the translation table page associated with other metadata pages.