Adaptive Address Mapping for Fragmented Storage Workloads
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The extent-based address mapping scheme can exceed the memory cost of the page-based scheme in certain workload environments, particularly when random writes occur frequently, leading to storage region fragmentation.
Innovation Solution
A storage system and method that adaptively convert the format of address mapping information based on workload characteristics, calculating the average length of extents and converting between extent and page formats to optimize memory usage, reducing the frequency of format conversions and processing costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If extent-based address mapping scheme is used, then memory cost is reduced for sequential workloads, but memory cost increases for random write workloads due to fragmentation
Solution Approach 1:
The patent implements dynamic format conversion between extent-based and page-based address mapping schemes based on real-time workload characteristics. The system monitors workload patterns and automatically converts the mapping format to optimize for current conditions, making the system adaptable to both sequential and random write workloads rather than being fixed to one approach
Solution Approach 2:
The patent changes the parameter of address mapping format (extent-based vs. page-based) based on workload characteristics. By monitoring extent allocation patterns and converting formats when thresholds are exceeded, the system optimizes memory cost for different workload types - using extent-based for sequential access and page-based for random access patterns
2Productivity
If extent-based mapping is used, then fewer entries are needed for sequential access, but more memory is required when random writes cause fragmentation
Solution Approach 1:
The patent implements a feedback mechanism that monitors extent allocation patterns and fragmentation levels. When the system detects that random writes are causing excessive fragmentation (when average extent length exceeds a threshold), it triggers a format conversion from extent-based to page-based mapping, and vice versa, creating a closed-loop control system that optimizes memory usage based on actual conditions
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
A method for operating a storage system including a storage includes calculating an average length of extents allocated to a logical address region corresponding to a particular node of an address mapping tree, the address mapping tree being associated with the storage, and a mapping information format of the particular node being a first format and, based on the average length, converting the mapping information format of the particular node from the first format to a second format.