Adaptive Data Subsegments for Mixed Erase-Block Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Heterogeneous erase block sizes in flash memory across different storage devices cause inefficiencies and data management challenges in storage clusters with replaceable blades and mixed solid-state memory, requiring software modifications for each hardware replacement.
Innovation Solution
Implementing segment-level heterogeneity with adaptive mapping and translation across storage devices, utilizing data segments of varying sizes to optimize storage utilization and minimize wasted space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If uniform block size flash memory is used, then device compatibility and simplicity are improved, but storage utilization efficiency deteriorates due to wasted space in heterogeneous storage clusters
Solution Approach 1:
The patent segments data into variable-sized segments that can be dynamically mapped to erase blocks of different sizes. This segmentation allows efficient utilization of heterogeneous storage devices by matching segment sizes to available erase block capacities, thereby reducing storage space waste while maintaining device compatibility through a unified management layer.
Solution Approach 2:
The system dynamically changes the parameters of data segments and their mapping relationships based on the specific characteristics of available storage devices. By adjusting segment sizes and mapping configurations according to the heterogeneous erase block sizes in the storage cluster, the system optimizes storage utilization without requiring uniform hardware.
2Adaptability or versatility
If software is modified for every hardware replacement, then storage system adaptability is improved, but system complexity and maintenance burden increase
Solution Approach 1:
The patent implements a universal data segment management layer that can handle multiple types of storage devices with different erase block sizes through a single software architecture. This multi-functional approach eliminates the need for separate software modifications for each hardware replacement, as the system automatically adapts to heterogeneous storage configurations through its inherent ability to manage variable-sized segments and dynamic mapping.
Solution Approach 2:
The storage management system performs self-service by automatically detecting the characteristics of replaced or added storage devices and dynamically reconfiguring the data segment mapping without requiring manual software modifications. The system self-adapts to hardware changes by utilizing its built-in flexibility in segment management and mapping strategies.
3Quantity of substance
If heterogeneous erase block sizes are used, then storage capacity flexibility is improved, but wear leveling efficiency deteriorates due to inconsistent data distribution
Solution Approach 1:
By segmenting data into appropriately sized units and strategically mapping these segments across erase blocks of different sizes, the system achieves both storage capacity flexibility and improved wear leveling. The segmentation allows for more uniform data distribution patterns that account for the heterogeneous nature of the storage devices, thereby enhancing reliability while maintaining capacity flexibility.
Data Source
AI summary
A data segment to be written to a set of storage devices is identified, wherein at least one storage device of the set of storage devices has a first allocation unit size that is larger than a second allocation unit size of other storage devices of the set of storage devices. A first subsegment having a first subsegment height corresponding to the second allocation unit size is mapped across the set of storage devices. A second subsegment having a second subsegment height that is a first difference between the first allocation unit size and the second allocation unit size is mapped across a first subset of the set of storage devices. A third subsegment having a third subsegment height that is a second difference between the second allocation unit size and second subsegment height is mapped across a second subset of the set of storage devices.