Adaptive Compression Mapping with Defrag Units for Mixed Workloads

The system dynamically switches between segment mapping mode and hash mapping mode based on workload characteristics. Segment mapping is used for sequential workloads to maximize throughput, while hash mapping is used for random workloads to minimize latency. This dynamic adaptation allows the system to optimize performance for different access patterns without requiring separate dedicated systems for each workload type.

The storage space is divided into multiple segments that can be independently managed and mapped. Each segment can be assigned to different mapping modes based on the access patterns of the data it contains. This segmentation allows fine-grained control over mapping strategies and enables the system to handle mixed workloads efficiently by applying appropriate mapping modes to different segments.

Different mapping modes are applied to different segments based on their specific access patterns. Sequential segments use segment mapping to maintain continuity and reduce fragmentation, while random access segments use hash mapping to provide fast access. This local optimization ensures that each segment is managed with the most appropriate mapping strategy, minimizing overall fragmentation while maintaining flexibility.

A mapping management layer acts as an intermediary between the host and the physical storage devices. This layer maintains mapping tables that track the relationship between logical block addresses and physical locations, and it dynamically selects which mapping mode to use for each segment. The intermediary manages the complexity of multiple mapping modes while presenting a unified interface to the host, thereby reducing the perceived fragmentation.

The system dynamically adjusts compression parameters and mapping strategies based on the observed compression rates of different data blocks. For blocks with high compression rates, the system allocates fewer physical blocks and may use hash mapping for random access efficiency. For blocks with low compression rates, the system allocates more physical blocks and uses segment mapping for sequential access efficiency. This parameter adaptation allows the system to optimize storage efficiency while automatically managing the complexity of varying compression characteristics.

The mapping management layer continuously monitors compression rates and access patterns of different data blocks, and uses this feedback to dynamically adjust mapping modes and capacity allocation. When compression rates change or access patterns shift, the system re-evaluates and re-assigns mapping modes to appropriate segments. This feedback mechanism enables automatic adaptation to changing storage conditions without requiring manual intervention, thereby managing capacity complexity through continuous optimization.