KV-SSD Object Grouping Schema for Mixed IO Latency

The patent creates separate processing paths for small and large object IOs. The small object path concatenates multiple small IOs into groups and processes them with optimized parameters (smaller threshold sizes, appropriate timeout windows), while the large object path handles big IOs independently. This segmentation prevents large IO processing from blocking small IO completion, simultaneously improving both large object throughput and small object latency.

The patent implements dynamic parameter adjustment for the object grouping schema. Threshold sizes and timeout windows are configurable and can be adapted based on workload conditions. This dynamic adjustment allows the system to optimize performance for different IO size distributions, preventing the system from being biased toward either small or large objects under varying conditions.

The patent segments the processing pipeline into distinct paths for small and large objects. The small object path uses parameter optimization (smaller threshold sizes, tailored timeout windows) to minimize latency, while the large object path maintains separate processing logic that preserves throughput. This segmentation ensures that optimization for small objects does not compromise large object performance.

The patent employs dynamic parameter adjustment where threshold sizes and timeout windows can be configured based on workload characteristics. This allows the system to adapt to different IO size distributions and maintain optimal performance for both small and large objects, preventing bias toward either category under varying operational conditions.