Memory System Program Mode Switching for Mixed Workloads

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Memory systems face increased read latency in cache program mode due to delayed migration of read commands, leading to inefficient data access and potential user dissatisfaction with delayed data retrieval.

Innovation Solution

A memory system that dynamically switches between cache and normal program modes based on workload thresholds, where the workload manager detects mixed or sequential workloads to adjust command processing and queue management, optimizing write and read command handling to reduce latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the memory system operates in cache program mode to improve write performance, then write command processing is accelerated, but read latency increases due to delayed migration of read commands

Engineering Contradiction:

Improvewrite performanceVSAvoidread latency

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The memory system dynamically switches between cache program mode and normal program mode based on workload detection. When a mixed workload is detected (read count exceeds first threshold), the system transitions from cache program mode to normal program mode to reduce read latency, and can switch back to cache program mode when sequential workload is detected (write count exceeds second threshold) to improve write performance.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters by switching program modes. In cache program mode, write commands are processed with accelerated performance, while in normal program mode, read commands are migrated promptly to reduce latency. The workload manager monitors read count and write count thresholds to determine when to change these operational parameters.

Inventive Principle:

Principle #35Parameter changes

2Productivity

If read commands are delayed in cache program mode to prioritize write operations, then write throughput increases, but read response time deteriorates

Engineering Contradiction:

Improvewrite throughputVSAvoidread response time

Core Design Contradiction:

ProductivityVSSpeed

Solution Approach 1:

The system dynamically adjusts command processing behavior by switching modes. In cache program mode, read commands are delayed to prioritize write throughput. When read response time becomes critical (read count > first threshold), the system switches to normal program mode where read commands are processed with higher priority, thus improving read response time while maintaining write throughput capability.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The workload manager continuously monitors the system state by counting read commands and write commands. When the read count exceeds the first threshold, feedback triggers a mode switch to normal program mode to improve read response time. When the write count exceeds the second threshold, feedback triggers a switch back to cache program mode to maximize write throughput.

Inventive Principle:

Principle #23Feedback

3Device complexity

If the system uses a single program mode, then device complexity is reduced, but adaptability to different workload types decreases

Engineering Contradiction:

Improveprogram mode managementVSAvoidworkload adaptation

Core Design Contradiction:

Device complexityVSAdaptability or versatility

Solution Approach 1:

The memory system implements multi-functionality by supporting both cache program mode and normal program mode within a single controller. The workload manager detects workload characteristics and automatically selects the appropriate mode, making the system adaptable to both sequential workloads (benefiting from cache mode) and mixed workloads (benefiting from normal mode) without requiring separate dedicated systems.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses dynamic mode switching to adapt to different workload types. The workload manager monitors command patterns and transitions between modes based on detected workload characteristics, enabling the system to optimize performance for both sequential and mixed workloads while maintaining a unified device architecture.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS11360706B2Memory system with program mode switching based on mixed and sequential workloads

Publication Date: 2022.06.14 SK HYNIX INC

AI summary

A memory system includes: a memory device; a host interface suitable for receiving write commands and queueing the received write commands in an interface queue; a workload manager suitable for detecting, in a cache program mode, a mixed workload when a read count is greater than a first threshold value, the read count representing a number of read commands queued in the interface queue and the mixed workload representing receipt of a mix of read and write commands; a mode manager suitable for switching from the cache program mode to a normal program mode when the mixed workload is detected; and a processor suitable for processing write commands queued in a command queue in the cache program mode and processing write commands queued in the interface queue in the normal program mode when the mixed workload is detected.