SSD Processing Bandwidth Allocation for Memory Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing devices face challenges in efficiently balancing processing bandwidth allocation during steady-state workloads and transitions, leading to inefficiencies in memory usage and performance, particularly in solid-state drives (SSDs), due to inadequate management of free memory and garbage collection processes.

Innovation Solution

The implementation of a method and device that dynamically adjusts processing bandwidth based on the used amount of free memory, allocating resources to process host instructions and perform garbage collection, minimizing the need for spare memory by using configurable thresholds to manage workload transitions and transitions in processing bandwidth allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If processing bandwidth is allocated to execute host instructions, then device performance is improved, but the amount of free memory decreases

Engineering Contradiction:
Improvedevice performanceVSAvoidamount of free memory
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent implements dynamic processing bandwidth allocation that adjusts the proportion of bandwidth dedicated to host instructions versus garbage collection based on the current amount of free memory. When free memory is abundant, more bandwidth is allocated to host instructions to maximize performance. When free memory becomes scarce, the allocation shifts to prioritize garbage collection that replenishes free memory, thus dynamically resolving the contradiction between performance and memory availability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of processing bandwidth allocation ratios based on the state of free memory. By monitoring free memory levels and adjusting the bandwidth distribution parameter between instruction execution and garbage collection, the system optimizes the trade-off between maintaining high performance and preserving sufficient free memory for future operations.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If garbage collection is performed to increase free memory, then the amount of free memory is improved, but device performance decreases

Engineering Contradiction:
Improveamount of free memoryVSAvoiddevice performance
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent employs dynamic bandwidth allocation that adjusts the proportion of processing bandwidth dedicated to garbage collection versus host instruction execution based on current free memory levels. When free memory is abundant, the system reduces garbage collection bandwidth allocation to maximize performance. When free memory becomes scarce, it increases garbage collection bandwidth to replenish free memory, thus dynamically resolving the contradiction between memory availability and performance.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system modifies the processing bandwidth allocation parameter for garbage collection based on the state of free memory. By changing this parameter dynamically - reducing it when free memory is high and increasing it when free memory is low - the system optimizes the balance between maintaining performance and ensuring sufficient free memory for future host operations.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If minimum effective spare memory is minimized, then memory efficiency is improved, but processing bandwidth allocation becomes more complex

Engineering Contradiction:
Improvememory efficiencyVSAvoidprocessing bandwidth allocation
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent implements a dynamic bandwidth allocation mechanism that automatically adjusts processing bandwidth distribution between host instructions and garbage collection based on real-time free memory monitoring. This dynamic approach minimizes the need for static spare memory buffers while managing the complexity through automated state-based decision logic, allowing the system to maintain high memory efficiency without requiring overly complex manual management.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250208925A1Devices and methods for improved workload-balancing processing bandwidth allocation
Publication Date: 2025.06.26 SK HYNIX NAND PRODUCT SOLUTIONS CORP
  • US20250208925A1 patent drawing
  • US20250208925A1 patent drawing
  • US20250208925A1 patent drawing

AI summary

A device and related method, the device including memory, communications circuitry, and processing circuitry. The processing circuitry allocates processing bandwidth of the device to process the received instructions and executes the instructions based on the allocated processing bandwidth using a first amount of free memory. If the used first amount of free memory is at least a first threshold, processing circuitry reduces the allocated processing bandwidth to process the received instructions based on the used first amount of free memory and continues to execute the instructions based on the reduced allocated processing bandwidth using a second amount of free memory of the device. If the used second amount of free memory is at least a second threshold, processing circuitry further reduces the allocated processing bandwidth to process the received instructions based on the used second amount of free memory, and allocates processing bandwidth to perform garbage collection of the memory.