Multi-meta die storage bandwidth transfer for parallel operations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multi-meta die-based storage devices face inefficiencies in die utilization due to power and resource constraints, leading to suboptimal performance and degraded quality of service when not all dies can be operated in parallel.

Innovation Solution

A controller in the storage device identifies inactive dies and transfers unused bandwidth from an active meta die to another meta die with pending operations, allowing parallel execution of foreground and background tasks without resource bottlenecks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If all dies are operated in parallel to improve performance, then productivity increases, but power consumption exceeds the power ceiling

Engineering Contradiction:
Improvestorage device performanceVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system dynamically adjusts the number of active dies based on power availability and operation type. The controller monitors power consumption and switches between operating all dies in parallel (when power allows) and operating a subset of dies (when power is constrained), enabling the system to adapt its performance level to match available power resources.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs partial parallel operation by activating only the necessary number of dies required to complete operations within power constraints. Instead of always operating all dies in parallel or never in parallel, the system selectively activates a subset of dies (e.g., 2 out of 4) to achieve sufficient throughput while staying within power limits.

Inventive Principle:
Principle #16Partial or excessive action

2Use of energy by moving object

If a subset of dies is operated in parallel to satisfy power constraints, then power consumption is controlled, but die utilization efficiency decreases

Engineering Contradiction:
Improvepower consumptionVSAvoiddie utilization efficiency
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The system performs preliminary actions by pre-positioning data in buffer memory before power-constrained operations. Background operations such as data relocation and caching are executed in advance when power is available, so that during sustained write operations with limited power, the active dies can process host data without waiting for data preparation, thereby improving overall die utilization efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system ensures continuous useful action by overlapping background operations with foreground operations across different meta dies. While one meta die performs sustained writes with limited power, another meta die simultaneously performs background operations, ensuring that all dies remain productive and utilization efficiency is maximized over time.

Inventive Principle:
Principle #20Continuity of useful action

3Device complexity

If background operations are performed on the same meta die as foreground operations, then device complexity is reduced, but quality of service degrades due to operation blocking

Engineering Contradiction:
Improvecontroller complexityVSAvoidhost data write delay
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The system segments background operations and foreground operations across different meta dies. The controller divides the set of dies into multiple meta dies, dedicating some meta dies to foreground host operations and others to background operations. This spatial segmentation eliminates operation blocking and ensures that background operations do not delay host data writes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller acts as an intermediary that coordinates between foreground and background operations. It monitors the state of all meta dies, dynamically allocates operations to appropriate meta dies, and manages data flow between buffer memory and target dies, thereby preventing blocking while maintaining system coherence.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Stability of the object's composition

If the controller traverses data sequentially across meta dies to ensure uniform usage, then die utilization uniformity improves, but productivity decreases due to lost parallelism

Engineering Contradiction:
Improvedie utilization uniformityVSAvoidstorage device throughput
Core Design Contradiction:
Stability of the object's compositionVSProductivity

Solution Approach 1:

The system applies different operation patterns to different meta dies based on local conditions. Some meta dies operate in parallel mode for foreground writes when power is available, while others perform sequential background operations. This localized differentiation allows the system to achieve both uniform die utilization over time and high instantaneous throughput when resources permit.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20250224892A1Optimizing die utilization in multi-meta die based storage devices
Publication Date: 2025.07.10 SANDISK TECHNOLOGIES LLC
  • US20250224892A1 patent drawing
  • US20250224892A1 patent drawing
  • US20250224892A1 patent drawing

AI summary

A storage device optimizes die utilization in multi-meta die-based environments. The storage device includes a memory device including multiple meta dies. When a controller on the storage device receives host instructions, the controller selects a first meta die on which to execute the host instruction. If the controller identifies that at least one inactive die is present on the first meta die and that the first meta die has unused bandwidth, the controller selects a second meta die having a pending background operation. The controller transfers the unused bandwidth from the first meta die to the second meta die. The controller executes the background operation on the second meta die, using the unused bandwidth from the first meta die, in parallel with foreground operation on the first meta die.