Storage Device Direct Data Path Bypassing CPU Bottleneck

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional network-attached storage devices are inefficient due to the CPU being a bottleneck in processing power and communication bandwidth, especially when scaling up storage capacity, as they process both control and data messages, with data messages being the majority and placing a high load on the CPU.

Innovation Solution

Implementing different processing paths for control and data messages, where control messages are routed through the processing device for administrative and management operations, while data messages are communicated directly between the storage device and the storage client without going through the processing device, reducing the burden on the CPU and improving efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If both control messages and data messages are processed through the CPU, then the storage device can provide comprehensive storage services, but the CPU becomes a bottleneck in processing power and communication bandwidth

Engineering Contradiction:
Improvestorage service capabilityVSAvoidmessage processing efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent segments the message processing function into two independent paths: control messages are routed through the host system CPU for administrative operations, while data messages are routed directly between the storage device and storage client through a dedicated data path, bypassing the CPU. This segmentation eliminates the CPU bottleneck while maintaining comprehensive storage service capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a dedicated data message path as an intermediary channel that enables direct communication between the storage device and storage client. This intermediary path handles data messages without requiring CPU intervention, thereby improving processing efficiency while the CPU continues to handle control messages through the host system.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the CPU processes all messages including data messages, then control and data operations can be unified, but power consumption and computing power requirements increase

Engineering Contradiction:
Improveoperation unificationVSAvoidpower consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent segments message processing into two distinct paths based on message type: control messages go through the host system CPU maintaining operational unification, while data messages use a dedicated direct path that bypasses the CPU. This segmentation reduces power consumption and computing power requirements by eliminating unnecessary CPU involvement in data message processing.

Inventive Principle:
Principle #1Segmentation

3Extent of automation

If data messages go through the host system, then centralized control is maintained, but security is compromised by exposing data access operations

Engineering Contradiction:
Improvecentralized controlVSAvoiddata access security
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The patent segments the communication paths so that control messages (which require centralized control and security policies) are processed through the host system CPU, while data messages (which require security isolation) are processed through a dedicated direct path between storage device and storage client. This segmentation maintains centralized control over control operations while improving security by isolating data access operations from the host system.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240020046A1Data Storage Devices having Different Paths for Control Messages and Data Messages
Publication Date: 2024.01.18 MICRON TECHNOLOGY INC
  • US20240020046A1 patent drawing
  • US20240020046A1 patent drawing
  • US20240020046A1 patent drawing

AI summary

An apparatus having a solid-state drive, a host interface, a network interface, and a controller configured to recover, from packets received in the network interface from a remote host system, first control messages and data messages containing host data provided by the remote host system. The controller is further configured to: send the first control messages via the host interface to a local host system to receive second control messages from the local host system; and process the second control messages and the data messages, without sending the data message to the local host system, to write the host data into the solid-state drive. When the first control messages include read requests, the controller is further configured to retrieve data from the solid-state drive and send, via the network interface, the retrieved data to the remote host system without going through the local host system.