PCIe SSD Integrated Networking Port for Fast Distributed Writes

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional distributed storage systems face significant remote write latency and increased resource load on remote servers due to interrupt-processing latency and CPU resource consumption during remote write operations.

Innovation Solution

Implementing a system with a PCI-e attached SSD that uses an integrated networking port for auto-log writes, reducing the number of steps required for a write operation and eliminating the need for external software intervention, thereby reducing latency and resource consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional remote write operations are used, then data consistency is achieved, but remote write latency increases and CPU resources are consumed

Engineering Contradiction:

Improvedata consistencyVSAvoidremote write latency

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts the interrupt-processing function from the remote server CPU by implementing a ring buffer mechanism in hardware/Firmware. The remote write data is placed in a ring buffer and acknowledged immediately without CPU intervention, separating the data transfer function from the CPU processing function, thus reducing latency while maintaining consistency

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a ring buffer as an intermediary data structure between the local and remote storage systems. This ring buffer acts as a mediator that holds write data temporarily, allowing the system to acknowledge writes immediately while ensuring consistency through later processing, thus resolving the latency-consistency tradeoff

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If conventional remote write operations are used, then data consistency is achieved, but CPU resources on remote server increase

Engineering Contradiction:

Improvedata consistencyVSAvoidCPU resource consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The system implements self-service mechanisms where the ring buffer automatically manages data storage and the system can detect and recover from failures autonomously through namespace appropriation, reducing the need for CPU-intensive monitoring and management operations

Inventive Principle:

Principle #25Self-service

3Loss of time

If PCI-e attached SSD with integrated networking port is used, then remote write latency is reduced, but device complexity increases

Engineering Contradiction:

Improveremote write latencyVSAvoidSSD architecture complexity

Core Design Contradiction:

Loss of timeVSDevice complexity

Solution Approach 1:

The patent merges the networking functionality directly into the SSD device by integrating a networking port with the PCI-e attached SSD. This consolidation eliminates external networking hardware and reduces the number of components, thereby reducing overall system complexity while enabling faster remote write operations through direct network access

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS10216596B1Fast consistent write in a distributed system

Publication Date: 2019.02.26 BITMICRO LLC

AI summary

Embodiments of the invention provide a system and method to vastly improve the remote write latency (write to remote server) and to reduce the load that is placed on the remote server by issuing auto-log (automatic log) writes through an integrated networking port in the SSD (solid state drive). Embodiments of the invention also provide a system and method for a PCI-e attached SSD to recover after a failure detection by appropriating a remote namespace.