Pipelined I/O Adapter Low-Latency Write Retries

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Server computers face inefficiencies in processing write requests due to general and flexible processing methods that interrupt processors frequently, leading to slower execution paths and increased latency.

Innovation Solution

Implementing a low latency write request processing method in I/O adapter devices that minimizes processor interruptions by generating protocol information concurrently with data fetching and transmitting it alongside the write packet, reducing reliance on processor assistance during packet processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If general and flexible processing methods are used for write requests, then reliability and error handling are improved, but processor interruption frequency increases and execution speed decreases

Engineering Contradiction:
Improveerror handling capabilityVSAvoidwrite request processing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments write request processing into two distinct paths: a fast path for standard requests that bypasses processor interruptions, and a slow path for exceptional requests that requires full processing. This segmentation allows the system to achieve high speed for common operations while maintaining reliability for error cases through the flexible slow path.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-generating protocol information and preparing write packets in advance, before actual write operations are needed. This includes pre-allocating buffer space, pre-computing protocol headers, and staging data in memory, which eliminates the need for processor interruptions during the actual write execution.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If processor assistance is used during packet processing, then flexibility and error management are improved, but latency increases due to additional processor interruptions

Engineering Contradiction:
Improveprocessing flexibilityVSAvoidwrite request latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent implements self-service by enabling the I/O adapter to autonomously process write requests without requiring processor assistance for routine operations. The adapter generates its own protocol information, manages its own buffers, and executes writes independently, thereby eliminating latency-causing processor interruptions while maintaining full flexibility through software-based error handling.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent transitions from a single-dimension processing model where all operations require processor involvement to a multi-dimensional model with distinct fast and slow paths. The fast path operates in a dimension independent of processor interruptions, while the slow path handles exceptional cases, effectively adding a temporal dimension to processing flexibility.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Manufacturing precision

If protocol information is generated sequentially after data fetching, then processing accuracy is improved, but execution speed decreases due to sequential processing

Engineering Contradiction:
Improveprotocol information accuracyVSAvoidpacket transmission speed
Core Design Contradiction:
Manufacturing precisionVSSpeed

Solution Approach 1:

The patent merges the data fetching operation with protocol information generation into a single concurrent process. While data is being fetched from storage, the system simultaneously generates the necessary protocol headers and control information, eliminating sequential delays and improving transmission speed without sacrificing accuracy through the use of a common processing architecture.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent ensures continuity of useful action by overlapping data fetching with protocol generation, so that both operations proceed simultaneously rather than sequentially. This continuous parallel processing eliminates idle time and maintains high utilization of system resources, thereby increasing overall execution speed while preserving processing accuracy.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS10108572B1Pipelined I/O adapter device with low-latency write requests retries
Publication Date: 2018.10.23 AMAZON TECH INC
  • US10108572B1 patent drawing
  • US10108572B1 patent drawing
  • US10108572B1 patent drawing

AI summary

Server computers may include one or more input/output (I/O) adapter devices for communicating with a network and/or direct-attached device. The I/O adapter device may implement processes to manage write requests in a general and flexible manner. The I/O adapter device may also implement processes to manage write requests in a fast an efficient—that is, low latency—manner. Low latency write requests processes may include determining that a write packet for a write request can be processed without additional assistance from a processor, once a processor has initiated a memory access request to fetch write data and also generated protocol information for transmitting the write packet. The I/O adapter device may then process and transmit the write packet through an offload pipeline, without interrupting a processor.