I/O Coherent Request Node for Data Processing Network Write Handling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data processing networks face inefficiencies in managing write operations due to the overhead incurred by streaming write flows, which are necessary for ordered writes, but also apply to non-ordered writes, leading to unnecessary resource utilization and bandwidth reduction.

Innovation Solution

The implementation of an I/O Requesting Node (RN-I) that dynamically isolates same-ID write streams from unique-ID write operations, allowing only ordered writes to use streaming flows while non-ordered writes follow an optimized protocol, minimizing message responses, transaction lifetime, and data movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If streaming write flow is used to guarantee ordered write observation, then write ordering is ensured, but overhead in terms of messages and node resources increases

Engineering Contradiction:
Improvewrite ordering guaranteeVSAvoidmessage overhead and node resource utilization
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments write operations into two distinct categories: ordered streaming writes and unordered independent writes. By dividing the write protocol into separate handling paths, the system applies the complex streaming flow protocol only when ordering is required, while using a simplified protocol for writes that do not require ordering guarantees.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements partial action by applying the full streaming write protocol only to the extent necessary for ordered writes. For unordered writes, the system uses a reduced protocol with fewer messages and less resource utilization, avoiding the excessive overhead of applying streaming protocols to all writes regardless of ordering requirements.

Inventive Principle:
Principle #16Partial or excessive action

2Adaptability or versatility

If interface modification is made to include additional signaling for identifying ordered streaming writes, then ordered writes can be identified, but implementation cost increases

Engineering Contradiction:
Improveability to identify ordered writesVSAvoidimplementation cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent uses existing stream identifier fields that are already present in standard write requests to identify ordered writes. Instead of creating new signaling mechanisms or modifying the interface, the system copies and leverages existing identifier fields for their additional purpose of distinguishing ordered from unordered writes, avoiding costly interface modifications.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent makes existing stream identifier fields multi-functional by using them both for their original purpose and for identifying ordered streaming writes. This universal usage of existing fields eliminates the need for additional signaling mechanisms and reduces implementation costs while maintaining the ability to distinguish ordered writes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If all writes go through the interface implementing OWO property, then ordered writes are guaranteed, but bandwidth is reduced due to unnecessary overhead for non-ordered writes

Engineering Contradiction:
Improveordered write observationVSAvoidsystem bandwidth
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the write processing path into two separate channels: one for ordered writes that requires full OWO protocol handling, and another for unordered writes that uses a streamlined protocol. This segmentation allows ordered writes to maintain their reliability guarantees while unordered writes contribute to bandwidth efficiency by using fewer messages and less processing overhead.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the protocol parameters dynamically based on the write type. For ordered writes, the system activates full OWO protocol parameters including additional messages and resource allocation. For unordered writes, the system modifies parameters to use a simplified protocol with reduced messaging and resource requirements, thereby optimizing bandwidth utilization.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11119961B2I/O coherent request node for data processing network with improved handling of write operations
Publication Date: 2021.09.14 ARM LTD
  • US11119961B2 patent drawing
  • US11119961B2 patent drawing
  • US11119961B2 patent drawing

AI summary

A method and apparatus for data transfer in a data processing network uses both ordered and optimized write requests. A first write request is received at a first node of the data processing network is directed to a first address and has a first stream identifier. The first node determines if any previous write request with the same first stream identifier is pending. When a previous write request is pending, a request for an ordered write is sent to a Home Node of the data processing network associated with the first address. When no previous write request to the first stream identifier is pending, a request for an optimized write is sent to the Home Node. The Home Node and first node are configured to complete a sequence of ordered write requests before the associated data is made available to other elements of the data processing network.