Dual Valid Bit Set for Multi-Node Cache Contention

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multi-node system algorithms fail to prevent new requests from entering the system when contention arises, leading to sub-optimal response times and unfairness in request processing, as they address contention only after the fact or increase hardware complexity.

Innovation Solution

Implementing a dual valid bit set mechanism that actively handles contention by inhibiting new requests when a point of contention is detected, ensuring that existing requests complete before new ones are allowed, using alternate valid bits to stall new interface requests until outstanding conflicts are resolved.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the basic protocol reject algorithm is used, then hardware complexity is minimized, but request processing timeliness deteriorates due to continual rejecting and re-launching

Engineering Contradiction:
Improvehardware complexityVSAvoidrequest processing timeliness
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by setting the valid bit to inhibit new requests before contention actually occurs. When a request is rejected, the valid bit is set to prevent other requests from entering the nest during the resolution period, eliminating the need for continual retry cycles and improving timeliness while maintaining simple hardware architecture.

Inventive Principle:
Principle #10Preliminary action

2Loss of time

If the hang detect algorithm is used, then system timeliness is improved by stalling new requests, but device complexity increases due to additional monitoring mechanisms

Engineering Contradiction:
Improvesystem timelinessVSAvoiddevice complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent applies self-service by using the existing valid bit mechanism to automatically stall new requests when contention is detected. The system uses its own operational state (valid bit status) to control request admission, eliminating the need for separate hang detection monitoring mechanisms while maintaining timeliness.

Inventive Principle:
Principle #25Self-service

3Stability of the object's composition

If system serialization algorithms are used, then event ordering is ensured, but hardware complexity and processing timeliness both deteriorate

Engineering Contradiction:
Improveevent orderingVSAvoidhardware complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent applies local quality by ensuring ordering only at the point of contention (the nest) rather than globally throughout the entire system. The valid bit mechanism ensures that requests are processed in order at the critical section where contention occurs, while allowing other parts of the system to operate independently, thus achieving necessary ordering without full serialization complexity.

Inventive Principle:
Principle #3Local quality

4Productivity

If new requests are allowed to enter the system continuously, then productivity is maintained, but fairness among requests deteriorates due to sub-optimal response times

Engineering Contradiction:
Improverequest throughputVSAvoidrequest processing fairness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies dynamics by making the system state changeable through the valid bit. The valid bit dynamically transitions from inactive to active when contention is detected, automatically adjusting request admission behavior to ensure fairness. This dynamic mechanism maintains productivity by allowing continuous requests under normal conditions while ensuring fairness when contention occurs, without requiring manual intervention or complex algorithms.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS7523267B2Method for ensuring fairness among requests within a multi-node computer system
Publication Date: 2009.04.21 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US7523267B2 patent drawing
  • US7523267B2 patent drawing
  • US7523267B2 patent drawing

AI summary

A method to use of dual valid bit sets including a regular bit set and alternate valid bits set which prevents new requests to a given cache line from entering a multi-nodal computer systems' nest system until all requests to the given cache line have been completed successfully. By providing the alternate valid bits the dual set of resource valids for each remote requester is provided for each remote requester, where one set of valids indicates if the resource is valid and actively working on the line, and the other set of valids indicates if the resource was valid but encountered some conflict that requires resolution before the request can complete. Only on successful reload and completion of the remote operation does this alternate address valid bit reset and open the way for any pending interface requests to proceed, so all outstanding requests currently loaded in a local resource within the nest system are able to complete before new interface requests are allowed into the system.