Disaggregated Computing System Circuit Switching

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current computing architectures face challenges in efficiently accessing and processing data across multiple memory devices in large-scale distributed systems, leading to suboptimal performance and resource utilization due to the need for data to pass through networks, which results in high latency and inefficient bandwidth usage.

Innovation Solution

The implementation of a disaggregated computing system with dynamic, point-to-point circuit wire level switching and general-purpose links that allow for flexible connection of processing and memory elements, enabling direct access to data without relying on traditional SMP fabrics, and utilizing optical links for high-bandwidth connectivity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If data passes through traditional networks in large-scale distributed systems, then connectivity between computing elements is achieved, but latency increases and bandwidth usage becomes inefficient

Engineering Contradiction:

Improvedata access speedVSAvoidlatency

Core Design Contradiction:

SpeedVSLoss of time

Solution Approach 1:

The patent extracts the data access path from the traditional network fabric and creates direct point-to-point circuit switches between computing elements and memory devices. This removes data from the network traversal path, eliminating network-induced latency and enabling immediate access to data stored in memory devices.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces circuit switches as intermediaries that establish direct wired connections between computing elements and memory devices. These circuit switches act as mediators that bypass the traditional network fabric, providing high-speed direct access paths that reduce latency while maintaining connectivity.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If traditional SMP fabrics are used for connecting computing elements and memory devices, then system connectivity is maintained, but resource utilization becomes suboptimal

Engineering Contradiction:

Improveresource utilizationVSAvoidconnection architecture complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent implements dynamic connection establishment through circuit switches that can reconfigure connections on-demand. Computing elements can dynamically establish direct circuit-switched paths to specific memory devices based on data access requirements, optimizing resource utilization by creating connections only when needed rather than maintaining fixed fabric connections.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The circuit switches serve multiple functions: they act as connection establishers, data forwarders, and resource allocators. A single circuit switch infrastructure supports various computing elements accessing various memory devices, replacing the need for dedicated fabric connections and improving overall resource utilization across the system.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Speed

If direct point-to-point circuit switches are implemented between computing elements and memory devices, then data access latency is reduced, but system reconfiguration capability is needed

Engineering Contradiction:

Improvedata access speedVSAvoidsystem reconfiguration capability

Core Design Contradiction:

SpeedVSAdaptability or versatility

Solution Approach 1:

The circuit switch infrastructure enables dynamic reconfiguration of connection paths based on workload requirements. Computing elements can establish direct circuit-switched connections to specific memory devices on-demand, and these connections can be reconfigured as computational tasks change, providing both high-speed access and adaptability.

Inventive Principle:

Principle #15Dynamics

4Quantity of substance

If optical links are used for connectivity, then bandwidth is increased, but infrastructure complexity increases

Engineering Contradiction:

ImprovebandwidthVSAvoidoptical infrastructure complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent replaces traditional electrical network fabric connections with optical circuit-switched connections. Optical links provide higher bandwidth and faster signal transmission compared to electrical fabric connections, enabling high-speed direct access between computing elements and memory devices while the circuit switching logic manages the complexity of optical infrastructure.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11012423B2Maximizing resource utilization through efficient component communication in disaggregated datacenters

Publication Date: 2021.05.18 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Embodiments are provided herein for maximizing resource utilization in a disaggregated computing system. A general purpose link is established between a first sub-plurality of computing elements and a second sub-plurality of computing elements. The first sub-plurality belongs to a first plurality of computing components of a first type and the second sub-plurality belongs to a second plurality of computing components of a second type in the disaggregated computing system. A determination is made that the first and second sub-pluralities of computing elements are assigned to a first tenant having first data communications. The general purpose link is secured to the first tenant while allowing second data communications of a second tenant to pass through the general purpose link concurrent with the first data communications of the first tenant.