Main Memory Bus Bridging for Co-Processor I/O Bottlenecks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer systems face communication bottlenecks due to the lower bandwidths supported by traditional I/O buses, which restrict the performance of co-processors and I/O devices that operate at faster speeds, necessitating a method to interface these devices via the main memory system for enhanced I/O capabilities.

Innovation Solution

A system that connects co-processors or I/O devices directly to the main memory bus, allowing them to communicate at higher bandwidths, eliminating bottlenecks by using a TeraDIMM architecture that integrates non-volatile memory into the memory channel, enabling parallelism and scalability similar to CPU virtual memory systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If co-processors and I/O devices interface via traditional I/O bus, then device compatibility and ease of connection are maintained, but communication bandwidth and system performance are limited

Engineering Contradiction:
Improvecommunication bandwidthVSAvoidinterface architecture complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The memory bus is designed to serve multiple functions: it continues to connect the CPU to system memory while also enabling co-processors and I/O devices to interface directly with the memory system. This multi-functionality allows the same high-bandwidth bus to serve both traditional memory access and accelerated I/O operations, resolving the contradiction between improved speed and increased complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a memory interface controller or bridge that mediates between the memory bus and co-processors/I/O devices. This intermediary component manages the interface complexity, allowing devices to access the high-bandwidth memory bus without requiring the entire system architecture to become more complex. The mediator handles protocol conversion and access arbitration.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If co-processors operate at faster speeds, then processing capability is improved, but communication bottlenecks occur due to lower bandwidth I/O bus

Engineering Contradiction:
Improveprocessing capabilityVSAvoidcommunication delay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system architecture segments the communication paths by providing dedicated memory bus access to co-processors for data-intensive operations while maintaining separate I/O bus connections for control and configuration. This segmentation allows fast processing on the memory bus without being bottlenecked by the slower I/O bus, resolving the contradiction between processing capability and communication delay.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a new dimension to the communication architecture by introducing a second communication path (memory bus) that operates in parallel with the traditional I/O bus. Co-processors can utilize the high-bandwidth memory bus dimension for data transfer while the I/O bus handles control functions, eliminating the bottleneck and allowing processing capability to scale without proportional increases in communication delay.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Speed

If I/O devices are connected via main memory bus, then data transfer speed is enhanced, but bus contention and access conflict may increase

Engineering Contradiction:
Improvedata transfer speedVSAvoidbus access reliability
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The memory interface controller implements feedback mechanisms that monitor bus utilization and dynamically adjust access priorities and timing for different devices. When the memory bus becomes congested, the controller receives feedback about queue depths and transfer completion status, then adjusts arbitration decisions to prevent overload and maintain reliable operation, resolving the contradiction between enhanced speed and maintained reliability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system employs periodic bus arbitration schemes where access rights to the memory bus are granted in regular time slots or cycles to different devices. This periodic action prevents any single device from monopolizing the bus, ensures fair resource distribution, and maintains predictable performance characteristics even under heavy load, thereby preserving reliability while enabling high-speed transfers.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS10942682B2System and method of interfacing co-processors and input/output devices via a main memory system
Publication Date: 2021.03.09 RAMBUS INC
  • US10942682B2 patent drawing
  • US10942682B2 patent drawing
  • US10942682B2 patent drawing

AI summary

A system for interfacing with a co-processor or input/output device is disclosed. According to one embodiment, the system includes a computer processing unit, a memory module, a memory bus that connects the computer processing unit and the memory module and a co-processing unit or input/output device, wherein the memory bus also connects the co-processing unit or input/output device to the computer processing unit.