Main Memory Bus Access for Co-Processors Facing I/O Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current computer systems face communication bottlenecks due to the lower bandwidths of I/O buses, which restrict the performance of co-processors and I/O devices that operate at faster speeds, necessitating a method to interface these devices through the main memory system for enhanced I/O capabilities.
Innovation Solution
The integration of TeraDIMM technology, which connects co-processors and I/O devices directly to the main memory bus, utilizing a TeraDIMM architecture that includes non-volatile memory and DRAM, allowing these devices to operate at higher bandwidths and bypassing traditional I/O bus limitations, along with a discovery boot loader and driver for initialization and configuration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If co-processors and I/O devices interface via the I/O bus, then device compatibility and system simplicity are maintained, but data bandwidth and communication speed are limited
Solution Approach 1:
The patent applies universality by enabling the main memory bus to serve dual purposes: its traditional function for CPU-memory communication and a new function for interfacing co-processors and I/O devices. This multi-functional use of the high-bandwidth main memory bus eliminates the need for separate I/O buses, thereby increasing data bandwidth for co-processors and I/O devices while maintaining interface simplicity through a unified bus architecture.
2Productivity
If co-processors operate at faster speeds, then processing performance is improved, but communication bottlenecks occur due to lower I/O bus bandwidth
Solution Approach 1:
The patent merges the I/O bus function into the main memory bus system, allowing co-processors and I/O devices to communicate directly through the high-bandwidth main memory bus. This consolidation eliminates the communication bottleneck created by separate low-bandwidth I/O buses, enabling faster processing performance without time loss due to communication constraints.
3Productivity
If the main memory bus is used for I/O operations, then I/O performance is enhanced, but bus contention and memory system complexity increase
Solution Approach 1:
The patent applies segmentation by introducing dedicated interface circuitry within the memory controller that segments and manages different types of bus traffic. This interface circuitry handles memory operations and co-processor/I/O device operations separately, allowing the main memory bus to serve multiple functions simultaneously without excessive contention, thereby enhancing I/O performance while controlling memory system complexity.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system for interfacing with a co-processor or input/output device is disclosed. According to one embodiment, the system includes a computer processing unit, a memory module, a memory bus that connects the computer processing unit and the memory module, and a co-processing unit or input/output device, wherein the memory bus also connects the co¬ processing unit or input/output device to the computer processing unit.