Stacked DIMM Interface Circuit Eliminates Bus Turnaround Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Memory systems face limitations in command scheduling and data transfer bandwidth due to inter-device and intra-device command scheduling constraints, leading to latency and incompatibility issues with existing memory controllers, particularly in high-speed systems like FBDIMMs.

Innovation Solution

An interface circuit that combines data bursts from multiple memory devices into a contiguous burst, using emulation and command translation logic to eliminate clock-to-data phase delays and re-drive data bursts, allowing seamless switching without idle bus cycles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If FBDIMM approach is used to assemble data from multiple memory devices, then data assembly capability is achieved, but significant latency is introduced

Engineering Contradiction:
Improvedata assembly capabilityVSAvoidlatency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-assembling data bursts from multiple memory devices into contiguous bursts at the memory device level before transmission to the controller. The interface circuit combines data bursts from multiple devices in advance, eliminating the need for the controller to perform time-consuming assembly operations after data retrieval, thus reducing overall system latency while maintaining data assembly capability

Inventive Principle:
Principle #10Preliminary action

2Productivity

If FBDIMM-type memory devices are implemented, then enhanced memory performance is achieved, but backward compatibility with existing memory controllers is lost

Engineering Contradiction:
Improvememory performanceVSAvoidbackward compatibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent introduces an interface circuit as an intermediary between the memory devices and the existing memory controller. This interface circuit handles the complex data assembly and timing operations, allowing the memory devices to operate in high-performance FBDIMM mode while presenting a standard interface to the controller. This mediator enables enhanced memory performance without sacrificing backward compatibility, as the controller sees only standard memory operations

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If data bursts from multiple memory devices are combined into contiguous bursts, then bandwidth is increased, but interface circuit complexity is increased

Engineering Contradiction:
ImprovebandwidthVSAvoidinterface circuit complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the memory system into distinct functional components: individual memory devices that generate data bursts, an interface circuit that combines these bursts, and a controller that issues commands. By segmenting the data assembly function into a dedicated interface circuit, the system achieves contiguous data bursts and increased bandwidth, while the complexity is localized to the interface circuit rather than distributed throughout the entire memory system

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8386722B1Stacked DIMM memory interface
Publication Date: 2013.02.26 GOOGLE LLC
  • US8386722B1 patent drawing
  • US8386722B1 patent drawing
  • US8386722B1 patent drawing

AI summary

One embodiment of the present invention sets forth an interface circuit configured to combine time staggered data bursts returned by multiple memory devices into a larger contiguous data burst. As a result, an accurate timing reference for data transmission that retains the use of data (DQ) and data strobe (DQS) signals in an infrastructure-compatible system while eliminating the cost of the idle cycles required for data bus turnarounds to switch from reading from one memory device to reading from another memory device, or from writing to one memory device to writing to another memory device may be obtained, thereby increasing memory system bandwidth relative to the prior art approaches.