Programmable Memory Module Access Modes for Latency-Capacity Tradeoffs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing memory systems face challenges in balancing memory latency, capacity, and cost, with current designs often prioritizing low latency at the expense of increased complexity and cost, while processes with lower data demands are impacted more by memory bandwidth than latency.
Innovation Solution
A memory module that can be programmed to operate in either a wide, low-latency mode or a narrower, higher-latency mode, reducing the number of connections and traces to support more modules per controller, thereby increasing system capacity and reducing cost per unit storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If memory systems are designed to minimize latency through wide data paths and parallel access, then memory latency is reduced, but device complexity and cost increase
Solution Approach 1:
The memory module enables dynamic switching between parallel access mode (wide data path, low latency) and serial access mode (narrow data path, reduced complexity) based on operational requirements. The programmable interface allows the system to adapt the data width and access mode dynamically, optimizing the balance between latency and complexity for different workloads.
Solution Approach 2:
The invention changes the operational parameters of the memory module by allowing programmable configuration of data width and access mode. By adjusting these parameters, the system can switch between wide parallel access ( minimizing latency) and narrow serial access (reducing connections and traces), thereby resolving the contradiction between latency and device complexity.
2Productivity
If memory systems use wide data paths and parallel access modes, then memory bandwidth is increased, but the number of connections and pin requirements increase
Solution Approach 1:
The memory module dynamically adjusts its operational mode based on bandwidth requirements. When high bandwidth is needed, it operates in parallel access mode with wide data paths. When bandwidth requirements are lower, it switches to serial access mode with fewer connections, thereby reducing pin requirements while maintaining adequate bandwidth for the application.
Solution Approach 2:
A single memory module design serves multiple functions by supporting both parallel and serial access modes. This multi-functionality allows the same hardware to adapt to different bandwidth requirements and connection constraints, eliminating the need for separate specialized modules for high-bandwidth and low-connectivity applications.
3Quantity of substance
If more memory modules are supported per controller, then system capacity is increased, but the number of pins and connections per module must be reduced
Solution Approach 1:
The memory module dynamically switches between parallel access mode (faster access speed) and serial access mode (fewer pins required) based on system configuration needs. This allows controllers to support more modules per controller by using serial mode when capacity is prioritized, while still offering parallel mode when access speed is critical, thereby resolving the contradiction between system capacity and access speed.
4Ease of manufacture
If memory systems are designed for high capacity with fewer connections, then cost per unit storage is reduced, but memory latency increases
Solution Approach 1:
The invention allows programmable configuration of the memory module to change operational parameters such as data width and access mode. Systems can be configured to use serial access mode with narrower data paths when cost per unit storage is the primary concern, accepting higher latency. Alternatively, parallel access mode can be enabled when low latency is critical, thereby resolving the contradiction between cost and latency through parameter adjustment.
Data Source
AI summary
A memory module can be programmed to deliver relatively wide, low-latency data in a first access mode, or to sacrifice some latency in return for a narrower data width, a narrower command width, or both, in a second access mode. The narrow, higher-latency mode requires fewer connections and traces. A controller can therefore support more modules, and thus increased system capacity. Programmable modules thus allow computer manufacturers to strike a desired balance between memory latency, capacity, and cost.