Memory Bus Interface Arbitration for Scalable Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional DRAM interface designs lack scalability, autonomy, and efficiency, leading to bottlenecks in memory performance, particularly in high-performance processor systems, due to their master-slave architecture and limited ability to handle multiple memory devices and high data rates.

Innovation Solution

The implementation of a memory bus interface that enables point-to-point or broadcast communications between memory devices and controllers using bus packets, allowing for autonomous operations, such as self-refresh and power management, and concurrent memory access requests, thereby reducing timing constraints and increasing bandwidth utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional DRAM interface designs with separate address and data lines and separate command lines are used, then communication between memory controller and memory devices can be established, but scalability is limited and device complexity increases

Engineering Contradiction:
ImprovescalabilityVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines separate address lines, data lines, and command lines into a unified memory bus interface that uses packet-based communication. This merging reduces the number of separate signal paths and simplifies the interface architecture while maintaining full functionality for address transmission, data transfer, and command execution.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The memory bus interface is designed as a universal communication channel that can handle multiple types of transactions (reads, writes, commands) through a single standardized packet format. This multi-functional interface can accommodate different memory devices and controllers, enhancing scalability without requiring separate dedicated paths for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If memory devices operate strictly in accordance with commands from memory controllers with no independent logic, then timing control is simplified, but autonomy is reduced and efficiency decreases

Engineering Contradiction:
Improvememory access efficiencyVSAvoiddevice autonomy
Core Design Contradiction:
ProductivityVSExtent of automation

Solution Approach 1:

The patent implements hint-based mechanisms where the memory controller can provide advance information about upcoming memory access patterns. The memory device uses this hint information to proactively prepare for future operations, such as pre-fetching data or preparing internal structures, thereby improving efficiency without requiring full autonomy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The memory device incorporates autonomous logic that enables it to independently process certain operations and make decisions based on the received commands and hint information. This self-service capability allows the device to optimize its internal operations, such as managing open rows and buffers, without constant controller intervention, thereby improving overall system efficiency.

Inventive Principle:
Principle #25Self-service

3Productivity

If multiple memory controllers access multiple memory devices simultaneously, then bandwidth utilization increases, but timing constraints become more complex and bottlenecks occur

Engineering Contradiction:
Improvebandwidth utilizationVSAvoidtiming constraints
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent introduces a packet-based communication protocol as an intermediary layer between multiple controllers and devices. This standardized packet format acts as a mediator that simplifies the interaction complexity, allowing multiple controllers to access multiple devices simultaneously through a unified interface without requiring complex timing coordination for each individual transaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8938589B2Interface methods and apparatus for memory devices using arbitration
Publication Date: 2015.01.20 SK HYNIX INC
  • US8938589B2 patent drawing
  • US8938589B2 patent drawing
  • US8938589B2 patent drawing

AI summary

A disclosed example apparatus includes an interface (702, 726) to receive a request to access a memory (602a) of a memory module (600) and a data store status monitor (730) to determine a status of the memory. The example apparatus also includes a message output subsystem (732) to, when the memory is busy, respond to the request with a negative acknowledgement indicating that the request to access the memory is not grantable.