Heterogeneous Memory Controller Using Border Index Values
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing systems struggle to efficiently manage memory operations between high capacity DIMMs and high bandwidth memory (HBM) devices, often leading to suboptimal performance due to mismatched bandwidth and capacity requirements.
Innovation Solution
A data processing system and method that utilize a heterogeneous memory system comprising a memory module and HBM, where the HBM includes a processing-in-memory (PIM) circuit. The system employs a memory controller to detect data arrays based on border index values, determining whether the data is stored in the memory module or HBM, and generates appropriate command sets to optimize memory operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If high capacity DIMM is used for memory operations, then memory capacity is improved, but bandwidth is reduced
Solution Approach 1:
The patent segments the memory system into two distinct parts: DIMM for high capacity storage and HBM for high bandwidth operations. The memory controller divides memory address spaces into first and second address spaces, directing different data arrays to different memory types based on operational requirements, thus resolving the contradiction between capacity and bandwidth
Solution Approach 2:
The system dynamically selects which memory type to use based on real-time operational needs. The memory controller determines whether to access DIMM or HBM by evaluating data array characteristics and operational requirements, allowing the system to adapt between capacity-oriented and bandwidth-oriented modes as needed
2Speed
If multiple DIMMs are used to support high bandwidth operations, then bandwidth is improved, but memory capacity becomes excessive
Solution Approach 1:
The patent segments the memory system into two distinct parts: DIMM for high capacity storage and HBM for high bandwidth operations. The memory controller divides memory address spaces into first and second address spaces, directing different data arrays to different memory types based on operational requirements, thus resolving the contradiction between capacity and bandwidth
Solution Approach 2:
The memory controller acts as an intermediary that intelligently routes memory requests to the appropriate memory type. By implementing border index values and address space segmentation, the controller ensures that high bandwidth operations utilize HBM without requiring excessive DIMM capacity, optimizing resource utilization
3Quantity of substance
If multiple HBM components are used to support high capacity operations, then memory capacity is improved, but bandwidth becomes excessive and execution speed is reduced
Solution Approach 1:
The patent segments the memory system into two distinct parts: DIMM for high capacity storage and HBM for high bandwidth operations. The memory controller divides memory address spaces into first and second address spaces, directing different data arrays to different memory types based on operational requirements, thus resolving the contradiction between capacity and bandwidth
Solution Approach 2:
The system dynamically selects which memory type to use based on real-time operational needs. The memory controller determines whether to access DIMM or HBM by evaluating data array characteristics and operational requirements, allowing the system to adapt between capacity-oriented and bandwidth-oriented modes as needed
4Adaptability or versatility
If heterogeneous memory system is implemented, then both capacity and bandwidth are supported, but system complexity increases
Solution Approach 1:
The memory controller is designed with multi-functionality to manage both DIMM and HBM through unified interfaces. By implementing border index values and address space segmentation mechanisms within the controller, the system achieves heterogeneous memory management without requiring separate control logic for each memory type, thus reducing overall system complexity
Solution Approach 2:
The memory controller acts as an intermediary that intelligently routes memory requests to the appropriate memory type. By implementing border index values and address space segmentation, the controller ensures that high bandwidth operations utilize HBM without requiring excessive DIMM capacity, optimizing resource utilization
Data Source
AI summary
A data processing system and method for accessing a heterogeneous memory system including a processing unit are provided. The heterogeneous memory system includes a memory module and high bandwidth memory (HBM) including a processing-in-memory (PIM) circuit combined with a memory controller. The memory controller is configured to detect a data array required for an arithmetic operation from a memory module or the HBM by using a border index value when the arithmetic operation is performed by the PIM circuit of the HBM and generate a memory module command set and an HBM command set using physical address spaces respectively designated in the memory module and the HBM.