Implementation method, system and medium of hybrid memory system facing HBM

CN116450045BActive Publication Date: 2026-06-30SHANGHAI JIAOTONG UNIV

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
SHANGHAI JIAOTONG UNIV
Filing Date
2023-04-20
Publication Date
2026-06-30

AI Technical Summary

Technical Problem

Existing hybrid memory systems cannot maintain high performance in various working scenarios, have relatively coarse heat statistics, incur significant overhead from data migration, and fail to fully utilize the high bandwidth characteristics of HBM.

Method used

HBM is divided into c-HBM and m-HBM regions, data popularity is classified in detail, and data storage location is dynamically adjusted through popularity monitoring table and address translation table to optimize data migration and caching process.

Benefits of technology

It improves the access speed of hot data, reduces data migration overhead, lowers the overall access latency of the memory system, and significantly improves the overall access speed and capacity of the memory system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116450045B_ABST
    Figure CN116450045B_ABST
Patent Text Reader

Abstract

This invention provides a method, system, and medium for implementing a hybrid memory system based on HBM, including: initializing and establishing a hybrid memory controller, creating a heat monitoring table and an address translation table; the hybrid memory system receiving access requests; reallocating the storage location of data according to its heat, updating the address translation table, and redirecting access requests; migrating and caching data according to the address translation table, and completing the access request. This invention, taking advantage of the high bandwidth characteristics of HBM, divides HBM into c-HBM and m-HBM regions and performs detailed heat classification of data, significantly improving the access speed of hot data, reducing data migration overhead, and effectively reducing the overall access latency of the memory system. Compared to traditional memory systems that only add a small amount of HBM, this invention significantly improves the overall access speed of the memory system while providing more memory space, performing excellently under various workloads and showing good market prospects and application value.
Need to check novelty before this filing date? Find Prior Art