Memory Controller Allocating Hot and Cold Pages by Access Interval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In heterogeneous memory systems, there is a need to accurately differentiate between hot and cold data to optimize storage in high-speed and low-speed memory devices, as existing methods fail to efficiently manage data based on access frequency, leading to suboptimal performance.

Innovation Solution

A memory controller that determines the attribute of each page as hot or cold based on access intervals and allocates data storage between high-speed and low-speed memory devices accordingly, using an attribute determiner, page analyzer, and memory allocator to optimize data placement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If data is stored in high-speed memory devices, then data retrieval speed is improved, but storage capacity is reduced

Engineering Contradiction:
Improvedata retrieval speedVSAvoidstorage capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The memory system is segmented into multiple memory devices with different performance characteristics (high-speed and low-speed memory devices). The attribute determiner divides data into hot and cold pages based on access intervals, and the memory allocator assigns hot pages to high-speed memory and cold pages to low-speed memory, achieving segmentation of both data and storage resources.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different memory devices are assigned different qualities based on data characteristics. High-speed memory devices store hot data (frequently accessed) while low-speed memory devices store cold data (less frequently accessed). This local quality assignment optimizes the system by matching data access patterns with appropriate memory performance levels.

Inventive Principle:
Principle #3Local quality

2Productivity

If existing data management methods are used, then device complexity is reduced, but system performance is suboptimal

Engineering Contradiction:
Improvesystem performanceVSAvoiddata management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The memory controller autonomously performs data classification and allocation without external intervention. The attribute determiner automatically calculates access intervals and identifies hot/cold pages, while the memory allocator automatically distributes data between memory devices. This self-service mechanism improves system performance while keeping the interface simple.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors data access patterns and uses this feedback to dynamically determine hot and cold page attributes. The access interval information serves as feedback that drives the allocation decisions, allowing the system to adapt to changing data access patterns and optimize performance continuously.

Inventive Principle:
Principle #23Feedback

3Quantity of substance

If all data is stored in low-speed memory devices, then storage capacity is maximized, but data retrieval speed is reduced

Engineering Contradiction:
Improvestorage capacityVSAvoiddata retrieval speed
Core Design Contradiction:
Quantity of substanceVSSpeed

Solution Approach 1:

The system dynamically adjusts data allocation based on real-time access patterns. The attribute determiner continuously evaluates access intervals to identify hot and cold pages, and the memory allocator dynamically redistributes data between high-speed and low-speed memory devices as access patterns change, optimizing the balance between capacity and speed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary classification of data into hot and cold pages before allocation. By pre-determining data attributes based on access intervals, the memory allocator can proactively place frequently accessed data in high-speed memory and less frequently accessed data in low-speed memory, avoiding the need for runtime migration and optimizing performance.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12086437B2Memory controller and memory system for allocating memory based on the ratio of hot/cold pages
Publication Date: 2024.09.10 SK HYNIX INC
  • US12086437B2 patent drawing
  • US12086437B2 patent drawing
  • US12086437B2 patent drawing

AI summary

The present technology relates to an electronic device. According to the present technology, a memory controller may include an attribute determiner configured to determine an attribute of each of a plurality of pages included in a first external device to indicate one of a hot page and a cold page, based on an access interval which is an interval from a time at which data is stored in each of the pages to a time at which access to the data is requested, a page analyzer configured to determine a ratio of hot pages having a hot page attribute to the plurality of pages, and a memory allocator configured to control one of the first external device and the second external device to store therein externally provided data based on the ratio of hot pages.