Hybrid Memory Data Processing for Accurate DRAM Prefetching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data processing methods inaccurately determine hot or cold memory pages in a hybrid memory system, leading to reduced accuracy in data prefetching and suboptimal performance.

Innovation Solution

A data processing method that identifies memory access instructions to determine if they correspond to a memory pointer and identify the accessed area in a storage class memory, prefetting data to DRAM when necessary, using a mapping table to distinguish between different processes and update addresses accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If access bit is used to identify hot memory pages in SCM, then data migration can be performed, but accuracy of data prefetching is reduced

Engineering Contradiction:
Improvedata migration capabilityVSAvoidaccuracy of data prefetching
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by prefetching data from SCM to DRAM before it is actually needed for processing. The system proactively identifies cold data in SCM and transfers it to DRAM in advance, so that when the data is needed, it is already in the faster memory, thereby improving both productivity and accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms by continuously monitoring memory access patterns and using this information to dynamically adjust data migration decisions. The system tracks access bits and uses this feedback to identify which data should be migrated from SCM to DRAM, improving the accuracy of prefetching decisions while maintaining productivity.

Inventive Principle:
Principle #23Feedback

2Ease of manufacture

If only access bit value is used to determine hot or cold memory pages, then data migration can be performed, but determining cold or hot memory pages becomes inaccurate

Engineering Contradiction:
Improvesimplicity of determination methodVSAvoidaccuracy of hot/cold page identification
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent adds another dimension to the determination process by not only considering access bit values but also examining the physical address ranges and mapping relationships between virtual and physical addresses. This multi-dimensional approach allows for more accurate identification of hot and cold pages while maintaining ease of implementation through structured mapping tables.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20250335366A1Data Processing Method and Apparatus, Chip, and Computer-Readable Storage Medium
Publication Date: 2025.10.30 HUAWEI TECH CO LTD
  • US20250335366A1 patent drawing
  • US20250335366A1 patent drawing
  • US20250335366A1 patent drawing

AI summary

A data processing method includes obtaining an instruction that carries a target virtual address and a target process identification; querying a mapping table based on the target virtual address and the target process identification, where the mapping table includes a correspondence between at least one virtual address, at least one process identification, and at least one physical address; and if a first physical address corresponding to the target virtual address and the target process identification exists in the mapping table, and the first physical address is included in a physical address range corresponding to the storage class memory, prefetching, to the dynamic random access memory, data of a target memory page corresponding to the first physical address.