Memory Controller Page Table Walk Offload

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory management methods using virtual memory, such as multi-level paging, face challenges in system performance due to the large size of page tables and the inefficiency of page table walks, which can lead to latency and processor compatibility issues, especially when processing data-intensive applications.

Innovation Solution

A memory device with a controller that offloads page management functions and performs page table walks, allowing the processing unit to focus on other tasks, thereby reducing data movement and increasing energy efficiency, and using near-memory processing to handle data closer to the memory, enhancing throughput and scalability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multi-level paging is used to reduce page table size, then physical memory consumption is reduced, but system performance deteriorates due to multiple memory accesses required for page table walks

Engineering Contradiction:
Improvephysical memory consumptionVSAvoidsystem performance
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent extracts the page table walk function from the processing unit and relocates it to the memory device controller. This allows the processing unit to focus on data processing while the controller handles address translation, resolving the contradiction by separating the functions that were previously coupled in the processing unit.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary mechanism where the memory device controller performs page table walks independently. This intermediary approach allows address translation to occur without burdening the processing unit, maintaining both reduced memory consumption and improved system performance.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If page table walks are performed by the processing unit, then address translation is completed, but data movement increases and energy efficiency decreases

Engineering Contradiction:
Improveaddress translation completionVSAvoidenergy efficiency
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent extracts the page table walk operation from the processing unit and assigns it to the memory device controller. This extraction eliminates unnecessary data movement between the processing unit and memory system, reducing energy consumption while maintaining reliable address translation.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The memory device controller performs page table walks using its own resources and capabilities, serving itself rather than relying on the processing unit. This self-service approach reduces energy loss by performing address translation locally without requiring additional data movement.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If the processing unit handles all page management functions, then comprehensive control is achieved, but system throughput and scalability are limited

Engineering Contradiction:
Improvecontrol comprehensivenessVSAvoidsystem throughput
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent segments the page management functions by dividing responsibilities between the processing unit and the memory device controller. The processing unit maintains comprehensive control through configuration and management, while the controller handles execution of page table walks, enabling parallel operation and improved throughput.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The memory device controller is designed with multi-functionality, handling both memory access operations and page table walk operations. This universal approach allows the system to achieve higher throughput and scalability without sacrificing comprehensive control over memory management.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250013578A1Memory management method based on virtual memory and apparatus using the same
Publication Date: 2025.01.09 SAMSUNG ELECTRONICS CO LTD
  • US20250013578A1 patent drawing
  • US20250013578A1 patent drawing
  • US20250013578A1 patent drawing

AI summary

A memory device includes a memory and a controller. The memory is configured to store data. The controller is configured to receive first address data based on multi-level paging from a processing unit, convert the first address data into second address data by performing on at least one of levels a page table walk of the multi-level paging, and access the memory using the second address data.