Scratchpad Memory Management via Dirty Page Exclusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In modern data centers, peripheral devices increasingly handle compute and data throughput, leading to inefficient memory management on servers/host systems, where conventional memory management indiscriminately swaps entire memory footprints, including temporary and non-essential data, resulting in resource inefficiencies.

Innovation Solution

Implementing scratchpad memory management techniques that differentiate between regular and scratchpad memory, where scratchpad memory is identified and excluded from swap-in/out sequences, using enhanced page request interfaces and memory management units to mark pages as dirty only when necessary, optimizing resource usage and performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If conventional memory management swaps entire memory footprint for dirty pages, then memory access consistency is maintained, but resource efficiency deteriorates due to unnecessary swapping of temporary data

Engineering Contradiction:
Improvememory swap overheadVSAvoidmemory management simplicity
Core Design Contradiction:
Loss of energyVSEase of operation

Solution Approach 1:

The patent segments memory into two distinct categories: scratchpad memory and regular memory. This segmentation allows the system to apply different management policies to each type. Scratchpad memory is identified through specific attributes in page requests, enabling the MMU to selectively exclude these pages from dirty marking and swap operations, thereby reducing unnecessary memory swaps while maintaining proper management of regular memory pages.

Inventive Principle:
Principle #1Segmentation

2Productivity

If scratchpad memory is excluded from dirty marking, then resource efficiency improves by reducing unnecessary swaps, but memory management complexity increases

Engineering Contradiction:
Improvesystem performanceVSAvoidmemory management unit complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies local quality by implementing different management characteristics for different memory regions. The MMU examines attributes in page requests to determine whether a page belongs to scratchpad memory or regular memory, then applies appropriate management rules locally to each page type. This allows the system to optimize performance for scratchpad memory while maintaining standard management for regular memory, with the complexity localized to the attribute checking logic in the MMU.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10922226B1Scratchpad memory management in a computing system
Publication Date: 2021.02.16 XILINX INC
  • US10922226B1 patent drawing
  • US10922226B1 patent drawing
  • US10922226B1 patent drawing

AI summary

An example computing system includes a memory, a peripheral device configured to send a page request for accessing the memory, the page request indicating whether the page request is for regular memory or scratchpad memory, and a processor having a memory management unit (MMU). The MMU is configured to receive the page request and prevent memory pages from being marked dirty in response to the page request indicating scratchpad memory.