Heterogeneous Memory Management via Metadata Service

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computing devices are limited by the types and amounts of memory installed at manufacture, requiring physical upgrades to access new or additional memory, which is costly and time-consuming, especially for newer memory technologies with varying attributes like persistence and speed.

Innovation Solution

Implementing heterogeneous memory management and services that allow dynamic allocation of load-store memory segments with specific attributes over a high-speed memory access fabric, enabling computing devices to access needed memory on an as-needed basis without physical upgrades.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If physical upgrades are performed to add new memory types or capacity, then memory capabilities are improved, but device downtime and upgrade complexity increase

Engineering Contradiction:
Improvememory capacityVSAvoiddevice downtime
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The system segments memory resources into discrete memory segments that can be independently managed, allocated, and accessed. Each computing device can have its memory requirements met by allocating specific segments from available pools without requiring physical reconfiguration of the entire system, enabling dynamic upgrades without downtime.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A metadata service acts as an intermediary between computing devices and physical memory resources. This service manages memory allocation, tracks available capacity, and handles requests dynamically, allowing memory upgrades to occur without taking devices offline while maintaining seamless access through the intermediary layer.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If physical upgrades are performed to access new memory technologies, then memory technology capabilities are improved, but upgrade cost and time increase

Engineering Contradiction:
Improvememory technology compatibilityVSAvoidupgrade ease
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The system creates a universal memory access interface that can work with multiple memory technologies and types through a common metadata service and allocation mechanism. Different memory technologies (DRAM, persistent memory, storage-class memory) can be integrated into the same pool and accessed uniformly by computing devices without requiring device-specific modifications or complex upgrade procedures.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The memory allocation system is dynamic rather than static, allowing memory assignments to be changed at runtime based on demand. Computing devices can dynamically access different memory types and capacities as needed, and the system can adapt to new memory technologies being added to the pool without requiring physical reconfiguration or taking systems offline for upgrades.

Inventive Principle:
Principle #15Dynamics

3Speed

If memory is allocated dynamically over high-speed fabric, then memory accessibility is improved, but system complexity increases

Engineering Contradiction:
Improvememory access speedVSAvoidmemory management complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The metadata service implements self-service functionality by automatically tracking memory segment availability, managing allocations, and handling deallocations without requiring complex external control systems. The service maintains metadata about each memory segment and can autonomously respond to allocation requests, reducing the overall system complexity despite the dynamic nature of memory access over high-speed fabric.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11868772B2Heterogeneous memory management and services
Publication Date: 2024.01.09 RED HAT INC
  • US11868772B2 patent drawing
  • US11868772B2 patent drawing
  • US11868772B2 patent drawing

AI summary

Heterogeneous memory management and services. A memory metadata service obtains memory configuration information that identifies one or more sharable load-store memory segments available on each of a plurality of computing devices. The memory metadata service generates a memory metadata repository that comprises memory metadata that identifies, for each computing device of the plurality of computing devices, the one or more sharable load-store memory segments available on the computing device and, for each sharable load-store memory segment, a memory size of the sharable load-store memory segment and at least one memory attribute. The memory metadata service receives, from a first requesting computing device, a first memory allocation request that requests a first quantity of load-store memory. The memory metadata service sends, to the first requesting computing device, memory allocation information that identifies a first sharable load-store memory segment based on the memory metadata repository.