Tiered Memory Object Management via Size-Based Routing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Tiered memory systems face inefficiencies in managing memory objects across different types of memory devices, such as emerging memory and flash-based memory, leading to unnecessary resource consumption and data access issues due to mismatched data sizes and access frequencies.

Innovation Solution

Implementing a method where memory objects are written to either emerging memory or flash-based memory based on threshold data sizes and access frequencies, using a key-value database system to manage and retrieve data, allowing seamless access across both memory types within a shared address space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Duration of action of stationary object

If memory objects are stored in flash-based memory, then data persistence is improved, but access speed deteriorates when only partial data is needed

Engineering Contradiction:
Improvedata persistenceVSAvoiddata access speed
Core Design Contradiction:
Duration of action of stationary objectVSSpeed

Solution Approach 1:

The patent segments memory objects into smaller portions that can be independently managed. When a memory object is stored in flash memory, the system can retrieve only the needed portions rather than the entire object, improving access speed while maintaining data persistence in flash memory.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical memory dimension by combining flash memory (for persistence) with emerging memory (for fast access). This multi-dimensional approach allows data to be stored in flash memory while enabling rapid access to specific portions through the emerging memory layer, resolving the contradiction between persistence and access speed.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Speed

If memory objects are stored in emerging memory, then access speed is improved, but data persistence deteriorates

Engineering Contradiction:
Improvedata access speedVSAvoiddata persistence
Core Design Contradiction:
SpeedVSDuration of action of stationary object

Solution Approach 1:

The system segments memory objects and stores them in flash memory for persistence, while maintaining metadata or indexes in emerging memory for fast access. This allows the system to achieve both fast access speeds and data persistence by separating the storage function (flash) from the access function (emerging memory).

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses a memory management system as an intermediary between the host and the tiered memory structure. This intermediary intelligently manages data placement and retrieval between flash memory and emerging memory, ensuring that persistence requirements are met while optimizing access speeds through selective data retrieval.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If full page access is required in flash memory, then data integrity is improved, but resource consumption increases when only small portions are needed

Engineering Contradiction:
Improvedata integrityVSAvoidresource consumption
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent enables segmentation of flash memory pages into smaller accessible units. Instead of requiring full page access, the system can retrieve only the specific portions of data that are needed, reducing energy consumption while maintaining data integrity through selective access to intact data segments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies partial action by retrieving only the necessary portions of data from flash memory rather than entire pages. This reduces resource consumption by avoiding the transfer and processing of unnecessary data, while still ensuring data integrity for the accessed portions through proper flash memory access protocols.

Inventive Principle:
Principle #16Partial or excessive action

4Device complexity

If memory objects are managed without size thresholds, then simplicity is improved, but efficiency deteriorates due to mismatched data sizes and access frequencies

Engineering Contradiction:
Improvemanagement simplicityVSAvoidmemory access efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent introduces size threshold parameters to govern memory object management decisions. By changing the parameter of data size classification, the system can automatically determine whether to store objects in flash memory or emerging memory based on their size, improving efficiency without significantly increasing complexity through automated threshold-based routing.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system applies local quality by treating different sizes of memory objects differently. Small objects below the threshold are managed with one strategy (stored in emerging memory for fast access), while larger objects above the threshold use another strategy (stored in flash memory for persistence). This localized differentiation improves overall efficiency while maintaining manageable complexity through clear size-based classification.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11861222B2Object management in tiered memory systems
Publication Date: 2024.01.02 MICRON TECHNOLOGY INC
  • US11861222B2 patent drawing
  • US11861222B2 patent drawing
  • US11861222B2 patent drawing

AI summary

Systems, apparatuses, and methods related to object management in tiered memory systems are discussed. An example method can include writing a memory object to a first memory device of a first type of memory medium. The example method can include determining that a size of the memory object meets or exceeds a threshold data size. The example method can include writing the memory object to a second memory device that comprises a second type of memory medium different than the first type. The first memory medium can be a non-volatile memory comprising phase-change memory or resistive random access memory (RAM) and the second memory medium can be NAND Flash or NOR Flash.