Pooled Memory Device Control with Dynamic Power Cutoff

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Computing systems face challenges with limited storage space as data generation increases, necessitating the use of memory expanders or pooled memory devices to manage high-speed data communication and high-density workload operations, particularly in big data and machine learning applications.

Innovation Solution

A pooled memory device system utilizing a controller to manage plural memory devices, allowing dynamic allocation and power management of memory resources, including data migration and power cutoff for unused memory, and supporting interfaces like Compute Express Link (CXL) for efficient data communication and resource expansion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If memory expander or pooled memory device is added to increase storage capacity, then data storage space is improved, but device complexity increases

Engineering Contradiction:
Improvestorage capacityVSAvoiddevice complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The memory system is divided into multiple memory devices (first memory device, second memory device, etc.) that can be independently controlled. Each memory device has its own power supply and can be individually managed by the controller, allowing the system to segment storage capacity while maintaining manageable complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller serves multiple functions: it manages memory allocation, controls power supply to individual memory devices, handles data migration between devices, and interfaces with the host system. This multi-functionality reduces the need for separate dedicated components for each function, thereby managing device complexity while providing comprehensive memory management.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If all memory devices are kept operational to ensure availability, then reliability is improved, but power consumption increases

Engineering Contradiction:
Improvememory availabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The power supply state of memory devices is dynamically adjusted based on actual usage requirements. The controller monitors memory access patterns and workload demands, then dynamically powers up or powers down individual memory devices accordingly. This dynamic power management ensures reliability by keeping needed memory devices operational while reducing overall power consumption by shutting down unused devices.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system automatically manages its own power consumption without external intervention. The controller continuously monitors memory usage patterns and autonomously decides which memory devices to power up or down based on current workload requirements, eliminating the need for manual power management while optimizing the balance between reliability and energy efficiency.

Inventive Principle:
Principle #25Self-service

3Reliability

If data is replicated across multiple memory devices for redundancy, then reliability is improved, but data migration time increases

Engineering Contradiction:
Improvedata redundancyVSAvoiddata migration time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

Data is preliminarily replicated to multiple memory devices during normal operation, establishing redundant copies before failures occur. The controller proactively distributes data across available memory devices so that when a failure occurs or reallocation is needed, data can be quickly accessed from existing replicas rather than requiring time-consuming re replication operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces manual or sequential data migration processes with automated parallel data replication mechanisms. Multiple data migration operations occur simultaneously across different memory devices using parallel processing, substituting sequential mechanical data copying with concurrent data replication, thereby reducing total migration time while maintaining redundancy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20250208780A1Apparatus and method for controlling a pooled memory device or a memory expander
Publication Date: 2025.06.26 SK HYNIX INC
  • US20250208780A1 patent drawing
  • US20250208780A1 patent drawing
  • US20250208780A1 patent drawing

AI summary

A pooled memory device includes plural memory devices and a controller. The plural memory devices include a first memory and a second memory with at least one power supply configured to control power supplied to each of the plural memory devices. The controller is coupled to an interconnect device which is configured to provide the plural memory devices to at least one external device as a logical device. The controller is configured to track available storage capacities of the first memory and the second memory and cut off power supplied to an unused memory among the first memory and the second memory.