Heterogeneous Memory System with Non-Volatile Cache
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional computer systems face challenges with DRAM-based memory systems, which consume power even when idle and have limited memory density, leading to increased cost and volume, making it difficult to enhance storage capacity without affecting the form factor, especially in mobile devices.
Innovation Solution
A memory system comprising plural heterogeneous memories with different latencies, where a high-capacity non-volatile memory operates as a cache for a high-speed memory, and both are controlled by dedicated controllers to optimize data storage and retrieval, allowing for increased capacity without compromising the system's form factor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If DRAM-based memory is used to increase storage capacity, then memory capacity is improved, but volume and cost increase
Solution Approach 1:
The patent combines multiple types of memory devices (volatile memory and non-volatile memory) into a single memory system. The volatile memory (first memory device) and non-volatile memory (second memory device) are merged to work together as an integrated memory system, allowing the system to achieve high capacity without proportionally increasing volume.
Solution Approach 2:
The patent implements a nested memory hierarchy where the non-volatile memory (second memory device) serves as an extended cache or storage layer that is logically nested within the memory system. The volatile memory acts as a faster layer that is nested within the overall system, creating a multi-level nested structure that optimizes both speed and capacity.
2Quantity of substance
If multiple DIMMs are used to increase memory capacity, then storage capacity is improved, but cost and volume increase
Solution Approach 1:
The patent merges different memory technologies (DRAM and non-volatile memory) into a unified memory system that leverages the strengths of each type. This combination allows the system to achieve high capacity without needing multiple expensive DIMM modules, thereby reducing overall system cost.
3Speed
If DRAM-based memory is used, then speed is improved, but power consumption increases
Solution Approach 1:
The patent implements a dynamic memory system that can adaptively switch between volatile and non-volatile memory based on access patterns and power requirements. The system dynamically manages data placement between the first memory device (volatile) and second memory device (non-volatile), optimizing the balance between speed and power consumption.
Solution Approach 2:
The patent employs periodic refresh operations for the volatile memory's capacitors, rather than continuous operation. The non-volatile memory maintains data without power, and the system periodically transfers data between memory types based on usage patterns, reducing overall power consumption while maintaining performance.
4Speed
If DRAM-based memory is used, then speed is improved, but data loss occurs upon power removal
Solution Approach 1:
The patent introduces non-volatile memory as an intermediary layer between the volatile memory and permanent storage. This intermediary maintains data persistence while allowing the volatile memory to operate at high speeds. The controller manages data transfer between these layers, ensuring data is preserved in the non-volatile memory when power is removed.
Data Source
AI summary
A memory system includes: a first memory device including a first memory and a first memory controller suitable for controlling the first memory to store data; a second memory device including a second memory and a second memory controller suitable for controlling the second memory to store data; and a processor suitable for executing an operating system (OS) and an application, and accessing data storage memory through the first and second memory devices.