Pluggable Non-Volatile Memory Module for Server I/O Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computer systems face limitations in performance due to the combination of volatile dynamic random access memory (DRAM) and magnetic storage disks, which require multiple servers and higher operating costs to meet performance demands, as DRAM offers high performance but limited capacity and high power consumption, while magnetic storage provides large capacity but poor data access performance.
Innovation Solution
The use of non-volatile memory integrated circuits, such as NAND Flash, which offer disk-like capacity and persistence across power cycles, along with a data communication protocol that accesses these modules differently than DRAM, allowing for the creation of low power server systems with improved I/O performance and reduced server counts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If DRAM is used for memory storage, then high-performance random access is achieved, but capacity is limited and power consumption is high
Solution Approach 1:
The patent combines DRAM and non-volatile memory (NVM) into a single memory module, creating a hybrid memory system that leverages the high-speed access of DRAM and the low-power, high-capacity characteristics of NVM. This merging allows the system to achieve both fast access performance and reduced power consumption by strategically placing frequently accessed data in DRAM while storing less frequently accessed data in NVM.
Solution Approach 2:
The memory system is segmented into multiple regions with different characteristics - volatile DRAM regions for high-speed access and non-volatile memory regions for capacity and persistence. This segmentation allows the system to optimize performance by directing access patterns to appropriate memory regions based on data usage patterns.
2Quantity of substance
If magnetic storage disks are used for storage, then large capacity is achieved, but data access performance is poor
Solution Approach 1:
Non-volatile memory serves as an intermediary between DRAM and magnetic storage disks. It provides a buffer layer that captures data from magnetic disks and makes it accessible at faster speeds, effectively mediating the performance gap between slow magnetic storage and fast but limited DRAM.
3Productivity
If multiple servers are deployed to meet performance demands, then performance requirements are satisfied, but operating costs increase
Solution Approach 1:
The hybrid memory module serves multiple functions within a single server - it provides high-speed memory, large-capacity storage, and persistent storage capabilities. This multi-functionality allows a single server to replace what would traditionally require multiple specialized servers, reducing overall system complexity and operating costs.
4Speed
If DRAM is used for memory, then high-performance random access is achieved, but capacity is limited
Solution Approach 1:
The memory system uses a nested structure where non-volatile memory modules can be stacked or layered to expand capacity while maintaining the high-speed access interface. This nesting approach allows capacity to scale without sacrificing access performance, as the NVM layers remain accessible through the same high-speed interface as DRAM.
Data Source
AI summary
In one embodiment of the invention, a replaceable memory apparatus is disclosed. The replaceable memory apparatus includes a first rectangular multilayer printed circuit board having a first side and a second side opposite the first side; a first male pluggable electrical connector mounted to the first side near a first edge; a first female pluggable electrical connector mounted to the second side; and first non-volatile memory mounted to the first side and the second side. The first female pluggable electrical connector is coupled to the first male pluggable electrical connector to feed through first signals. The first non-volatile memory is coupled to the first female pluggable electrical connector and the first male pluggable electrical connector to receive the first signals.