6 results about "NVDIMM" patented technology

The present disclosure includes apparatuses and methods related to a non-deterministic memory protocol. An example apparatus can perform operations on the memory device based on commands received from a host according to a protocol, wherein the protocol includes non-deterministic timing of the operations. The memory device can be a non-volatile dual in-line memory module (NVDIMM) device.

The invention discloses a dynamic hierarchical storage method and system based on a lake and warehouse integrated architecture, and relates to the technical field of dynamic hierarchical storage, and the dynamic hierarchical storage system comprises a data management layer which is based on a Catalog, Database and Table three-layer logic structure of Apache Dores; the physical storage layer comprises a cache layer, a middle buffer layer and a persistence layer; the cache layer is composed of an NVRAM / NVDIMM (Non-Volatile Random Access Memory / Non-Volatile Delivery Infrastructure Module) and is carried on a BE / FE node of Dores; the middle buffer layer is composed of a Burst Buffer system constructed by an NVMe SSD (Non-Volatile Memory Express Solid State Disk); the persistence layer comprises an SSD (Solid State Disk) array and a disk array and is used for low-cost and high-capacity data retention; and the calculation engine layer is used for integrating Satunnel, Spark and Flink. The technical problem to be solved by the invention is to provide the dynamic hierarchical storage method and system based on the lake and warehouse integrated architecture, and hierarchical storage and automatic migration of lake and warehouse data are realized through definition of hotspot data, label definition of structured data and unstructured data and data attributes by fusing common big data calculation engines such as seatunnel, Flink and Spark.

The application discloses a kind of dynamic hierarchical storage method and system based on lake warehouse integrated architecture, it is related to dynamic hierarchical storage technical field, including: data management layer: based on Apache Doris's Catalog, Database and Table three-layer logical structure;Physical storage layer: including cache layer, intermediate buffer layer and persistent layer;The cache layer is made of NVRAM / NVDIMM, is carried on the BE / FE node of Doris;The intermediate buffer layer is made of the Burst Buffer system of NVMe SSD construction;The persistent layer includes SSD array and disk array, for low-cost large-capacity data retention;Computing engine layer: integration Seatunnel, Spark and Flink.The technical problem to be solved in the application is to provide a kind of dynamic hierarchical storage method and system based on lake warehouse integrated architecture, fusion big data commonly used computing engine such as seatunnel, Flink, Spark, through the definition of hot spot data, the label definition of structured data and unstructured data, and the hierarchical storage and automatic migration of lake warehouse data are realized by data attribute.

A pseudo main memory system. The system includes a memory adapter circuit for performing memory augmentation using compression, deduplication, and / or error correction. The memory adapter circuit is connected to a memory, and employs the memory augmentation methods to increase the effective storage capacity of the memory. The memory adapter circuit is also connected to a memory bus and implements an NVDIMM-F or modified NVDIMM-F interface for connecting to the memory bus.

A method for operating a non-volatile dual in-line memory module (NVDIMM) is disclosed. The NVDIMM includes a dynamic random access memory (DRAM) and a non-volatile memory (NVM) device, the DRAM including a first input / output (I / O) port and a second I / O port, and the second I / O port connected to the NVM device. The method includes receiving an externally provided command signal representing a read / write command and a transfer mode, driving a multiplexer according to the transfer mode of the command signal to select at least one of the first I / O port and the second I / O port, and reading or writing data in at least one of the DRAM and the NVM device according to the read / write command of the command signal using the at least one of the first I / O port and the second I / O port selected by driving the multiplexer.

The invention discloses a persistent memory crash recovery method and system combining an operation queue and collaborative synchronization. The persistent memory crash recovery method and system are suitable for an Optan DCPMM or NVDIMM-based file system. According to the method, a file system is divided into a newest view and a consistent view, metadata packaging and scheduling are carried out by adopting an operation queue bound according to files, and asynchronous persistence is completed through foreground and background threads. The system dynamically monitors a plurality of indexes based on the FoF window, regulates and controls the check point period and the persistent batch of the operation nodes according to the indexes, and improves the data security in a power-off scene. Write amplification is reduced by introducing a lightweight index and adding a write strategy, and resource allocation and release are isolated through atomic operation. After the system crashes and is restarted, the consistent state of the file system is quickly rebuilt with high concurrency through a verification mechanism, snapshot replay and index recovery. The scheme has the advantages of low write amplification, high recovery efficiency, extensible architecture and the like.