Unlock instant, AI-driven research and patent intelligence for your innovation.

High performance unstructured database service based on non-volatile storage system

A non-volatile storage, unstructured technology, applied in the field of information to ensure persistence, data integrity, and high availability

Active Publication Date: 2020-11-20
上海孚典智能科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of application involves the storage, management, indexing and query of massive unstructured data information, which poses new challenges to the performance of the database system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High performance unstructured database service based on non-volatile storage system
  • High performance unstructured database service based on non-volatile storage system
  • High performance unstructured database service based on non-volatile storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The present invention is realized by two parts of hardware and software, and the hardware part is realized by NVRAM equipment, and the current Optane NVRAM system of Intel Corporation can be adopted. The system connects with x86server through PCIe interface, and its hardware device driver supports mainstream Linux and Windows systems. Therefore, it can be easily realized on the current mainstream data platform.

[0033] The software system targets mainstream NoSQL DB systems, including HBase, Cassandra, and MongoDB. Provide memory data management driver for the above data block system (NVRAM driver, see attached figure 2 ) to replace its original memory data management module (see attached Image 6 ). By introducing the management and operation capabilities of NVRAM as a data buffer layer, the data buffer of the docking memory is replaced by the file system with NVRAM, which improves the I / O efficiency and accelerates reading and writing. For the specific definitio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Techniques are provided for performance acceleration of an unstructured database (NoSQL DB) by a non-volatile storage system. Aiming at the requirements of NoSQL database systems widely applied to various data acquisition and analysis systems on performance improvement at present, a nonvolatile storage system is introduced, and a file cache system of NoSQL DB is accelerated (through nonvolatile storage), so that the data read-write efficiency and speed are improved, and the data security is guaranteed. The method comprises the following two innovations: 1, an NVRAM (Non-Volatile Random AccessMemory) is applied on an interactive read-write cache of a database and a file system; and 2, effective utilization of NVRAM resources is realized through a multi-copy data scheduling algorithm. The invention has good applicability in the aspect of improving the efficiency of a cloud computing and Internet of Things edge computing data analysis system.

Description

technical field [0001] The present invention belongs to the field of information technology, and in particular relates to a data management system used to support cloud computing and edge computing, using non-volatile storage (NVRAM) technology to bring I / O to an unstructured data management system (NoSQL DB) Performance improvements. Background technique [0002] In recent years, with the rapid development of cloud computing and edge computing technology and the continuous landing of related applications, intelligent data applications based on data collection, analysis and processing have begun to increase rapidly. This type of application involves the storage, management, indexing and query of massive unstructured data information, which poses new challenges to the performance of database systems. Especially in the ever-growing graphic and image recognition, industrial automation, and intelligent manufacturing fields to manage massive data, improving the performance of No...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/25G06F16/28G06F16/182G06F16/17G06F12/02
CPCG06F12/0246G06F16/1734G06F16/182G06F16/25G06F16/28
Inventor 赵继胜吴宇
Owner 上海孚典智能科技有限公司