Method for achieving NoSQL key-value storage engine

A storage engine and key-value technology, applied in the database field, can solve problems such as waste of resources, long development cycle, time-consuming and laborious, etc., achieve the effect of improving operating efficiency and avoiding repeated development work

Inactive Publication Date: 2012-05-09
PEKING UNIV FOUNDER GRP CO LTD +2
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method for implementing a NoSQL key-value storage engine, so as to solve the technical problems that need to be redeveloped in the prior art, not only the development cycle is long, but also time-consuming and labor-intensive, and resources are seriously wasted

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for achieving NoSQL key-value storage engine
  • Method for achieving NoSQL key-value storage engine
  • Method for achieving NoSQL key-value storage engine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] According to the method proposed by the present invention, the specific operation process of implementing KeyValueSE based on the source code of PostgreSQL is as follows:

[0049] S110: Remove the code of PostgreSQL's parser, optimizer, executor, metadata management, type support system, server framework and other modules, as well as the code of auxiliary functions such as internationalization support, communication protocol, programming interface, etc., and only keep the storage engine Subsystem code.

[0050] S120: Define a fixed "byte string" data type and a fixed single-column fixed attribute object using this "byte string" type in the storage engine, and use the attribute object to create a fixed data row structure description character object tupleDesc. The key code snippets are as follows:

[0051]

[0052]

[0053]

[0054] S130: Use the data row structure descriptor object tupleDesc object as the data row structure of all data tables, so that the dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method for achieving an NoSQL key-value storage engine comprises two stages: firstly obtaining NoSQL storage engine Key Value SE: A1, removing an independent module from A relational database management system (RDBMS), and only keeping the storage engine in the RDBMS; A2, establishing a single-row byte string data line structure serving as a data line structure of a data table in the storage engine; and A3, setting a dependent manner of the storage engine based on callback functions registered by users; and secondly, enabling the storage engine Key Value SE to be remade into a storage engine supporting multi-process and multi-thread: B1, enabling all global variable to be placed in a thread local storage; B2, replacing an original signal communication mechanism between processes with a communication mechanism between threads; and B3, setting a thread initialization function and an exit function. The method can make maximum use of a mature storage engine of the RDBMS to achieve development of the NoSQL key-value storage engine, avoids a large amount of repeated development work, and simultaneously can rapidly achieve production of the NoSQL key-value storage engine with high concurrency, complete ACID transactional semantics and an efficient data storage and access method.

Description

technical field [0001] The present invention relates to a database field, in particular to a method for implementing a NoSQL (Not Only SQL, non-relational, which is a management system design method different from relational databases) key-value storage engine. Background technique [0002] After decades of development, the relational database management system (RDBMS) has been widely used, but at the same time, it has exposed many inherent defects, and its performance cannot meet the latest application requirements of many types. NoSQL is a new data storage management technology developed in recent years. It tries to avoid the shortcomings of RDBMS's low performance in the case of large data volume and a large number of multi-table connections. The key / value storage engine (key / value storage engine) is a technical solution of NoSQL, which stores modeless key-value data (key / value pair), and the key-value data is an unstructured byte string inside the storage engine. The st...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 赵伟郑程光程仁波刘钰王文军罗正海赖铮徐邵稀孙伟丰王凤华何齐李书淦关健
Owner PEKING UNIV FOUNDER GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap