Edge storage database based on improved LSM tree

An LSM tree and database technology, applied in edge storage, flash storage, database, embedded, and IoT fields, can solve the problems of lack of edge data integration data synchronization capability, high sensitivity to write amplification, and reduced SD card life. High disaster tolerance and availability, reducing write amplification, and saving write bandwidth

Active Publication Date: 2020-07-10
SOUTH CHINA UNIV OF TECH
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

More seriously, flash memory devices such as SD cards, similar to solid-state drives, are highly sensitive to write amplification. Excessive writing will lead to a significant reduction in the life of SD cards. Therefore, IoT flash memory devices require low write amplification storage s

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Edge storage database based on improved LSM tree
  • Edge storage database based on improved LSM tree
  • Edge storage database based on improved LSM tree

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The present invention will be further described below in conjunction with specific examples.

[0049] The edge storage database based on the improved LSM tree provided by this embodiment includes an index module, a value storage module, a database function module, a network module, a database synchronization module and a user service module.

[0050] The index module is responsible for storing the internal key and address information of the data, and is responsible for maintaining the order of the internal keys; the index module includes an LSM tree module and an address structure storage module, wherein:

[0051] The LSM tree module is implemented based on levelDB, realizes the sequence arrangement of internal keys by merging, is responsible for orderly maintaining the internal keys of data according to the dictionary order, and stores the addresses of internal keys and data; the address structure storage module is responsible for The value log file number, data length...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an edge storage database based on an improved LSM tree, and the database comprises: an index module which is responsible for the maintenance of data internal keys and address information; a value storage module which is responsible for maintaining data internal keys and actual value information; a database function module which is used for converting various complex data structures into internal key-value pairs; a network module which is used for providing a multiplexed TCP service; a database synchronization module which is used for providing master-slave synchronization and multi-master synchronization among multiple nodes of the database; and a user service module which directly interacts with a user through various standardized interfaces. Through the improvement of the LSM tree and the cooperation of multiple modules, a high-performance, low-loss, high-availability and standardized edge storage database is successfully constructed, and compared with an existing Internet-of-Things edge data storage system, the write-in amplification of the system is remarkably reduced.

Description

technical field [0001] The invention relates to the technical fields of edge storage, Internet of Things, embedded, flash storage, and database, in particular to an edge storage database based on an improved LSM tree. Background technique [0002] The rapid development of IoT technology has spawned a large number of terminals that are physically located at the edge of the network, forming an intricate edge network. But at the same time, due to network conditions, security and privacy, cost budget and other reasons, traditional centralized cloud computing is powerless in the face of edge networks. Therefore, edge computing, which is closer to the data source, lower cost, less traffic, and more secure, has developed rapidly, and edge storage, as the core link in edge computing, is becoming more and more important. [0003] Edge storage differs from traditional data storage in two significant ways: [0004] One is the difference in application scenarios: first, the data store...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/23G06F16/2458G06F16/27H04L29/06H04L29/08
CPCG06F16/2246G06F16/2255G06F16/2272G06F16/2282G06F16/27G06F16/2358G06F16/2474H04L67/1097H04L69/18Y02D10/00
Inventor 董敏孙博宇毕盛
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap