Data storage method, device and system, computer equipment and storage medium

A data storage and equipment technology, applied in computing, database indexing, electrical digital data processing, etc., can solve problems such as storage system performance fluctuations, pause delays, etc., to improve average performance, ensure read and write performance, reduce system fluctuations and The effect of pause delay

Active Publication Date: 2019-08-30
PINGCAP XINGCHEN (BEIJING) TECH CO LTD
View PDF7 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention aims to solve the problems of system performance fluctuations and pause delays caused by write amplification defects in the storage system in the prior art, thereby providing a data storage method, device, system, computer equipment and storage medium

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method, device and system, computer equipment and storage medium
  • Data storage method, device and system, computer equipment and storage medium
  • Data storage method, device and system, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032]The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0033] In the description of the present invention, it should be noted that the terms "first", "second", and "third" are used for description purposes only, and should not be understood as indicating or implying relative importance.

[0034] In addition, the technical features involved in the different embodiments of the present invention described below may be combined with each other as long as there is no conflict with each other.

[0035] Before introducing the embodiments of the present invention, first ex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data storage method, device and system, computer equipment and a storage medium, and the method comprises the steps: processing a write-in request of to-be-stored data in a memory, and caching the to-be-stored data in the memory; when the data cached in the memory reaches a first preset threshold value, converting the to-be-stored data in the memory into a multi-layer matrix array with an index, and storing the multi-layer matrix array in a storage layer of a matrix storage structure preset in the nonvolatile storage equipment; and when the data in the nonvolatile storage device reaches a second preset threshold value, performing merging processing on the data stored in the nonvolatile storage device, and writing the data into the next layer of the merging tree structure. According to the inventionmethod, the read-write performance of the system can be ensured, and the space size of each layer is increased, so that the write-amplification performance cost of the system caused by the multilayer log structure tree structure is solved, and the system fluctuation and the pause delay are reduced.

Description

technical field [0001] The technical field of data storage of the present invention specifically relates to a data storage method, device, system, computer equipment and storage medium. Background technique [0002] With the rapid development of information technology and the popularization of the Internet, the amount of data has increased by leaps and bounds, and the data storage scale and data access volume of application services have also increased. Traditional relational databases cannot meet the needs, and non-relational databases Came into being. Key-value storage is a typical storage method of non-relational databases. Data in the key-value storage system is organized and stored in the form of key-value pairs. Due to its horizontally scalable performance expansion method, it can better cope with the current big data era. Needs have become one of the mainstream methods in the storage industry today. [0003] Most key-value storage systems today use the Log-Structure...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/2455
CPCG06F16/2246G06F16/24552
Inventor 崔秋唐刘朱承浩姚婷
Owner PINGCAP XINGCHEN (BEIJING) TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap