Unlock instant, AI-driven research and patent intelligence for your innovation.

Data updating method and server of distributed storage system

A storage system and data update technology, applied in the field of data processing, can solve problems such as poor concurrency, affecting the availability of distributed Key-Value storage systems, and inability to perform simultaneous read and write operations

Active Publication Date: 2016-03-09
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, although the above method can avoid reading dirty data, it has poor concurrency and cannot perform read and write operations at the same time, which weakens the availability of the distributed Key-Value storage system
For example, when a write operation is performed through a distributed index, the write operation may take several seconds or even several minutes, which causes the read operation to be greatly delayed and seriously affects the availability of the distributed Key-Value storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data updating method and server of distributed storage system
  • Data updating method and server of distributed storage system
  • Data updating method and server of distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0095] An embodiment of the present invention provides a data update method for a distributed key-value pair Key-Value storage system. Scenarios to which this embodiment of the present invention can be applied are firstly introduced below. Such as figure 1 shown. figure 1 The system architecture that can implement the embodiment of the present invention is shown, and the system architecture includes a client 101 of a simple database SDB, a network layer Weblayer 102, a buffer layer Cachelayer 103 and a storage layer Storelayer 104, wherein the storage layer 104 is a Key-Value storage system, and the buffer layer 103 mainly provides license service LC (LicenseClient) Server. In the embodiment of the present invention, the operations on the distributed index (such as adding index nodes, modifying index nodes, etc.) are performed in the buffer layer, and the node data to be stored are persistently stored in the storage layer. The following describes the embodiments of the pres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An embodiment of the present invention provides a data update method for a distributed key value pair Key-Value storage system. A node that needs to be updated, a father node, an ascending node, a root node are duplicated to a buffer layer of the Key-Value storage system, and key values and content of the node that needs to be updated, the father node, and the ascending node are modified, and content of the root node is modified, so that these nodes are different from original nodes in a storage layer. According to the method in the present invention, the node that needs to be updated, the father node, and the ascending node are first stored into the storage layer, and then, the root node is stored to a key value pair system. Because the node that needs to be updated in the buffer layer is stored into the storage layer prior to the root node in the buffer layer, the node that needs to be updated cannot be read in a read operation generated in the storage process of the node that needs to be updated, thereby avoiding reading of dirty data. The present invention further provides a corresponding method and server for reading an index node.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a method and server for processing index nodes. Background technique [0002] With the development of electronic communication technology, the storage capacity of electronic data is continuously increasing, and the user's requirements for the capacity of the data storage system are also continuously increasing. As a distributed key-value pair Key-Value storage system featuring high availability, high scalability, and large capacity, it is welcomed by users. [0003] The distributed key-value pair Key-Value storage system uses the key-value pair Key-Value as the data organization method, and distributes these Key-Values ​​on a large number of nodes according to a certain hash algorithm. For the processing of node data in the distributed Key-Value storage system, operations such as query, addition, modification, and deletion can be implemented through the distributed simple database...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCG06F16/00
Inventor 娄东风周训淼
Owner HUAWEI CLOUD COMPUTING TECH CO LTD