Data update method for distributed storage system and server

A storage system and data update technology, applied in the field of data processing, can solve the problems affecting the availability of distributed Key-Value storage systems, poor concurrency, and inability to perform read and write operations at the same time.

Active Publication Date: 2014-01-15
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF3 Cites 37 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, although the above method can avoid reading dirty data, it has poor concurrency and cannot perform read and write operations at the same time, which weakens the availability of the distributed Key-Value storage system
For example, when a write operation is performed through a distributed index, the write operation may take several seconds or even several minutes, which causes the read operation to be greatly delayed and seriously affects the availability of the distributed Key-Value storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data update method for distributed storage system and server
  • Data update method for distributed storage system and server
  • Data update method for distributed storage system and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0095] An embodiment of the present invention provides a data update method for a distributed key-value pair Key-Value storage system. Scenarios to which this embodiment of the present invention can be applied are firstly introduced below. Such as figure 1 shown. figure 1 A system architecture that can implement the embodiment of the present invention is shown, the system architecture includes a client 101 of a simple database SDB, a network layer Web layer 102, a buffer layer Cache layer 103 and a storage layer Store layer 104, wherein the storage layer 104 is a Key-Value storage system , the buffer layer 103 mainly provides a license service LC (License Client) Server. In the embodiment of the present invention, the operations on the distributed index (such as adding index nodes, modifying index nodes, etc.) are performed in the buffer layer, and the node data to be stored are persistently stored in the storage layer. The following describes the embodiments of the present...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention provides a data update method for a Key-Value storage system via distributed key values. Through replication of nodes requiring update, father nodes, ancestor nodes, and root nodes to a buffer layer of the Key-Value storage system, modification of key values and contents of the nodes requiring update, the father nodes, and the ancestor nodes, and modification of the contents of the root nodes, the nodes are made different from original nodes in the storage layer. The method is characterized in that, the nodes requiring update, the father nodes, and the ancestor nodes are first stored in the storage layer, and then the root nodes are stored in a key value pair system. Since the nodes requiring update in the buffer layer are stored in the storage layer prior to storage of the root nodes in the buffer layer in the storage layer, reading operation in the storage process of the nodes requiring update does not enable reading of the nodes requiring update, thereby preventing reading of dirty data. The invention also provides a corresponding method for reading index nodes and a server.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a method and server for processing index nodes. Background technique [0002] With the development of electronic communication technology, the storage capacity of electronic data is continuously increasing, and the user's requirements for the capacity of the data storage system are also continuously increasing. As a distributed key-value pair Key-Value storage system featuring high availability, high scalability, and large capacity, it is welcomed by users. [0003] The distributed key-value pair Key-Value storage system uses the key-value pair Key-Value as the data organization method, and distributes these Key-Values ​​on a large number of nodes according to a certain hash algorithm. For the processing of node data in the distributed Key-Value storage system, operations such as query, addition, modification, and deletion can be implemented through the distributed simple database...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCG06F16/00
Inventor 娄东风周训淼
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap