A data update method and device in a distributed storage system

A distributed storage and data update technology, applied in the field of distributed systems, can solve problems such as increased overhead and inability to guarantee data consistency of multiple copies, and achieve the effects of improving efficiency, solving data consistency, and ensuring read performance

Active Publication Date: 2018-08-03
SHANDA INTERACTIVE ENTERTAINMENT
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present invention provides a method and device for updating data in a distributed storage system to overcome the problems in the prior art that the overhead will be increased and the data consistency among multiple copies cannot be guaranteed in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data update method and device in a distributed storage system
  • A data update method and device in a distributed storage system
  • A data update method and device in a distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] see figure 1 as shown, figure 1 It is a flow chart of Embodiment 1 of the data update method in the distributed storage system disclosed in the embodiment of the present invention. In this embodiment, the method may include:

[0052] Step 101: the current server node receives the data to be updated sent by the client.

[0053]The client first sends the data to be updated to a server node in the distributed storage system. For example, user information is stored on each server node in the distributed storage system, and if the user information needs to be changed, the client Send new user information to one of the server nodes, that is, the data to be updated, and the server node that receives the new user information is the current server node.

[0054] Step 102: The current server node incrementally assigns a unique version number to the data to be updated, and obtains identifiers of multiple replica server nodes where multiple replicas of the data to be updated are ...

Embodiment 2

[0067] refer to figure 2 as shown, figure 2 It is the flow chart of Embodiment 2 of the data update method in the distributed storage system disclosed in the embodiment of the present invention. In addition to steps 101-104 in Embodiment 1, after step 104, the method may further include:

[0068] Step 201: The current server node caches the data to be updated, and deletes the data to be updated after all the replica server nodes are updated.

[0069] The current server node first caches the data to be updated, and when the data is successfully updated on all replica server nodes, it can be deleted. In addition, when the current server node has insufficient space, it can also be deleted, so that it can take up less space The storage space of the current server node.

[0070] It should be noted that, in the embodiment of the present invention, the latest updated data can be additionally cached on at least one replica node, that is, on a certain replica server node, not only ...

Embodiment 3

[0085] see image 3 as shown, image 3 It is a schematic structural diagram of Embodiment 1 of the data update device in the distributed storage system disclosed in the embodiment of the present invention. In this embodiment, the device may include:

[0086] The metadata information repository 301 is used to store the identification of each server node in the distributed storage system, the distribution information of the copy in the server node and the status of the copy;

[0087] Receive data to be updated module 302, for receiving the data to be updated sent by the client;

[0088] An allocation module 303, configured to incrementally allocate a unique version number for the data to be updated;

[0089] An obtaining module 304, configured to obtain, from the metadata information repository, identifiers of multiple replica server nodes where multiple replicas of the data to be updated are located;

[0090] The sending module 305 is configured to send the data to be updated ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for updating data in a distributed storage system. The method comprises the steps as follows: a current server node distributes an only version number to to-be-updated data in a progressive increase manner, and a plurality of replica server node identifiers where a plurality of replicas of the to-be-updated data are located from a metadata information repository; the current server node sends the to-be-updated data and the distributed version number to the replica server nodes corresponding to the plurality of the replica server node identifiers, so that a plurality of the replica server nodes can update respectively preserved replicas and corresponding version numbers according to the to-be-updated data; the version numbers represent the update times of the replicas; and the current server node judges whether data of more than a half of the plurality of the replica server nodes are updated successfully, if the data are updated successfully, successful data updating information and updated version numbers are sent back to a client. With the adoption of the method and the device for updating data in the distributed storage system, the expenditure is increased, and the data consistency among the plurality of the replicas can be guaranteed.

Description

technical field [0001] The present invention relates to the field of distributed systems, and more specifically, relates to a method and device for updating data in a distributed storage system. Background technique [0002] A distributed storage system is to disperse and store data on multiple independent devices. More specifically, it can include distributed file systems, distributed databases, distributed semi-structured storage systems, distributed block storage systems, etc. These systems are oriented to different storage applications and have different access modes. Used interchangeably. At the same time, these systems also have many similarities or similarities, such as: copy distribution information positioning, copy update and maintenance, server node information maintenance and management, and so on. The copy here refers to the copy data of data on different server nodes. [0003] In the existing technology, the common distributed system can generally adopt a st...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30H04L29/08
Inventor 李黄海王旭
Owner SHANDA INTERACTIVE ENTERTAINMENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products