Unlock instant, AI-driven research and patent intelligence for your innovation.

Strong consistency distributed data storage method, device and system

A distributed data and consistent technology, applied in transmission systems, electrical components, etc., can solve problems such as system architecture redundancy, and achieve the effect of ensuring correctness

Active Publication Date: 2016-01-20
TENCENT CLOUD COMPUTING BEIJING CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the strong consistency system provided by the industry is an additional storage system for specific scenarios, but the additional provision of strong consistency storage service will lead to a very redundant system architecture

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Strong consistency distributed data storage method, device and system
  • Strong consistency distributed data storage method, device and system
  • Strong consistency distributed data storage method, device and system

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0030] See image 3 , is a flow chart of a strongly consistent distributed data storage method provided in the first embodiment of the present invention; this embodiment is a strongly consistent distributed data storage method executed by a cache server, including the following steps:

[0031] Step S11, the cache server receives the data write request sent by the client, the data write request includes the data key value and the data operation command, and the cache server includes the cache data corresponding to the data key value and the corresponding cache data sequence number c_seq.

[0032] Step S12, the cache server acquires the self-incrementing sequence number new_seq corresponding to the data key value from the Zookeeper server cluster, and the self-incrementing sequence number new_seq is the data write request of the Zookeeper server cluster for the data The latest sequence number of the key-value creation.

[0033] Step S13, the cache server calculates the differe...

no. 2 example

[0044] Figure 5 It is a flowchart of a strongly consistent distributed data storage method provided in the second embodiment of the present invention; this embodiment is a strongly consistent distributed data storage method executed by the system, including the following steps:

[0045] In step S21, the client sends a data write request to the cache server, and the data write request includes a data key and a data operation command.

[0046] Step S22, the cache server sends a first acquisition request to the Zookeeper server cluster according to the data write request, for acquiring the self-incrementing sequence number new_seq corresponding to the data key, and the cache server stores the data key The cache data corresponding to the value and the cache data sequence number c_seq.

[0047] Step S23, the Zookeeper server cluster returns an auto-increment sequence number new_seq corresponding to the data key value to the cache server according to the first acquisition request,...

no. 3 example

[0066] See Figure 8 , is a schematic structural diagram of a strongly consistent distributed data storage device provided in the third embodiment of the present invention; the device provided in this embodiment can run on a cache server, and the strongly consistent distributed data storage device 30 may include: request receiving Module 31 , data caching module 32 , data acquisition module 33 , data processing module 34 , data writing module 35 , and data synchronization module 36 .

[0067] Wherein, the request receiving module 31 is configured to receive a data write request sent by the client, and the data write request includes a data key value and a data operation command;

[0068] A data cache module 32, configured to store the cached data corresponding to the data key and the corresponding cached data sequence number c_seq;

[0069] The data acquisition module 33 is used to obtain the self-incrementing sequence number new_seq corresponding to the data key value from t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a strong consistence distributed data storage method, device and system. The method comprises the steps that a cache server receives a data writing request sent by a client side, and the data writing request comprises a data key value and a data operating command; the cache server obtains a self-increasing serial number corresponding to the data key value from a zookeeper server cluster; the cache server calculates a difference value between the self-increasing serial number and a cache data serial number, whether the difference value is larger than a preset threshold value is judged, if not, cache data are directly processed according to the data operating command, if yes, latest valid data corresponding to the data key value are obtained from the zookeeper server cluster, the cache data are updated to be the latest valid data, and the latest valid data are processed according to the data operating command; the cache server is used for writing the processed data into the zookeeper server cluster. According to the method, under the circumstance of not influencing the zookeeper writing operation performance, strong consistence cache is provided, and the correctness of data writing is ensured.

Description

technical field [0001] The invention relates to computer Internet technology, in particular to a method, device and system for strongly consistent distributed data storage. Background technique [0002] Zookeeper is a distributed coordination service that provides various services for distributed applications, including configuration maintenance, name service (NameService), distributed synchronization, group service, etc. [0003] like figure 1 As shown, Zookeeper is a cluster composed of many server nodes. In Zookeeper, each node is called a Znode. Znode maintains node user data, collection of parent nodes and child nodes, and status of the node. These nodes are further divided into master nodes (leader nodes) and slave nodes (follower nodes). Zookeeper will ensure that the client's operations on the Znode are sequentially consistent. [0004] In Zookeeper, the write operation of data will be transferred from the follower node to the leader node, and then the leader no...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1097
Inventor 张浩佘晓彬
Owner TENCENT CLOUD COMPUTING BEIJING CO LTD