Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

A distributed architecture data consistency method based on a Zookeeper

A distributed architecture and consistent technology, applied in the field of data processing, to achieve the effect of improving data access speed, performance and data consistency

Active Publication Date: 2019-05-28
科大国创云网科技有限公司
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] The object of the present invention is to provide a kind of distributed architecture data consistency method based on Zookeeper, by using Zookeeper in the distributed architecture system as the cache data synchronization manager, utilize the publication and subscription mechanism of Zookeeper to real-time synchronous distributed multi-node Cache data to achieve data consistency between multiple nodes and solve existing problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed architecture data consistency method based on a Zookeeper
  • A distributed architecture data consistency method based on a Zookeeper
  • A distributed architecture data consistency method based on a Zookeeper

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0045] see figure 1 Shown, the present invention is a kind of distributed framework data consistency method based on Zookeeper, comprises the following steps:

[0046] Step S1, buffer data initialization: After each node of the distributed system is started, the data in Zookeeper is loaded into the memory of each node;

[0047] Step S2. Deploy subscription monitoring: define a subscription monitoring method, each node subscribes to the Zookeeper directory and data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed architecture data consistency method based on a Zookeeper, and relates to the technical field of data processing. The method comprises the following steps of: initializing buffer data: loading data in a Zookeeper into a memory of each node after each node of the distributed system is started; defining a subscription monitoring method, each node subscribes to aZookeeper directory and data, deploying monitoring; and data synchronization: after monitoring the data change in the Zookeeper, updating the memory data of each node through a deployed monitoring method, and keeping the data synchronization among the nodes. According to the invention, a Zookeeper component is used as a cache data synchronization manager in a distributed architecture system; thedistributed multi-node cache data is synchronized in real time by utilizing a release and subscription mechanism of the Zookeeper, and meanwhile, the data access speed is greatly increased based on aZookeeper database of a memory, so that the performance and the data consistency are well improved in a distributed architecture system.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a distributed architecture data consistency method based on Zookeeper. Background technique [0002] Zookeeper is an open source distributed application coordination service. Distributed applications can implement functions such as data publishing / subscribing, load balancing, distributed coordination / notification, cluster management, distributed locks and distributed queues based on Zookeeper. [0003] CAP theory in the distributed field: No distributed system can simultaneously meet the three basic requirements of Consistency, Availability, and Partition tolerance. In a distributed architecture, multi-node deployment is used to achieve high availability. Partition fault tolerance is the most basic requirement. How to balance consistency and availability is the main problem faced by the distributed architecture. Therefore, the BASE theory came into being. The...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/23G06F16/2455G06F16/2458
Inventor 冯强中范文斌王亚平吴彤彤刘成彪王涛
Owner 科大国创云网科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products