Distributed collaboration method and collaboration device

A cooperator and distributed technology, applied in the field of computer systems, can solve the problems of rigid design of watch mechanism, rigid callback of zookeeper, low performance, etc., to achieve the effect of quick election, simplified configuration, and improved performance

Active Publication Date: 2014-08-06
阿里巴巴科技(北京)有限公司
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] 1. The tree configuration nodes are cumbersome and complex, and the performance is low
In order to ensure this structure, Zookeeper needs to maintain the overhead of a set of virtual file structures, which has a performance impact on tree nodes with deep directory structures.
[0009] 2. The rigid design of the watch mechanism: zookeeper does not have the method support for obtaining the latest version information. It can only register a watch roughly every time it writes a method such as update. When these methods are called, it will call back, and it does not consider the content of the information. Whether it changes, zookeeper will still call back for updates that do not change the content of the information, and the callback of zookeeper is relatively rigid, it can only be used once, if the information continues to change, you must re-register the watch
[0010] 3. The implementation of the leader election mechanism is too limited. There are only two nodes in the cluster, and zookeeper cannot perform leader election. The leader election of zookeeper must have a strange limitation of an odd number of nodes.
In addition, although Zookeeper's leader election implementation is simpler than the original Paxos, it still has many roles and follower states such as Leader, Follower, Observer, and Learner ( Following), looking for state (Looking), observing state (Observing), leading state (Leading) and other complex states

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed collaboration method and collaboration device
  • Distributed collaboration method and collaboration device
  • Distributed collaboration method and collaboration device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0116] Apply the distributed collaboration method provided by this application to cluster management.

[0117] For large-scale Internet applications with tens of thousands of server cluster environments like Taobao, there is usually a need for a cluster manager to manage the servers in the cluster, so that any server in the same cluster is down, and other servers can be aware of it. If the cluster manager goes down, all servers in the cluster cannot be affected in any way, and can be switched to the backup manager in real time to provide services. like Figure 4 shown. Figure 4 The active manager in the system is the same as the coordinator leader, and the standby manager is equivalent to the coordinator candidate.

[0118] The cluster manager (main manager and standby manager) internally provides a "group" (group) and "server" (server) configuration information, which is equivalent to the domain and node in this application, which are used to represent different A cluster...

Embodiment 2

[0122] Apply the distributed collaboration method provided by this application to the unification of configuration information.

[0123] In a distributed multi-machine environment, maintaining unified configuration information is the most common requirement. When configuration information changes, all machines can obtain and update it in real time. For example, in Taobao’s business service requirements, each business system such as commodities and transactions provides a service address to the outside world, and relies on the services of other business systems, then the service address is a public configuration information. If the service address changes, it should be all Business systems can learn and respond to changes in real time.

[0124] If the commodity business system needs to register its own service address, a node with "domain=commodity, node=service, value=address 1, address 2, address 3..." will be established on the coordinator;

[0125] If the transaction busin...

Embodiment 3

[0127] Embodiment 3, application of distributed lock

[0128] In a distributed environment, when multiple business systems compete for a common resource, distributed lock control is usually required. For example, a data download system in Taobao. If too many business systems download data concurrently, it will cause a lot of pressure and slow down , which can be controlled by distributed locks.

[0129] First, the data download system establishes a locked domain on the coordinator, and then each business system establishes its own node under the domain through the coordinator agent to queue and monitor the change information of the domain.

[0130] If a business system finds that its own node meets the preset conditions, such as its own node ranks first, it downloads the data, and deletes the node after the download is completed to release the lock. In this way, the information of the domain changes, and the synergist sends an event to Listen to the business system of the dom...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed collaboration method. The distributed collaboration method includes the steps that after a collaboration device receives node establishment requests from collaboration clients, nodes are established for the collaboration clients, domains which the nodes belong to are determined, and each node only belongs to one domain; when the nodes change or the domains change, the collaboration device informs collaboration clients meeting the preset conditions of the change. The invention further provides the collaboration device. When collaborative management is performed through the distributed collaboration method and the collaboration device, only the two layers of the domains and the nodes are configured, configuration is simplified, and performance is improved.

Description

technical field [0001] The present application relates to a computer system, in particular to a distributed coordination method and a coordination device. Background technique [0002] Large-scale distributed applications usually require schedulers, controllers, coordinators, etc. to manage resource allocation and task scheduling of task processes. In order to avoid most applications embedding coordinators in scheduling control and other implementations, it is difficult to expand the system and the cost of development and maintenance is high. For problems, the coordinator is usually isolated and designed as a general-purpose, scalable coordinating system. In a computer cluster, it is usually necessary to maintain a leader server, which is responsible for cluster management and scheduling. Therefore, the cluster needs to ensure that a leader provides services at various stages such as startup and operation, and can re-elect the leader after failure and recovery. . [0003] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 彭渊
Owner 阿里巴巴科技(北京)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap