High-availability authentication method for hadoop cluster kerberos

Abstract

The invention discloses a high-availability authentication method for a hadoop cluster kerberos. The high-availability authentication method comprises the following steps: deploying a plurality of kerberos servers in different Linux servers; calling the shell script at regular time by the Linux timer to synchronize and back up the data of the plurality of kernel servers; when the kernel authentication is started by the Hadoop, configuring all the kdc server addresses used in kdc parameter configuration of krb5. Conf; and in the hadoop cluster, adjusting the kerberos authentication priority sequence by adjusting the kdc parameter sequence by the node, so that the kernel server realizes multiple backups. When the hadoop performs kernel authentication, the adjustment can be performed according to the configuration of the authentication server, and in a large-scale cluster, the time delay caused by authentication can be reduced; and meanwhile, the load of a kernel server single server is reduced, and the stability of kernel authentication of the cluster is guaranteed.

Description

technical field [0001] The invention relates to the technical field of computer software applications, more specifically, it relates to a Hadoop cluster Kerberos high-availability authentication method. Background technique [0002] Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without knowing the underlying details of the distribution. Make full use of the power of the cluster for high-speed computing and storage. [0003] Kerberos is a network authentication protocol designed to provide strong authentication services for client / server applications through a key system. The realization of the authentication process does not depend on the authentication of the host operating system, does not require the trust of several host addresses, does not require the physical security of all hosts on the network, and assumes that the data packets transmitted on the network can be read, modified and inserted ar...

AI Technical Summary

Problems solved by technology

[0005] However, in large-scale clusters, when a single kerberos service is used as an authentication server, problems often arise: First, there is a single point of failure problem. When the kerberos authentication server fails, the task startup authentication on the cluster will fail, which will cause the entire The cluster is abnormal; secondly, when the Hadoop cluster nodes reach a certain scale and the system tasks reach a certain scale, the authentication delay of a single kerberos authentication server is too high or the authentication is abnormal. Therefore, a single kerberos authentication server cannot meet large-scale cluster authentication.

Images