High-availability authentication method for hadoop cluster kerberos

A Hadoop cluster and authentication method technology, applied in the field of computer software applications, can solve the problems of abnormal authentication, abnormal clustering, and high authentication delay of a single kerberos authentication server, achieve high availability requirements, ensure stability, and avoid the effect of excessive load

Active Publication Date: 2020-08-28
CHONGQING UNIV OF EDUCATION
View PDF7 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, in large-scale clusters, when a single kerberos service is used as an authentication server, problems often arise: First, there is a single point of failure problem. When the kerberos authentication server fails, the task startup authentication on the cluster will fail, which will cause the entire The cluste...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-availability authentication method for hadoop cluster kerberos
  • High-availability authentication method for hadoop cluster kerberos
  • High-availability authentication method for hadoop cluster kerberos

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0035] Embodiment: a kind of hadoop cluster kerberos high availability authentication method, such as figure 1 shown, including the following steps:

[0036] S1: Deploy multiple kerberos servers on different Linux servers.

[0037] S2: The Linux timer regularly calls the shell script to synchronize and back up the data of multiple kerberos servers in the corresponding Linux server. The timing cycle of the Linux timer is executed once every 5s

[0038] S3: When Hadoop starts kerberos authentication, configure all kdc server addresses used in the kdc parameter configuration of krb5.conf; among them, the default first kdc parameter is the master-master service of the kerberos server, and the second kdc The parameter is the standby master (slave-master) service of the kerberos server, and the third kdc parameter is the slave service; in the Hadoop cluster, the node adjusts the kerberos authentication priority order by adjusting the kdc parameter order.

[0039]The deployment of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a high-availability authentication method for a hadoop cluster kerberos. The high-availability authentication method comprises the following steps: deploying a plurality of kerberos servers in different Linux servers; calling the shell script at regular time by the Linux timer to synchronize and back up the data of the plurality of kernel servers; when the kernel authentication is started by the Hadoop, configuring all the kdc server addresses used in kdc parameter configuration of krb5. Conf; and in the hadoop cluster, adjusting the kerberos authentication priority sequence by adjusting the kdc parameter sequence by the node, so that the kernel server realizes multiple backups. When the hadoop performs kernel authentication, the adjustment can be performed according to the configuration of the authentication server, and in a large-scale cluster, the time delay caused by authentication can be reduced; and meanwhile, the load of a kernel server single server is reduced, and the stability of kernel authentication of the cluster is guaranteed.

Description

technical field [0001] The invention relates to the technical field of computer software applications, more specifically, it relates to a Hadoop cluster Kerberos high-availability authentication method. Background technique [0002] Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without knowing the underlying details of the distribution. Make full use of the power of the cluster for high-speed computing and storage. [0003] Kerberos is a network authentication protocol designed to provide strong authentication services for client / server applications through a key system. The realization of the authentication process does not depend on the authentication of the host operating system, does not require the trust of several host addresses, does not require the physical security of all hosts on the network, and assumes that the data packets transmitted on the network can be read, modified and inserted ar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F21/33G06F11/14
CPCG06F21/335G06F11/1448G06F11/1464
Inventor 彭亚飞韦鹏程付仕明
Owner CHONGQING UNIV OF EDUCATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap