Implementation method of dynamic connection of Flink and Kerberos authentication components

A technology of dynamic connection and implementation method, applied in the field of computing, can solve the problems of unfixed number of jobs, restart to realize configuration file update, etc.

Pending Publication Date: 2021-09-10
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in actual business scenarios, we need Flink clusters to access multiple different input and output sources, or the same type of input and output sources to access multiple instances, so when the input and output sources involve Kerberos authentication components (such as Kafka, Hbase, Hdfs, etc.), it is necessary to support the dynamic configuration of Kerberos compon

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Implementation method of dynamic connection of Flink and Kerberos authentication components

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to enable those skilled in the art to better understand the solutions of the present invention, the present invention will be further described in detail below in conjunction with specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts fall within the protection scope of the present invention.

[0029] A preferred embodiment is given below:

[0030] Such as figure 1 As shown, a method for implementing Flink dynamic connection to Kerberos authentication components in this embodiment has the following steps:

[0031] S1. Prepare the Flink cluster and multiple sets of different Kerberos authentication components:

[0032] Standalone Cluster deployment method as an example, first prepare three hosts to build a Flink cluster, inc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of computing, and particularly provides an implementation method of dynamic connection of Flink and Kerberos authentication components, which comprises the following steps of: S1, preparing an Flink cluster and a plurality of sets of different Kerberos authentication components; S2, mounting NFS shared storage; S3, dynamically integrating Kerberos authentication files by a Kerberos management center, and storing the Kerberos authentication files in a shared storage directory; S4, changing the flink-conf.yaml configuration file of the Flink cluster; S5, in a Job related code of the Flink, refreshing Krb5.conf related configuration in real time; and S6, operating the Job of the Flink so that the Flink cluster is successfully connected with the plurality of sets of Kerberos authentication components. Compared with the prior art, the method has the advantages that the problems that conflicts occur when Flink is connected with a plurality of different Kerberos authentication components, a cluster needs to be restarted when the Kerberos authentication components are changed and the like are solved.

Description

technical field [0001] The invention relates to the computing field, and specifically provides an implementation method for Flink to dynamically connect Kerberos authentication components. Background technique [0002] The predecessor of Apache Flink was a research project of the Technical University of Berlin. It was accepted by the Apache Incubator in 2014, and then quickly became one of the top projects of the Apache Software Foundation. It is an open source for distributed data stream processing and batch data processing. Computing platform that provides functions to support two types of applications, stream processing and batch processing. [0003] Kerberos is an authentication system based on a trusted third party proposed by the Massachusetts Institute of Technology. Kerberos provides a method of identity authentication in an open network environment, which enables users on the network to prove their identities to each other. [0004] Currently, the official kerbero...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/445
CPCG06F9/44526
Inventor 朱继学高美容尹萍孙哲安晓博
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products