Ambari-based Hadoop cluster multi-tenant management service method and system

A technology of hadoop cluster and service system, applied in the field of multi-tenant management service of Hadoop cluster based on Ambari, it can solve problems such as isolation, and achieve the effect of convenient configuration information, convenient modification, and ease of use of services

Active Publication Date: 2021-01-19
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical task of the present invention is to provide a Hadoop cluster multi-tenant management service method and system based on Ambari to solve how to isolate different user da

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ambari-based Hadoop cluster multi-tenant management service method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0064] as attached figure 1 Shown, the Hadoop cluster multi-tenant management service method based on Ambari of the present invention, the method is specifically as follows:

[0065] S1. Build Hadoop cluster multi-tenant management system—EMR service system;

[0066] S2. Ambari integrates the EMR service system: combine the EMR service system with Ambari, register the EMR service system in Ambari, make the EMR service system a custom service of Ambari, and realize the multi-tenant management of Hadoop clusters quickly and conveniently through Ambari Features;

[0067] S3, Hadoop cluster deployment: Using the Blueprint deployment technology, Hadoop clusters with multi-tenant management functions can be quickly deployed.

[0068] Among them, the EMR service system includes,

[0069] The user management and authentication module (EMR IAM module) is used to combine IAM and keycloak to undertake the functions of user management, user authentication and primary and sub-accounts. ...

Embodiment 2

[0085] The Hadoop cluster multi-tenant management service system based on Ambari of the present invention, the system includes,

[0086] The system building block is used to build the Hadoop cluster multi-tenant management system—EMR service system;

[0087] The integration module is used to combine the EMR service system with Ambari, register the EMR service in Ambari, make the EMR service system a custom service of Ambari, and realize the multi-tenant management function of Hadoop cluster quickly and conveniently through Ambari;

[0088] The deployment module is used to use the Blueprint deployment technology to enable the rapid deployment of Hadoop clusters with multi-tenant management functions.

[0089] Among them, the EMR service system includes,

[0090]The user management and authentication module (EMR IAM module) is used to combine IAM and keycloak to undertake the functions of user management, user authentication and primary and sub-accounts.

[0091] Front-end pag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an Ambari-based Hadoop cluster multi-tenant management service method and system, belongs to the technical field of big data development, and aims to solve the technical problem of how to isolate different user data from each other and realize that different users under the same main account can share resources, so the the privacy of user data is ensured while improving theefficiency of resource use. According to the technical scheme, the method specifically comprises the following steps: constructing a Hadoop cluster multi-tenant management system, namely an EMR service system; according to the Ambari integrated EMR service system, combining the EMR service system and the Ambari, registering the EMR service system in the Ambari, so that the EMR service system becomes a self-defined service of the Ambari, and the multi-tenant management function of the Hadoop cluster can be rapidly and conveniently achieved through the Ambari; and Hadoop cluster deployment: enabling the Hadoop cluster with the multi-tenant management function to be quickly deployed by utilizing a Blueprint deployment technology.

Description

technical field [0001] The invention relates to the technical field of big data development, in particular to an Ambari-based Hadoop cluster multi-tenant management service method and system. Background technique [0002] With the rapid development of modern technology, more and more smart devices are used in various industries, generating massive amounts of data. These data are regarded as new means of production, influencing and changing human society through big data and machine learning technology. Based on the development and evolution of big data scenarios, the Hadoop ecosystem can efficiently handle the challenges brought by massive data to all walks of life. Therefore, the Hadoop ecosystem has become the actual standard in the field of big data and is widely used in the business systems of enterprises and organizations. [0003] In the Hadoop ecosystem, Ambari is a management tool for Hadoop clusters. It can realize one-click automatic deployment of Hadoop component...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/455
CPCG06F9/45558G06F2009/45587G06F2009/45595
Inventor 李涛齐光鹏孙思清张炜刚刘牧
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap