Hadoop cluster multi-tenant management service method and system based on ambari

A hadoop cluster and service system technology, applied in the field of Ambari-based Hadoop cluster multi-tenant management services, can solve problems such as isolation, achieve the effects of improving operational efficiency, protecting data privacy, and improving usage efficiency

Active Publication Date: 2022-04-12
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical task of the present invention is to provide a Hadoop cluster multi-tenant management service method and system based on Ambari to solve how to isolate different user data from each other, and to realize that different users under the same master account can share resources and ensure protection. User data privacy while improving resource usage efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hadoop cluster multi-tenant management service method and system based on ambari

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0064] as attached figure 1 Shown, the Hadoop cluster multi-tenant management service method based on Ambari of the present invention, the method is specifically as follows:

[0065] S1. Build Hadoop cluster multi-tenant management system—EMR service system;

[0066] S2. Ambari integrates the EMR service system: combine the EMR service system with Ambari, register the EMR service system in Ambari, make the EMR service system a custom service of Ambari, and realize the multi-tenant management of Hadoop clusters quickly and conveniently through Ambari Function;

[0067] S3, Hadoop cluster deployment: Using the Blueprint deployment technology, Hadoop clusters with multi-tenant management functions can be quickly deployed.

[0068] Among them, the EMR service system includes,

[0069] The user management and authentication module (EMR IAM module) is used to combine IAM and keycloak to undertake the functions of user management, user authentication and primary and sub-accounts. ...

Embodiment 2

[0085] The Hadoop cluster multi-tenant management service system based on Ambari of the present invention, the system includes,

[0086] The system building block is used to build the Hadoop cluster multi-tenant management system—EMR service system;

[0087] The integration module is used to combine the EMR service system with Ambari, register the EMR service in Ambari, make the EMR service system a custom service of Ambari, and realize the multi-tenant management function of Hadoop cluster quickly and conveniently through Ambari;

[0088] The deployment module is used to use the Blueprint deployment technology to enable the rapid deployment of Hadoop clusters with multi-tenant management functions.

[0089] Among them, the EMR service system includes,

[0090]The user management and authentication module (EMR IAM module) is used to combine IAM and keycloak to undertake the functions of user management, user authentication and primary and sub-accounts.

[0091] Front-end pag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an Ambari-based Hadoop cluster multi-tenant management service method and system, which belongs to the field of big data development technology. The technical problem to be solved by the invention is how to isolate different user data from each other and realize the same master account. Different users can share resources to ensure the protection of user data privacy while improving resource utilization efficiency. The technical solution adopted is: The method is as follows: build a Hadoop cluster multi-tenant management system—EMR service system; Ambari integrates EMR service system: Combine the EMR service system with Ambari, register the EMR service system in Ambari, make the EMR service system a custom service of Ambari, and realize the multi-tenant management function of Hadoop cluster quickly and conveniently through Ambari; Hadoop cluster deployment: use Blueprint Deployment technology enables rapid deployment of Hadoop clusters with multi-tenant management.

Description

technical field [0001] The invention relates to the technical field of big data development, in particular to an Ambari-based Hadoop cluster multi-tenant management service method and system. Background technique [0002] With the rapid development of modern technology, more and more smart devices are used in various industries, generating massive amounts of data. These data are regarded as new means of production, influencing and changing human society through big data and machine learning technology. Based on the development and evolution of big data scenarios, the Hadoop ecosystem can efficiently handle the challenges brought by massive data to all walks of life. Therefore, the Hadoop ecosystem has become the actual standard in the field of big data and is widely used in the business systems of enterprises and organizations. [0003] In the Hadoop ecosystem, Ambari is a management tool for Hadoop clusters. It can realize one-click automatic deployment of Hadoop component...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/455
CPCG06F9/45558G06F2009/45587G06F2009/45595
Inventor 李涛齐光鹏孙思清张炜刚刘牧
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap