Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and device for automatic installation and deployment of Hadoop platform

An automatic installation and platform technology, applied in the field of big data, can solve the problems that the installation management platforms are incompatible with each other, and the Hadoop open source version cannot realize automatic installation, so as to realize automatic installation and deployment and compatibility with each other, shorten the installation and deployment time, and improve the installation efficiency. efficiency effect

Active Publication Date: 2017-05-03
FUJIAN NEWLAND SOFTWARE ENGINEERING CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to provide a method and device for automatically installing and deploying a hadoop platform, so as to solve the problem that the existing Hadoop open source version cannot realize automatic installation, and although the CDH open source version and the HDP open source version can realize automatic installation, their Installation management platforms are incompatible with each other

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for automatic installation and deployment of Hadoop platform
  • A method and device for automatic installation and deployment of Hadoop platform
  • A method and device for automatic installation and deployment of Hadoop platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0109] Step 1: Publish the hadoop version software installation package and customize the version configuration file according to the universal design principle, for the installation and use of all hosts 11 in the cluster:

[0110] The software installation package is stored on the yum installation server. To solve the problem of installation package media differentiation: because yum installs based on the http service, when releasing the software package, the software packages of different releases and versions are distributed according to the "Hadoop release version / version number" The directory hierarchy can be stored in the http service directory of the yum installation server, and the specific software installation package is stored in the version number directory;

[0111] The version configuration file is stored on the management platform, including the repo file specifying the yum installation source address and the configuration default file of each hadoop service; the...

Embodiment 2

[0132] Please refer to image 3 , the second embodiment of the present invention is:

[0133] A device for automatic installation and deployment of hadoop platform, including human-computer interaction interface, cluster management module 4, service management module, host 11 management, monitoring management, alarm management, system management, database processing module, host 11 communication module, client 13 Software, mainframe 11 and database.

[0134] The human-computer interaction interface, that is, the human-computer interaction interface of the big data management platform, is a unified entrance for users to perform various operations on the cluster and the cluster host 11. Based on the B / S architecture, users can log in to the management platform through a browser;

[0135] Cluster management module 4, responsible for creating clusters, displaying cluster information, etc.;

[0136] The service management module is mainly used for service configuration management...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a device for automatic installation and deployment of a hadoop platform. The method comprises the following steps of storing installation packages in different release versions and in different version numbers in a yum installation server according to directory hierarchy; allowing hadoop version configuration files in different release versions and in different version numbers to form configuration list information according to the directory hierarchy, storing the configuration list information on a big data management platform, and storing repo installation source files and a hadoop service directory list under a version number directory layer; running the big data management platform and uploading the configuration list information; creating a cluster and selecting a hadoop release version and a version number; allowing hosts to join the cluster, and distributing the repo installation source files to the hosts; selecting a hadoop service; configuring necessary parameters of the hadoop service; generating installation and start task information by using the big data management platform, and sending the installation starting task information to each host by using the big data management platform; allowing each host to acquire a software installation package of the corresponding hadoop service and automatically install and start each service according to the installation and start task information. The method and the device solve the problem of differentiation and are universally applied to installation of various open source editions.

Description

technical field [0001] The invention relates to the field of big data, in particular to a method and device for automatic installation and deployment of a hadoop platform. Background technique [0002] With the rapid development of information technology, the data generated in the information age is increasingly expanding. As an important technical means to solve the field of big data, Hadoop is currently widely used. Hadoop products were originally open sourced by the Apache Foundation (hereinafter collectively referred to as the Apache open source version). This version is mainly used for verification and learning purposes, and is less used for commercial use. Currently, the main installation and deployment methods are manual installation or batch script installation. A series of releases have been developed on the basis of the Apache open source version. Currently, the two commercial versions, cloudera and hortonworks, are the most mainstream. The open source version of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/445
Inventor 白默王雷林克何凌毅朱坚陆向东
Owner FUJIAN NEWLAND SOFTWARE ENGINEERING CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com