Method and device for automatic installation and deployment of hadoop platform
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
An automatic installation and platform technology, applied in the field of big data, can solve problems such as the incompatibility of installation management platforms and the inability of automatic installation of Hadoop open source version to achieve automatic installation and deployment and mutual compatibility, shorten installation and deployment time, and improve installation. The effect of efficiency
Active Publication Date: 2015-01-28
FUJIAN NEWLAND SOFTWARE ENGINEERING CO LTD
View PDF3 Cites 57 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0005] The technical problem to be solved by the present invention is to provide a method and device for automatically installing and deploying a hadoop platform, so as to solve the problem that the existing Hadoop open source version cannot realize automatic installation, and although the CDH open source version and the HDP open source version can realize automatic installation, their Installation management platforms are incompatible with each other
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0109] Step 1: Publish the hadoop version software installation package and customize the version configuration file according to the universal design principle for installation and use on all hosts 11 in the cluster:
[0110] The software installation package is stored on the yum installation server. In view of the difference of the installation package medium: because yum is installed based on the http service, the software packages of different distributions and versions are distributed according to the "Hadoop distribution / version number" when the software package is released. The directory hierarchy can be stored in the http service directory of the yum installation server, and the specific software installation package is stored in the version number directory;
[0111] The version configuration file is stored on the management platform, including the repo file specifying the source address of the yum installation and the configuration default file for each hadoop service...
Embodiment 2
[0132] Please refer to image 3 , the second embodiment of the present invention is:
[0133] A device for automatic installation and deployment of a hadoop platform, comprising a human-computer interaction interface, a cluster management module 4, a service management module, a host 11 management, monitoring management, alarm management, system management, a database processing module, a host 11 communication module, and a client 13 Software, mainframe 11 and database.
[0134] The human-computer interaction interface, that is, the human-computer interaction interface of the big data management platform, is a unified entry for users to perform various operations on the cluster and cluster hosts 11. Based on the B / S architecture, users can log in to the management platform through a browser;
[0135] The cluster management module 4 is used to be responsible for cluster creation, cluster information display, etc.;
[0136] The service management module is mainly used for serv...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The invention provides a method and a device for automatic installation and deployment of a hadoop platform. The method comprises the following steps of storing installation packages in different release versions and in different version numbers in a yum installation server according to directory hierarchy; allowing hadoop version configuration files in different release versions and in different version numbers to form configuration list information according to the directory hierarchy, storing the configuration list information on a big data management platform, and storing repo installation source files and a hadoop service directory list under a version number directory layer; running the big data management platform and uploading the configuration list information; creating a cluster and selecting a hadoop release version and a version number; allowing hosts to join the cluster, and distributing the repo installation source files to the hosts; selecting a hadoop service; configuring necessary parameters of the hadoop service; generating installation and start task information by using the big data management platform, and sending the installation starting task information to each host by using the big data management platform; allowing each host to acquire a software installation package of the corresponding hadoop service and automatically install and start each service according to the installation and start task information. The method and the device solve the problem of differentiation and are universally applied to installation of various open source editions.
Description
technical field [0001] The invention relates to the field of big data, in particular to a method and device for automatic installation and deployment of a hadoop platform. Background technique [0002] With the rapid development of information technology, the data generated in the information age is expanding day by day. As an important technical means to solve the field of big data, Hadoop is currently widely used. The Hadoop product was originally open sourced by the Apache Foundation (hereinafter collectively referred to as the Apache open source version). This version is mainly used for verification and learning purposes, and is less used for commercial use. Currently, the main installation and deployment methods are manual installation or batch script installation. Based on the Apache open source version, a series of distributions have been developed. Currently, the two commercial versions, cloudera and hortonworks, are the most mainstream. The open source version of h...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to view more 
Login to view more