Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Template based WEB deployment method for big data components

A big data and component technology, applied in software deployment, electrical digital data processing, hardware monitoring, etc., can solve problems such as difficult installation of Hadoop

Active Publication Date: 2016-04-13
BEIJING UNIV OF TECH
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, Hadoop is very difficult to install, deploy, and manage. This makes many users discouraged from Hadoop. At present, in addition to manually installing the official website version, the most widely used version is the Hadoop release version provided by Cloudera. This version is a simplified version of Hadoop. Compared with the original version, some steps are saved in the configuration, but there are still problems such as manually setting up SSH, changing the Hadoop core configuration, and manually entering commands in the Linux system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Template based WEB deployment method for big data components
  • Template based WEB deployment method for big data components
  • Template based WEB deployment method for big data components

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] Deploy the packaged HadoopInstaller program (including the written component template script) to tomcat, then start tomcat, and access the address http: / / hostIP:8080 / / HadoopInstaller through the local browser to enter the installation page. The installation process includes The 6 steps are adding host, detecting host environment, selecting optional components, parameter configuration, installation and deployment, and installation report. Figure 4 Shown is the installation flowchart.

[0037] 1. Add a host: Enter the IP address and account information of the host to be added, and the page will dynamically check whether the format of the entered information is correct (to avoid duplication), if it does not meet the requirements, it will prompt to re-enter; if it meets the requirements, enter the host again The user name and password, the information will be saved to the session. Prepare for later reading.

[0038] 2. Check the host environment: take out the relevant in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a template based WEB deployment method for big data components. The thought of the method is that a template is analyzed, information is obtained, and components are installed. The method comprises the steps of 1) analyzing the template: finding corresponding application template and component template through an entrance; 2) obtaining the information: mainly initializing the obtained Input information, wherein the information includes three information sources of information fixed in a background, information automatically distributed according to Java internal rules and algorithms, and information importable in a page; and 3) installing the components: calling a corresponding shell script through the information obtained in the steps 1) and 2) to perform component installation. The invention belongs to the field of big data component applications; and especially by adopting a visual monitoring process technology based on a templated installation structure and WEB cross-system platform operation, the components can be installed and deployed in a plurality of nodes at the same time conveniently and quickly, so that the installation procedure of a developer is simplified and a basic environment is provided for realizing later large array operation.

Description

technical field [0001] The invention belongs to the application field of big data components, especially adopts template-based installation structure, WEB cross-system platform operation, and visual monitoring process technology, which can conveniently and quickly realize the installation and deployment of multiple components on multiple nodes at the same time, including Hadoop and HBase at present. , Hive, Kafka and Zookeeper 5 components, the purpose is to simplify the installation procedures for developers and provide a basic environment for the later realization of large array operations. Background technique [0002] Hadoop is an open source and efficient cloud computing infrastructure platform. It is not only widely used in the field of cloud computing, but also supports search engine services. As the underlying infrastructure system of search engines, it is also used in massive data processing, data mining, machine learning, Fields such as scientific computing are gai...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/44G06F11/32
CPCG06F8/61G06F11/323
Inventor 郑楠张新峰
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products