Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data cluster automatic deployment system and method

A deployment system and big data technology, which is applied in the field of automatic deployment system of big data clusters, can solve the problems of cluster deployment failure, heavy workload, error-prone, etc., and achieve the effects of reducing learning costs, improving speed, and being convenient to use

Pending Publication Date: 2019-09-06
INSPUR SOFTWARE CO LTD
View PDF7 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this method has greatly improved in terms of convenience and ease of use compared with the traditional manual installation and script installation, the pre-preparation work (host name modification, JDK installation, inter-host Mutual trust, firewall settings, time synchronization, etc.) still need manual installation or configuration, especially when deploying large-scale clusters, you need to do some pre-processing on each node, the workload is huge and error-prone
[0004] Even if the deployment management tools such as Cloudera Manager or Ambari are installed, it still requires complex multi-step operations to install basic services and fill in configuration items through its page wizard. For those who are not familiar with big data clusters and their basic services, It is also very easy to encounter various problems during the installation process and cause the cluster deployment to fail

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data cluster automatic deployment system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0026] Such as figure 1 As shown, the big data cluster automatic deployment system of the present invention is based on Ambari Blueprint and Ansible, the front-end configuration interaction interface is formed by Vue. log output.

[0027] Among them, Ambari Blueprint is a REST API provided by Ambari, through which there is no need to use the Ambari cluster installation wizard. Ansible is a simple IT automation tool that implements task execution on remote servers based on the SSH protocol.

[0028] Ambari implements the background silent installation and deployment and service startup of Hadoop clusters by defining two configuration files, blueprint and hostmap.

[0029] Both blueprint and hostmap configuration files are in json format.

[0030] Ansible implements task execution on remote servers based on the SSH protocol.

[0031] Jenkins is a tool for automating construction tasks. It provides detailed log files and reminder functions during the construction process for ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a big data cluster automatic deployment system and method, and belongs to the technical field of computer software big data. The big data cluster automatic deployment system isbased on Ambari Blueprint and Ansible, Vue. Js and Flask form a front-end configuration interaction interface, Ambari and Ansible form a support for automatic installation of a rear-end service, andJenkins achieves task scheduling and log output. According to the automatic deployment system for the big data cluster, the installation and deployment speed of the big data cluster can be remarkablyincreased, the installation and deployment process of the big data cluster is greatly simplified, many problems caused by manual configuration are avoided, and the popularization and application valueis very high.

Description

technical field [0001] The invention relates to the technical field of computer software big data, and specifically provides a big data cluster automatic deployment system and method. Background technique [0002] We are in an era of data explosion. How to store, analyze and process the massive data generated by various industries, and dig deep into the hidden value behind the data are issues that major Internet companies are actively studying. Apache Hadoop and its ecosystem software (ZooKeeper, Hive, HBase, Spark, etc.) have laid the foundation for the application and development of big data technology. Building a basic platform for storing and analyzing these data has become the primary link in the research and application of big data technology. A cluster formed by installing big data service components on multiple hosts is one such basic platform. This method is usually to manually install software and configure services on 3 or 5 nodes, or build a cluster by manually...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F8/61G06F8/71H04L12/24
CPCG06F8/61G06F8/71H04L41/0886H04L41/0273
Inventor 阚宝铎李国涛张栋吴李烜
Owner INSPUR SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com