Method for automatically deploying and managing big data clusters

A big data and cluster technology, applied in the direction of data exchange network, digital transmission system, electrical components, etc., can solve problems such as difficult management, complex deployment of big data clusters, cumbersome configuration, etc., to improve speed, improve security, and simplify the deployment process Effect

Inactive Publication Date: 2016-12-21
INSPUR SOFTWARE CO LTD
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is: in order to solve the problems of complex deployment, cumbersome configuration, and difficult management during the installation and deployment of large data clusters, in order to solve the problem of efficiently co

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for automatically deploying and managing big data clusters

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0018] Such as figure 1 As shown, a method for automatically deploying and managing big data clusters, the method includes a distributed architecture composed of a Web end, a Server end, and multiple Agent ends, Java services are implemented by Server and multiple Agents, and unified by the Server end It also provides web-side visual operation based on Ember.js / AngularJS, which can quickly deploy big data applications, and supports the installation and deployment of multiple clusters to achieve visual monitoring of clusters, hosts and applications.

Embodiment 2

[0020] On the basis of Embodiment 1, the Web terminal described in this embodiment is mainly responsible for guiding users to install big data applications, mainly including adding hosts, selecting applications, assigning hosts, and modifying configurations. Perform visual monitoring, and support operations such as startup and shutdown of each application and configuration optimization.

Embodiment 3

[0022] On the basis of Embodiment 1, the Server end described in this embodiment is mainly responsible for interacting with the Web end and the Agent end. The Server end opens two types of APIs, one of which provides monitoring and management services for the Web end to implement application Visualization of installation, deployment and management monitoring; the other is used to interact with the Agent side, distribute tasks to the specified Agent, and accept the heartbeat request sent by the Agent to the Server to monitor the status of the Agent in real time.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for automatically deploying and managing big data clusters. The method comprises distributed architecture composed of a web side, a server side and multiple agent sides. Java service is realized through the server and the multiple agents. Uniform management is carried out by the server side. Web side visual operations based on Ember.js/Angular JS are provided by the server side. According to the method, the deploying speed of the big data clusters is improved and a deploying process is simplified; according to a web page, management and configuration optimization can be carried out on the multiple clusters; the state information of the clusters can be obtained visually in real time through visual monitoring; and according to a Kerberos security protocol, the security of the clusters can be effectively improved.

Description

technical field [0001] The invention relates to the technical field of computer software applications, in particular to a method for automatically deploying and managing large data clusters, and a method for deploying large data clusters by using Java services to invoke Python scripts. Background technique [0002] Ember.js is a JavaScript MVC framework for creating web applications. It uses string-based Handlebars templates, supports two-way binding, observer mode, computed properties (depending on other properties to change dynamically), automatic update templates, routing control, state machine etc. Ember uses its own extended classes to create Ember objects, arrays, strings, and functions, and provides a large number of methods and properties for operations. Ember uses nestable view layers to make views hierarchical [0003] Metrics is a package that provides measurement tools for various indicators of JAVA services. Embedding the Metrics code in the JAVA code can faci...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L12/26
CPCH04L41/0253H04L41/042H04L41/22H04L43/10H04L43/12
Inventor 张栋李国涛
Owner INSPUR SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products