Method for automatically deploying and managing big data clusters through Docker container

A docker container and big data technology, which is applied in the field of computer software application development, can solve the problems of high resource usage of big data clusters, tedious parameter adjustment, complicated installation and management, etc., to reduce hardware resource usage, reduce workload, and simplify The effect of the deployment process

Inactive Publication Date: 2017-01-11
INSPUR SOFTWARE CO LTD
View PDF5 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Based on the above situation, at the same time, in order to solve the shortcomings of high resource utilization rate of big data clusters, complex installation and management, cumbersome parameter adjustment and inconven

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for automatically deploying and managing big data clusters through Docker container

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer, the present invention will be described in detail below in conjunction with the accompanying drawings and embodiments. It should be noted that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0016] The method of using Docker container to automatically deploy and manage big data clusters is to build the Docker images related to the automated deployment of Hadoop big data clusters by writing Dockerfile files, including Server-side images and Agent-side images; use Server-side images to start a Server container, use Agent End mirroring starts multiple Agent ends, and the Server end manages multiple Agent ends in a unified manner, and at the same time starts the Web application in the Server container; establishes a distributed architecture composed of the Server end, m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention particularly relates to a method for automatically deploying and managing big data clusters through a Docker container. Docker mirror images related to Hadoop big data cluster automatic deployment are constructed by compiling a Docker file and include a Server side mirror image and an Agent side mirror image. A distributed framework composed of a Server side, multiple Agent sides and a Web side is constructed by using the Docker mirror images, and service of deploying Hadoop related big data clusters is automatically started. Management and configuration tuning of the clusters are achieved through Web pages, workloads of operation and maintenance staff are reduced, meanwhile operation states of the clusters, a host and assemblies can be visually obtained through visual monitoring, work efficiency of the operation and maintenance staff is improved, accordingly big data cluster deployment speed is remarkably increased, the deployment process is simplified, and the hardware resource utilization rate is reduced.

Description

technical field [0001] The invention relates to the technical field of computer software application development, in particular to a method for automatically deploying and managing large data clusters using Docker containers. Background technique [0002] Docker is an open source application container engine that allows developers to package their applications and dependencies into a portable container, and then publish it to any popular Linux machine, and can also implement virtualization. Containers use a sandbox mechanism completely, and there will be no interfaces between them. There is almost no performance overhead and can be easily run on machines and data centers. Most importantly, they are not dependent on any language, framework or system. [0003] A Dockerfile is a script consisting of a series of commands and parameters that are applied to a base image and ultimately create a new image, which simplifies the process from start to finish and greatly simplifies de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/455H04L29/08
CPCG06F9/45533H04L67/02H04L67/1095
Inventor 李国涛谢广泰张栋
Owner INSPUR SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap