A method for establishing a Hadoop cluster based on Kubernets

A hadoop cluster and implementation method technology, applied in the direction of program control design, instrumentation, electrical digital data processing, etc., to achieve the effect of improving high availability, high scalability, and convenient migration

Active Publication Date: 2019-01-25
上海华云互越数据技术有限公司
View PDF7 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The purpose of the present invention is to reveal a kind of implementation method based on Kubernetes to set up Hadoop cluster, in order to solve the technical limitation that needs to know the configuration inform...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for establishing a Hadoop cluster based on Kubernets
  • A method for establishing a Hadoop cluster based on Kubernets
  • A method for establishing a Hadoop cluster based on Kubernets

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The present invention will be described in detail below in conjunction with the implementations shown in the drawings, but it should be noted that these implementations are not limitations of the present invention, and those of ordinary skill in the art based on the functions, methods, or structural changes made by these implementations Equivalent transformations or substitutions all fall within the protection scope of the present invention.

[0039]Kubernetes is an open source container cluster project, which provides an automated deployment, scalable, and manageable platform for application containers between host clusters. Based on Kubernetes, it is convenient to monitor, manage and maintain Docker containers. In this embodiment, the nodes formed in the built Hadoop cluster include a master node (Master node) and a slave node (Slave node), and one or more Docker containers run in the master node and the slave node. Each node is configured with a unique property (for...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for establishing a Hadoop cluster based on Kubernets, comprising the following steps: S1, a Manager node circularly listens to the configuration information of each node in the Hadoop cluster, and dynamically encapsulates the configuration information into a system file; The system files are updated to the nodes in the Hadoop cluster by mounting the shared files through the Kubernets API, S2, a management request initiated by a user to a Hadoop cluster is recieved, the node in the Hadoop cluster executes the update operation according to the management request and notifies the Manager node, and the Manager node receives the modification request sent by the node executing the update operation to update the configuration information, and modifies the system file according to the updated configuration information. The invention can realize the dynamic maintenance of the Hadoop cluster, and improves the high availability and the high expansibility of the Hadoop cluster.

Description

technical field [0001] The invention relates to the field of cloud computing container technology, in particular to an implementation method for building a Hadoop cluster based on Kubernetes. Background technique [0002] Kubernetes is an open source container cluster management project, which can provide an open source platform between host clusters that can be automatically deployed, scalable, and application containers can be operated. Kubernetes usually works in conjunction with the Docker container tool and integrates multiple host clusters running Docker containers. It is very convenient to use Kubernetes to manage Docker container clusters. It can not only dynamically monitor the status of containers, but also maintain and manage containers. [0003] Hadoop is a software platform for developing and operating large-scale data processing. The open source software framework implemented based on the JAVA language can be implemented in a distributed cluster composed of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/455
CPCG06F9/45558
Inventor 许广彬谭瑞忠濮天晖张银滨郭晓王子豪强亮
Owner 上海华云互越数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap