Method and device for realizing Hadoop host automatic discovery

A hadoop cluster and automatic discovery technology, applied in the field of network communication, can solve the problems of low efficiency of operation and maintenance management, and achieve the effect of improving efficiency

Active Publication Date: 2016-07-13
NEW H3C TECH CO LTD
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a method and device for automatically discovering Hadoop hosts to solve the problem of low efficiency of operation and maintenance management in existing Hadoop host discovery schemes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for realizing Hadoop host automatic discovery
  • Method and device for realizing Hadoop host automatic discovery
  • Method and device for realizing Hadoop host automatic discovery

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, and to make the above-mentioned purposes, features and advantages of the embodiments of the present invention more obvious and understandable, the following describes the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings For further detailed explanation.

[0039] See figure 1 , which is a schematic diagram of a network architecture for implementing automatic discovery of Hadoop hosts provided by an embodiment of the present invention. Such as figure 1 As shown, the schematic diagram of the network architecture may include a client (ie, a host) and a server; the server may include a DHCP (DynamicHostConfigurationProtocol, Dynamic Host Configuration Protocol) server and a Hadoop cluster management server (hereinafter referred to as the cluster management server). Wherein, the DHC...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device for realizing Hadoop host automatic discovery. The method comprises steps: a DHCP DISCOVER message carrying a private label broadcasted by a client is received; a DHCP OFFER message carrying the private label is sent to the client; a DHCP REQUEST message broadcasted by the client is received, wherein the DHCP REQUEST message carries the private label and label information of the client; a DHCP ACK message is sent to the client, wherein the DHCP ACK message carries the private label and Hadoop cluster configuration information corresponding to the label information of the client to enable the client to be added to the Hadoop cluster according to the Hadoop cluster configuration information. When the embodiment of the invention is applied, Hadoop host automatic discovery is realized, and the Hadoop cluster operation and maintenance management efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of network communication, in particular to a method and device for realizing automatic discovery of Hadoop hosts. Background technique [0002] With Hadoop (a distributed system infrastructure) becoming more and more popular, in order to meet the needs of rapid deployment, monitoring and management, a dedicated management platform is required, such as Cloudera Enterprise Manager (Cloudera management platform), Ambari (a management platform) Wait. In order to facilitate the management of many nodes in the cluster, the management platform usually adopts the C / S (Client / Server, client / server) architecture, that is, the client of the management software is installed in all the cluster nodes and accepts the unified management of the server. [0003] However, practice has found that in the existing Hadoop host discovery scheme, when a new node joins, the environment needs to be manually configured on the new node...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/12H04L12/24H04L29/08
CPCH04L41/08H04L67/10H04L61/5014
Inventor 韩东亮饶云
Owner NEW H3C TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products