Unlock instant, AI-driven research and patent intelligence for your innovation.

A Model-Based Hadoop Deployment and Configuration Method

A technology of hadoop cluster and configuration method, applied in the direction of program control device, program loading/starting, etc., can solve problems such as increasing the complexity of cluster structure, and achieve the effect of improving efficiency and simplifying the deployment and configuration process

Active Publication Date: 2017-11-17
FUZHOU UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Administrators must be familiar with these interfaces to deploy and configure these services, which increases the complexity of the cluster structure
[0004] On the other hand, although there are already some management tools that can help administrators automate the construction of Hadoop clusters, they usually only provide a fixed deployment solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Model-Based Hadoop Deployment and Configuration Method
  • A Model-Based Hadoop Deployment and Configuration Method
  • A Model-Based Hadoop Deployment and Configuration Method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The technical solution of the present invention will be specifically described below in conjunction with the accompanying drawings.

[0041] In order to manage Hadoop clusters at the architecture layer, a set of unified models of Hadoop software architecture is defined first, including service model, deployment model and cloud model. The service model provides a unified view of Hadoop services. Administrators can define required Hadoop services and their configurations in the service model, such as HDFS, Map-Rudece, HIVE, etc.; the deployment model provides a unified view of Hadoop cluster deployment units, from In this view, you can clearly see which computing nodes each component of a Hadoop service is deployed on; the cloud model provides a unified view of the computing resources available in the cloud.

[0042] There are many different Hadoop services described in the service model. Such as figure 1 As shown, you can see each element in the service model: The Acco...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a model-based Hadoop deployment and configuration method, which uses a service model and a cloud model as the input of the Hadoop cluster's automatic deployment and configuration rule engine; sets the Hadoop cluster's automatic deployment and configuration rules; according to the Hadoop cluster's Automatic deployment and configuration rules, combined with the service model and cloud model, generate an automatic deployment and configuration plan for the Hadoop cluster. According to the plan, call the API to deploy the Hadoop cluster on the infrastructure, and get the updated service model and deployment model. A model-based Hadoop deployment and configuration method proposed by the present invention simplifies the deployment and configuration process and improves the efficiency of Hadoop deployment and configuration.

Description

technical field [0001] The invention relates to Hadoop ecosystem software deployment and configuration, in particular to a model-based Hadoop deployment and configuration method. Background technique [0002] Hadoop is an open source distributed data processing software framework. It handles data in a reliable, efficient and easily scalable manner. In practice, administrators need to deploy and configure Hadoop clusters in different ways according to different management requirements, which is a major obstacle to using Hadoop services. This obstacle can be divided into two main parts: [0003] On the one hand, Hadoop services are very diverse, such as HDFS, Map-Reduce, Hbase, Hive, Yarn, Flume, Spark, Storm, Zookeeper and so on. Each service has its own management interface that differs from other services. Administrators must be familiar with these interfaces to deploy and configure these services, which increases the complexity of the cluster structure. [0004] On th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/445
Inventor 陈星郭文忠黄益成
Owner FUZHOU UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com