Automatic deployment system for big data processing system Hadoop on cloud platform OpenStack

A big data processing and hadoop cluster technology, applied in big data and cloud computing fields, can solve problems such as business failures, and achieve the effect of solving business failures and simplifying configuration operations

Inactive Publication Date: 2015-06-24
JIANGSU R & D CENTER FOR INTERNET OF THINGS
View PDF5 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] For this reason, the present invention provides an automatic deployment system of a big data processing system Hadoop on the cloud platform OpenStack, and designs a corresponding coordination control module to solve the problem of business failure caused by physical node failure; it is simple and easy to...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic deployment system for big data processing system Hadoop on cloud platform OpenStack
  • Automatic deployment system for big data processing system Hadoop on cloud platform OpenStack
  • Automatic deployment system for big data processing system Hadoop on cloud platform OpenStack

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The present invention will be further described below with reference to the specific drawings and embodiments.

[0014] like figure 1 2, the big data processing system Hadoop proposed by the present invention automatically deploys the system on the cloud platform OpenStack, including a service customization module 1, a Hadoop cluster control module 2, a coordination control module 3 and an OpenStack platform support module 4.

[0015] The OpenStack platform support module 4 is installed on the Openstack platform 5, and is used to provide virtual machine creation, management and physical resource virtualization services. The OpenStack platform support module 4 is mainly responsible for related services such as virtual machine creation and management, file system support, and is the main entity of the cloud computing platform.

[0016] The service customization module 1 is installed on the OpenStack platform support module 4, and is the entrance of the entire system, whi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an automatic deployment system for a big data processing system Hadoop on a cloud platform OpenStack. The automatic deployment system comprises a service customization module, a Hadoop cluster control module, a coordination control module and an OpenStack platform supporting module. The OpenStack platform supporting module is installed on the OpenStack platform and used for providing the services of virtual machine creation and management and physical resource virtualization. The service customization module is installed on the OpenStack platform supporting module and used for providing a service use interface and obtaining the Hadoop cluster demand information input by a user. The Hadoop cluster control module is called by the service customization module and used for converting the user demand information sent by the service customization module to a specific Hadoop cluster configuration file, generating a specific Hadoop business operating command script, and forwarding a resource management request and job scheduling related commands sent by a resource manager in a Hadoop cluster in the Hadoop business operating process. The coordination control module triggers the coordination control module to create the corresponding Hadoop cluster.

Description

technical field [0001] The invention relates to a system for automatically deploying a big data processing system Hadoop on a cloud platform OpenStack, and is a system for automatically deploying a Hadoop cluster on OpenStack, which solves the problem of Hadoop business failure caused by physical node failure, and belongs to big data and cloud computing. field. Background technique [0002] With the rapid development of the Internet and the Internet of Things industry, the importance of data is increasingly reflected. In the boom of data nuggets, there are problems such as high threshold for big data processing, low utilization of server cluster resources, and difficulty in data sharing. For small and medium-sized enterprises and individuals with sudden data processing needs, they do not have enough funds to purchase dedicated server clusters, and do not have enough time and energy to deeply study technologies related to big data processing; for large enterprises, each depa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L29/08
CPCH04L41/5048H04L41/5051H04L41/5096H04L41/0886H04L41/0895H04L41/40
Inventor 管江华陈曙东
Owner JIANGSU R & D CENTER FOR INTERNET OF THINGS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap