Ceph cluster automatic deployment method and system based on big data platform

A big data platform and automated technology, applied in the field of cloud storage, can solve problems such as numerous configurations, complex operations, and inability to use, and achieve the effect of satisfying the stability of the solution, improving the efficiency of operation and maintenance, and simple operation.

Inactive Publication Date: 2017-12-08
北京溢思得瑞智能科技研究院有限公司 +1
View PDF6 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The deployment scheme officially recommended by Ceph is manual deployment, which is complicated to operate and has various configurations, requires professional and technical personnel to operate, and is difficult to use and promote
Moreover, the open source Ceph automated deployment solution cannot be integrated with the big data platform, cannot be directly used in the big data platform, and the operation is still relatively complicated
[0007] In short, the existing deployment scheme is relatively complicated to operate, and cannot be integrated with the big data platform, and is not suitable for the unified management and monitoring of resources under the big data platform

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ceph cluster automatic deployment method and system based on big data platform
  • Ceph cluster automatic deployment method and system based on big data platform
  • Ceph cluster automatic deployment method and system based on big data platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] The present invention proposes a Ceph cluster automatic deployment method based on a big data platform, which utilizes the Master / Slave architecture and self-defined component framework of the big data platform, combined with the Ceph manual deployment method, to realize the automatic deployment, configuration, inspection, Alarms and status monitoring, etc., greatly simplify and speed up the deployment of Ceph clusters.

[0051] details as follows:

[0052] Macro business logic introduction:

[0053] 1) System logical architecture

[0054] The system logic architecture of the big data platform involved in this method is as follows: figure 1 As shown, the main points of the core logic function are described as follows:

[0055] a) The system is a Master / Slave architecture;

[0056] b) The Master is responsible for the centralized management and task assignment of the entire platform, and manages all slave nodes through the Agent interface;

[0057] c) The Slave is res...

Embodiment 2

[0097] An electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the one processor, the instructions being executed by the one processor at least one processor executes to enable the at least one processor to perform the following method steps:

[0098] The management node sends control commands to the computing nodes, including:

[0099] Deployment management, realize automatic configuration, unified management, start and stop, service inspection of Ceph cluster, and plan each functional node of Ceph cluster according to resource usage;

[0100] Configure parameters, display the personalized configuration of the Ceph cluster to the user in a graphical way, and record and modify the parameter values ​​according to the actual configuration of the user;

[0101] Monitoring and management, collecting the operating parameters of the Ceph cluster, and handing i...

Embodiment 3

[0110] The embodiments of the present application provide a non-volatile computer storage medium, where the computer storage medium stores computer-executable instructions, and the computer-executable instructions can execute the methods in any of the foregoing method embodiments.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to the field of cloud storage and specifically relates to a Ceph cluster automatic deployment method and system based on a big data platform. The system comprises a management node module and a computation node module. The management node module comprises a deployment module, a parameter configuration module, a monitoring management module and an alarm management module. The computation node module comprises an automatic installation module, a parameter synchronization module and a state monitoring module. According to the method and the system, automatic deployment can be realized rapidly and the efficiency is improved by more than 2 times.

Description

technical field [0001] The invention relates to the field of cloud storage, in particular to a Ceph cluster automatic deployment method and system based on a big data platform. Background technique [0002] Data storage is the foundation of big data and cloud computing. There are three typical storage methods: block storage, object storage and file storage: block storage is widely used in early storage systems due to its fast read and write speed; the current big data field Distributed file systems are usually used to meet the needs of dynamic data growth; and object storage is especially suitable for large-scale unstructured data storage and retrieval in cloud and big data environments due to its flat storage method and easy sharing. . Object storage has no directory structure but only storage space. Data is stored in Key-Value format, and it is easy to expand, so it has been widely used in the field of Internet and cloud computing. [0003] Typical object storage systems...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L12/24
CPCH04L41/08H04L67/10H04L67/1097
Inventor 李亮
Owner 北京溢思得瑞智能科技研究院有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap