A method and system for version management and rapid iterative deployment of a large data platform

A big data platform and version management technology, applied in the big data platform version management and rapid iterative deployment and system fields, can solve problems such as huge workload, unfavorable user use, and difficulty in troubleshooting, and achieve the effect of rapid iteration

Active Publication Date: 2019-01-18
福建星瑞格软件有限公司
View PDF17 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] The big data platform has a set of big data software optimization configuration parameters for each business scenario. If you use the existing cluster management technology, you need to write a lot of scripts, and then execute the automated configuration scripts on hundreds of servers , because scripts are written by personnel, the workload is huge, and if there is a problem in a certain script, it is difficult to troubleshoot, which is not conducive to user use

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for version management and rapid iterative deployment of a large data platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The method for version management and rapid iterative deployment of the big data platform of the present invention includes:

[0025] Step 1, put the big data configuration book into a virtual machine to run, and then save the virtual machine as a mirror image file; the big data configuration book includes: operating system version configuration and environment configuration, user's environment configuration and Big data configuration parameters;

[0026] Step 2, uploading the mirror image file to the mirror warehouse server, and generating a corresponding time stamp, the mirror warehouse server is used for the storage and management of the mirror file and the operation management of sending it to each node of the big data;

[0027] Step 3. After receiving the configuration version update instruction from the cluster administrator, the mirror warehouse server obtains the corresponding mirror file, and then puts the mirror file into the virtual machine configured with th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a version management and fast iterative deployment method of a large data platform. The method includes: putting a large data configuration book into a virtual machine for running, and then saving the virtual machine as a mirror file; Uploading the mirror file to the mirror warehouse server, and generating a corresponding timestamp; After receiving the configuration versionupdate instruction from the cluster administrator, sending out the mirror file of the whole cluster corresponding to the big data, and starting the relevant virtual machine process at each host node by the mirror warehouse server to realize the iterative update of the configuration version of the whole cluster. The invention also provides a version management and fast iterative deployment system of a large data platform, which reaches the upgrading iteration of the management configuration of the whole cluster through the iteration of a mirror file.

Description

technical field [0001] The invention relates to a method and system for version management and rapid iterative deployment of a big data platform. Background technique [0002] The big data platform has a set of big data software optimization configuration parameters for each business scenario. If you use the existing cluster management technology, you need to write a lot of scripts, and then execute the automated configuration scripts on hundreds of servers , because the scripts are all written by personnel, the workload is huge, and if there is a problem in a certain script, it will be difficult to troubleshoot, which is not conducive to users. Contents of the invention [0003] The technical problem to be solved by the present invention is to provide a method and system for version management and rapid iterative deployment of a big data platform, so as to make a virtual machine image file for each version of the big data platform, and to reach the entire cluster through ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/61G06F8/71
CPCG06F8/63G06F8/71
Inventor 黄桥藩
Owner 福建星瑞格软件有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap