Automatic cluster application deployment method and system

Abstract

According to the automatic cluster application deployment method and system provided by the invention, rapid deployment and flexible and convenient template design are carried out through automatic matching template data, deployment requests from users can be dynamically received, products can be automatically distributed to each server, the complexity of manual operation is reduced, the reliability is improved, and the possibility of errors is reduced; meanwhile, the application monitoring function and the server monitoring function are integrated, the health state of product operation is sensed in real time by collecting operation index data of a deployed product, a user is helped to know the operation condition of the product at any time, and stable operation of an application is ensured; the operation state of the server in the cluster can be continuously monitored, an early warning function is provided, and the stability of a product operation environment is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of data monitoring deployment, and in particular to an automated cluster application deployment method, an automated cluster application deployment system, a computer device, a computer-readable storage medium, and a computer program product. Background Art

[0002] The statements in this section merely provide background art related to the present invention and do not necessarily constitute prior art.

[0003] Automated cluster application deployment refers to the use of automation tools and scripts to automatically deploy applications and their dependencies to a cluster of multiple servers or virtual machines. This deployment method can significantly speed up the launch of applications, reduce operation and maintenance costs, and improve the scalability and fault tolerance of the system. In the current IT field, automated deployment and monitoring systems have been widely used. Most existing automated deployment solutions rely on configuration files in formats such as YAML or XML to describe the application environment and use scripting languages ​​to perform automated tasks, such as Ansible, Chef, Puppet, etc. In terms of monitoring, tools such as Prometheus and Zabbix are used to collect and analyze cluster status data.

[0004] The inventors have found that the existing automated deployment and monitoring methods have the following problems: (1) The configuration files are highly complex and difficult to understand and modify; (2) There is a lack of flexible dynamic parameter adjustment capabilities during the automated deployment process; (3) The real-time and accuracy of the monitoring system are limited, and the response to abnormal situations is not timely; (4) There is a lack of an integrated deployment and monitoring platform, resulting in low management efficiency. Summary of the invention

[0005] In order to address the deficiencies of the prior art, the present invention provides an automated cluster application deployment method and system, which automatically matches the number of servers in a cluster through a built-in cluster deployment template, automatically allocates product deployment plans, and automatically pushes products to corresponding cluster nodes, thereby realizing automated deployment.

[0006] In order to achieve the above object, the present invention adopts the following technical solution:

[0007] In a first aspect, the present invention provides an automated cluster application deployment method.

[0008] An automated cluster application deployment method includes the following processes:

[0009] Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster;

[0010] According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template.

[0011] Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

[0012] As a further limitation of the first aspect of the present invention, a JSON template is used as the configuration file format.

[0013] As a further limitation of the first aspect of the present invention, the agent program is pushed to all servers in the cluster to prepare for subsequent instruction execution and data collection actions.

[0014] As a further limitation of the first aspect of the present invention, an application monitoring process is also included, including:

[0015] Any application monitoring starts;

[0016] Generating monitoring instructions for the deployed product installation package;

[0017] Monitoring instructions are automatically sent to all servers in the cluster, so that the proxy service in the server executes the instructions to collect data and reports the collected data to the system platform.

[0018] As a further limitation of the first aspect of the present invention, the server monitoring process is also included, including:

[0019] When any server proxy service starts, the proxy service automatically collects server data and automatically reports the collected data to the system platform, so that the platform performs the following actions:

[0020] After receiving the data, it will be cleaned and processed. Based on the built-in alarm strategy, it will automatically determine whether the processed data is alarm data. If it is alarm data, an alarm will be issued.

[0021] In a second aspect, the present invention provides an automated cluster application deployment system.

[0022] An automated cluster application deployment system includes: a unified deployment platform and multiple servers, wherein the unified deployment platform is configured to perform the following process:

[0023] Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster;

[0024] According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template.

[0025] Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

[0026] In a third aspect, the present invention provides an automated cluster application deployment system.

[0027] An automated cluster application deployment system, comprising:

[0028] The clustering unit is configured to: incorporate all servers to be deployed into a unified cluster, and push the agent program to all servers in the cluster;

[0029] The deployment template matching unit is configured to: compare the deployment template library in the cluster according to the uploaded product installation package, determine whether the deployment template successfully matched can match the current cluster environment, if so, call the deployment template successfully matched, if not, customize the deployment template of the product installation package to obtain a customized deployment template;

[0030] The automated deployment unit is configured to automatically match the number of servers in the cluster based on the compared successful deployment template or the custom deployment template, automatically allocate the deployment plan of the product installation package, and automatically push the product installation package to the corresponding cluster node.

[0031] In a fourth aspect, the present invention provides a computer device, comprising: a processor and a computer-readable storage medium;

[0032] a processor adapted to execute a computer program;

[0033] A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by the processor, the method for automated cluster application deployment as described in the first aspect of the present invention is implemented.

[0034] In a fifth aspect, the present invention provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and executing the automated cluster application deployment method as described in the first aspect of the present invention.

[0035] In a sixth aspect, the present invention provides a computer program product, comprising a computer program, and when the computer program is executed by a processor, the computer program implements the automated cluster application deployment method as described in the first aspect of the present invention.

[0036] Compared with the prior art, the present invention has the following beneficial effects:

[0037] 1. The present invention innovatively proposes an automated cluster application deployment method, which automatically matches the number of servers in the cluster through a built-in cluster deployment template, automatically allocates product deployment plans, and automatically pushes products to corresponding cluster nodes, thereby realizing automated deployment.

[0038] 2. The present invention innovatively designs an application monitoring strategy, automatically issues application data collection instructions and automatically collects product application data, and provides real-time feedback on product operating status.

[0039] 3. The present invention innovatively proposes a server monitoring strategy, automatically collects server data, automatically issues alarms based on built-in alarm strategies, and monitors and ensures the healthy operation of the system.

[0040] Advantages of additional aspects of the present invention will be given in part in the following description, and in part will become obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0042] Figure 1 A schematic diagram of a product deployment process provided by Embodiment 1 of the present invention;

[0043] Figure 2 A schematic diagram of an application monitoring process provided in Example 1 of the present invention;

[0044] Figure 3 A schematic diagram of a server monitoring process provided in Example 1 of the present invention;

[0045] Figure 4 An overall schematic diagram of the automated cluster application deployment and monitoring solution provided in Example 2 of the present invention;

[0046] Figure 5 A schematic diagram of a product deployment system provided in Embodiment 3 of the present invention;

[0047] Figure 6 A schematic diagram of a computer device provided for Embodiment 4 of the present invention. DETAILED DESCRIPTION

[0048] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0049] It should be noted that the following detailed descriptions are exemplary and are intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs.

[0050] In the absence of conflict, the embodiments of the present invention and the features of the embodiments may be combined with each other.

[0051] Embodiment 1:

[0052] This implementation proposes an automated cluster application deployment method. Cluster application deployment distributes application products on multiple physical or virtual nodes, with each node running one or more instances of the application, thereby improving the overall performance and reliability of the system. This deployment method can ensure that the application can continue to run when a single node fails, while optimizing resource usage and improving user experience through load balancing technology.

[0053] Specifically, this implementation adopts JSON as the configuration file format because of its clear structure, good readability and easy parsing. It is particularly suitable for describing complex deployment environments. It can be quickly deployed through automatic matching of template data. The flexible and convenient template design can dynamically receive deployment requests from users and automatically distribute products to various servers, reducing the complexity of human operations, improving reliability, and reducing the possibility of errors.

[0054] like Figure 1 As shown, the present invention uses a built-in cluster deployment template to automatically match the number of servers in the cluster, automatically allocate product deployment plans, and automatically push products to corresponding cluster nodes to achieve automated deployment, including the following processes:

[0055] Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster;

[0056] According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template.

[0057] Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

[0058] This implementation also integrates an application monitoring module and a server monitoring module. The application monitoring module collects operating indicator data of deployed products to perceive the health status of product operation in real time, helping users to understand the product operation status at any time and ensure the stable operation of the application; the server monitoring module can continuously monitor the operating status of servers in the cluster and provide early warning functions to ensure the stability of the product operating environment.

[0059] like Figure 2 As shown, the application monitoring module automatically issues application data collection instructions and automatically collects product application data, and provides real-time feedback on product operation status, including the following processes:

[0060] Any application monitoring starts;

[0061] Generate monitoring instructions for deployed products;

[0062] Monitoring instructions are automatically sent to all nodes in the cluster;

[0063] The proxy service in the node executes instructions to collect data;

[0064] Report the collected data to the system platform.

[0065] like Figure 3 As shown in the figure, the server monitoring module automatically collects server data, automatically issues alarms based on built-in alarm strategies, monitors and ensures the healthy operation of the system, including the following processes:

[0066] Any node proxy service starts;

[0067] The proxy service automatically collects server data;

[0068] Automatically report the collected data to the system platform;

[0069] The platform receives the data;

[0070] The platform cleans and processes the data;

[0071] The platform automatically determines whether the processed data is alarm data based on the built-in alarm strategy;

[0072] If it is alarm data, a system alarm will be issued.

[0073] The present invention simplifies configuration. The JSON template simplifies the writing of configuration files and reduces maintenance costs. It enhances flexibility. The dynamic parameter adjustment mechanism makes the deployment process more flexible and can adapt to the needs of different scenarios. It improves monitoring efficiency. The real-time monitoring and early warning functions improve the response speed of the system and enhance the fault prevention capability. It realizes integrated management, integrates deployment and monitoring into the same platform, and improves the overall operation and maintenance efficiency.

[0074] Moreover, the design and parsing algorithm of the JSON template of the present invention ensures efficient processing of configuration files; through the dynamic parameter adjustment mechanism, the system has a high degree of adaptability; through the real-time monitoring and early warning algorithm, accurate control of the health status of the cluster and the health status of the product is achieved.

[0075] Embodiment 2:

[0076] like Figure 4 As shown, the present invention provides an automated cluster application deployment system, including: a unified deployment platform and multiple servers, wherein the unified deployment platform is configured to perform the following process:

[0077] Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster;

[0078] According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template.

[0079] Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

[0080] The unified deployment platform also includes application monitoring and server monitoring processes, which are specifically described in Example 1 and will not be repeated here.

[0081] Embodiment 3:

[0082] like Figure 5 As shown, this implementation provides an automated cluster application deployment system, including:

[0083] The clustering unit is configured to: incorporate all servers to be deployed into a unified cluster, and push the agent program to all servers in the cluster;

[0084] The deployment template matching unit is configured to: compare the deployment template library in the cluster according to the uploaded product installation package, determine whether the deployment template successfully matched can match the current cluster environment, if so, call the deployment template successfully matched, if not, customize the deployment template of the product installation package to obtain a customized deployment template;

[0085] The automated deployment unit is configured to automatically match the number of servers in the cluster based on the compared successful deployment template or the custom deployment template, automatically allocate the deployment plan of the product installation package, and automatically push the product installation package to the corresponding cluster node.

[0086] The application deployment system further includes:

[0087] The application monitors the process unit and is configured to:

[0088] Any application monitoring starts;

[0089] Generating monitoring instructions for the deployed product installation package;

[0090] Monitoring instructions are automatically sent to all servers in the cluster, so that the proxy service in the server executes the instructions to collect data and reports the collected data to the system platform.

[0091] The application deployment system further includes:

[0092] The server monitoring unit is configured to:

[0093] When any server proxy service starts, the proxy service automatically collects server data and automatically reports the collected data to the system platform, so that the platform performs the following actions:

[0094] After receiving the data, it will be cleaned and processed. Based on the built-in alarm strategy, it will automatically determine whether the processed data is alarm data. If it is alarm data, an alarm will be issued.

[0095] It is understandable that the above-mentioned units can be separately or all combined into one or several other units to constitute, or some of the units can also be split into multiple smaller units in function to constitute, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In practical applications, the functions of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the automated cluster application deployment system may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0096] According to another embodiment of the present application, the system described in this embodiment can be constructed, and the automated cluster application deployment method of the embodiment of the present application can be implemented by running a computer program (including program code) capable of executing the steps involved in the corresponding method described in Example 1 on a general-purpose computing device such as a computer, which includes processing elements and storage elements such as a central processing unit (CPU), random access memory (RAM), and read-only memory (ROM). The computer program can be recorded on, for example, a computer-readable recording medium, and loaded into the above-mentioned computing device through the computer-readable recording medium and run therein.

[0097] Embodiment 4:

[0098] like Figure 6 As shown, this implementation provides an electronic device, which includes a processor 1001, a communication interface 1002, and a computer-readable storage medium 1003. The processor 1001, the communication interface 1002, and the computer-readable storage medium 1003 may be connected via a bus or other means.

[0099] Among them, the communication interface 1002 is used to receive and send data, the computer-readable storage medium 1003 can be stored in the memory of the electronic device, the computer-readable storage medium 1003 is used to store a computer program, the computer program includes program instructions, and the processor 1001 is used to execute the program instructions stored in the computer-readable storage medium 1003.

[0100] Processor 1001 (or CPU (Central Processing Unit)) is the computing core and control core of the electronic device, which is suitable for implementing one or more instructions, specifically suitable for loading and executing one or more instructions to implement corresponding method processes or corresponding functions.

[0101] The processor 1001 is configured to execute the following process:

[0102] Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster;

[0103] According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template.

[0104] Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

[0105] It also includes application monitoring and server monitoring processes, which are specifically described in Example 1 and will not be repeated here.

[0106] Embodiment 5:

[0107] This implementation provides a computer-readable storage medium (Memory), which is a memory device in an electronic device for storing programs and data. It is understandable that the computer-readable storage medium here can include both built-in storage media in the electronic device and, of course, extended storage media supported by the electronic device. The computer-readable storage medium provides a storage space that stores the processing system of the electronic device.

[0108] In addition, the storage space also stores one or more instructions suitable for being loaded and executed by the processor, and these instructions may be one or more computer programs (including program codes). It should be noted that the computer-readable storage medium here may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk storage; optionally, it may also be at least one computer-readable storage medium located away from the aforementioned processor.

[0109] In one embodiment, the computer-readable storage medium stores one or more instructions; the processor loads and executes the one or more instructions stored in the computer-readable storage medium to implement the following process:

[0110] Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster;

[0111] According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template.

[0112] Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

[0113] It also includes application monitoring and server monitoring processes, which are specifically described in Example 1 and will not be repeated here.

[0114] Embodiment 6:

[0115] The present implementation provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device performs the following process:

[0116] Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster;

[0117] According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template.

[0118] Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

[0119] It also includes application monitoring and server monitoring processes, which are specifically described in Example 1 and will not be repeated here.

[0120] A person skilled in the art can appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0121] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instruction can be stored in a computer-readable storage medium or transmitted by a computer-readable storage medium. The computer instruction can be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (for example, coaxial cable, optical fiber, digital line (DSL)) or wireless (for example, infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data processing device such as a server, a data center, etc. that contains one or more available media integration. Available media can be magnetic media (for example, floppy disk, hard disk, tape), optical media (for example, DVD), or semiconductor media (for example, solid-state drive (Solid State Disk, SSD)) and the like.

[0122] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An automated cluster application deployment method, characterized in that: The process includes: Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster; According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template. Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

2. The automated cluster application deployment method according to claim 1, characterized in that: Use JSON template as the configuration file format.

3. The automated cluster application deployment method according to claim 1, characterized in that: Push the agent program to all servers in the cluster to prepare for subsequent instruction execution and data collection actions.

4. The automated cluster application deployment method according to claim 1, characterized in that: It also includes the application monitoring process, including: Any application monitoring starts; Generating monitoring instructions for the deployed product installation package; Monitoring instructions are automatically sent to all servers in the cluster, so that the proxy service in the server executes the instructions to collect data and reports the collected data to the system platform.

5. The automated cluster application deployment method according to claim 1, characterized in that: Also included is the server monitoring process, including: When any server proxy service starts, the proxy service automatically collects server data and automatically reports the collected data to the system platform, so that the platform performs the following actions: After receiving the data, it will be cleaned and processed. Based on the built-in alarm strategy, it will automatically determine whether the processed data is alarm data. If it is alarm data, an alarm will be issued.

6. An automated cluster application deployment system, characterized in that: include: A unified deployment platform and multiple servers, wherein the unified deployment platform is configured to perform the following process: Integrate all servers to be deployed into a unified cluster, and push agent programs to all servers in the cluster; According to the uploaded product installation package, the deployment template library in the cluster is compared to determine whether the deployment template successfully matched can match the current cluster environment. If so, the deployment template successfully matched is called. If not, the deployment template of the product installation package is customized to obtain a customized deployment template. Based on the compared successful deployment template or the custom deployment template, the number of servers in the cluster is automatically matched, the deployment plan of the product installation package is automatically allocated, and the product installation package is automatically pushed to the corresponding cluster node.

7. An automated cluster application deployment system, characterized in that: include: The clustering unit is configured to: incorporate all servers to be deployed into a unified cluster, and push the agent program to all servers in the cluster; The deployment template matching unit is configured to: compare the deployment template library in the cluster according to the uploaded product installation package, determine whether the deployment template successfully matched can match the current cluster environment, if so, call the deployment template successfully matched, if not, customize the deployment template of the product installation package to obtain a customized deployment template; The automated deployment unit is configured to automatically match the number of servers in the cluster based on the compared successful deployment template or the custom deployment template, automatically allocate the deployment plan of the product installation package, and automatically push the product installation package to the corresponding cluster node.

8. A computer device, characterized in that: include: a processor and a computer readable storage medium; a processor adapted to execute a computer program; A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by the processor, the automated cluster application deployment method according to any one of claims 1 to 5 is implemented.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and executing the automated cluster application deployment method according to any one of claims 1 to 5.

10. A computer program product, characterized in that The computer program product includes a computer program, and when the computer program is executed by a processor, the automated cluster application deployment method according to any one of claims 1 to 5 is implemented.

Images