Cluster management method and device, equipment, storage medium and program product
By integrating the cluster management function into job flow and providing a front-end interface, users can trigger automatic cluster management operations with one click, solving the problems of cumbersome and inefficient cluster management in the existing technology, and achieving efficient cluster management.
Patent Information
- Application Number
- CN202411243910.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-05
- Publication Date
- 2025-01-03
AI Technical Summary
The existing cluster management methods require operation and maintenance personnel to carry out a lot of tedious and repetitive work, resulting in high management difficulty and low efficiency.
Integrate the cluster management function into different cluster management job flows, providing the implementation program and front-end interface of cluster management job flows. Users can configure and trigger job flow execution through the interface to automatically complete multiple cluster operations.
It reduces the difficulty of cluster management, improves management efficiency, reduces the hidden dangers of human error, and improves the accuracy and efficiency of management.
Smart Images

Figure CN119248474A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to computer technology, and in particular to a cluster management method, apparatus, device, storage medium and program product. Background Art
[0002] The rapid development of cloud platform technology has enabled enterprises to have more flexibility and efficiency in data processing and analysis. More and more enterprises are considering migrating to cloud platforms to reduce software and hardware costs and maintenance costs, and to speed up development and deployment. A cluster is a computing architecture used to process and store large-scale data. It is usually composed of multiple nodes. It processes and stores massive amounts of data through a group of interconnected nodes. Each node usually has its own storage and computing capabilities, and the nodes in the cluster jointly undertake data processing tasks. To ensure security, clusters are usually independently supplied to different enterprises or various business departments of large enterprises. However, clusters have many components, complex configurations, and often require security vulnerabilities to be fixed. Therefore, how to efficiently complete the installation, deployment, configuration maintenance, and vulnerability upgrades of multiple clusters has become a problem that every cloud vendor that provides cloud-based managed big data products must solve.
[0003] The current cluster management methods include manually configuring, managing, and maintaining the cluster by relevant operation and maintenance personnel, and using scripts to perform cluster configuration and deployment tasks.
[0004] However, the existing cluster management methods require relevant operation and maintenance personnel to perform a lot of tedious and repetitive work when managing and maintaining the cluster, resulting in high difficulty and low efficiency in cluster management. Summary of the invention
[0005] The present application provides a cluster management method, apparatus, device, storage medium and program product to reduce the difficulty of cluster management and improve the efficiency of cluster management.
[0006] In a first aspect, a cluster management method includes:
[0007] In response to a request to execute any cluster management function, display a cluster configuration interface corresponding to the cluster management function, wherein the cluster configuration interface is used to configure management configuration information of the target cluster;
[0008] In response to the cluster management instruction, the implementation program of the cluster management workflow corresponding to the cluster management function is run, and by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, multiple cluster operations are performed on the target cluster according to the management configuration information of the target cluster to complete the cluster management of the target cluster.
[0009] In a second aspect, the present application provides a cluster management device, including:
[0010] A front-end interaction module, configured to respond to a request to execute any cluster management function and display a cluster configuration interface corresponding to the cluster management function, wherein the cluster configuration interface is used to configure management configuration information of a target cluster;
[0011] The cluster supply module is used to respond to cluster management instructions, run the implementation program of the cluster management workflow corresponding to the cluster management function, and complete the cluster management of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs and performing multiple cluster operations on the target cluster according to the management configuration information of the target cluster.
[0012] In a third aspect, the present application provides an electronic device, including: a memory, a processor, and a transceiver;
[0013] The memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement the method as described in the first aspect above.
[0014] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method described in the first aspect above.
[0015] In a fifth aspect, the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the method described in the first aspect above.
[0016] The present application provides a method, device, equipment, storage medium and program product for cluster management. In the method, a cluster management server integrates various cluster management functions into different cluster management workflows, provides implementation programs of cluster management workflows corresponding to various cluster management functions, and provides a front-end interface. In response to a request to execute any cluster management function, the cluster management server displays a cluster configuration interface corresponding to the cluster management function, and the cluster configuration interface is used to configure the management configuration information of the target cluster. In response to a cluster management instruction, the cluster management server runs the implementation program of the cluster management workflow corresponding to the cluster management function, and performs multiple cluster operations on the target cluster according to the management configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, thereby realizing the cluster management function of the target cluster. After the user completes the configuration on the front-end interface, the execution of the cluster management workflow can be triggered with one click, and multiple cluster operations required for the cluster management function can be automatically completed. The user does not need to manually perform various cluster operations to realize various cluster management functions, thereby reducing the difficulty of cluster management and improving the efficiency of cluster management. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0018] Figure 1 A schematic diagram of a cluster management platform provided in an embodiment of the present application;
[0019] Figure 2 An architecture diagram of a cluster management system provided in an embodiment of the present application;
[0020] Figure 3 A schematic diagram of a cluster management method provided in an embodiment of the present application;
[0021] Figure 4 A flow chart of a cluster creation method provided for an exemplary embodiment of the present application;
[0022] Figure 5 A flow chart of a cluster scaling method provided for an exemplary embodiment of the present application;
[0023] Figure 6 A flow chart of a cluster expansion method provided for an exemplary embodiment of the present application;
[0024] Figure 7 A flow chart of a cluster version upgrade method provided for an exemplary embodiment of the present application;
[0025] Figure 8 A pre-processing flow chart before cluster version upgrade provided by an exemplary embodiment of the present application;
[0026] Fig. 9 A flow chart of cluster health monitoring provided for an exemplary embodiment of the present application;
[0027] Fig.10 A schematic diagram of a cluster management device provided in an embodiment of the present application;
[0028] Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0029] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0030] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0031] In the technical solution of this application, the collection, storage, use, processing, transmission, provision and disclosure of information such as financial data or user data involved shall comply with the provisions of relevant laws and regulations and shall not violate public order and good morals.
[0032] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.
[0033] First, the terms involved in this application are explained:
[0034] Cluster: A system consisting of a group of computers or devices (nodes) that work together to complete a specific task.
[0035] Big data cluster: A distributed system consisting of multiple computers (nodes) designed specifically for processing, storing, and analyzing large-scale data sets.
[0036] Cloud platform: An Internet-based computing service infrastructure that allows users to use computing resources, storage, network, database and other information technology (IT) services on demand without subscribing to and maintaining physical hardware.
[0037] Hadoop cluster: A distributed system consisting of multiple computers (nodes) designed to store and process large data sets.
[0038] Pan-Hadoop cluster: A distributed computing cluster that includes multiple components in the Hadoop ecosystem (such as HDFS, MapReduce, Spark, etc.), a system used to process, store, and analyze large-scale data.
[0039] Cloudification: Migrate traditional local computing, storage, and application services to cloud computing platforms to take advantage of the cloud's elasticity, scalability, and on-demand resource allocation.
[0040] Managed Hadoop: Outsource the deployment, management, and maintenance of the Hadoop cluster to a third-party service provider, who will be responsible for running and maintaining the cluster, allowing users to focus on data processing tasks.
[0041] Ambari: An open source tool for deploying, managing, and monitoring Hadoop clusters. It provides a user-friendly interface and automation functions to simplify the operation and maintenance management of the big data platform.
[0042] Cloud Virtual Machine (CVM): A scalable virtual server that supports multiple operating systems and application deployments. Users can flexibly configure computing resources according to their needs.
[0043] Infrastructure as a Service (IaaS): A cloud computing service model that provides virtualized computing resources, such as servers, storage, and networks, which users can configure and manage as needed.
[0044] Application Programming Interface (API): A tool that allows different software systems to communicate with each other and exchange data through predefined interfaces.
[0045] Representational State Transfer API (RESTful API for short): An application programming interface based on the REST (Representational State Transfer) architectural style, which communicates through the HTTP (Hypertext Transfer Protocol) protocol and uses standard HTTP methods such as GET (get resources), POST (create resources), PUT (update resources), and DELETE (delete resources) to operate resources on the server, and usually returns data in JSON or XML format.
[0046] Cloud Load Balancer (CLB): A cloud-based load balancing service that automatically distributes network traffic to improve system performance and availability.
[0047] The rapid development of cloud platform technology has given enterprises more flexibility and efficiency in data processing and analysis. More and more enterprises are considering migrating to cloud platforms to reduce software and hardware costs and maintenance costs, and speed up development and deployment. A cluster is a computing architecture for processing and storing large-scale data. It is usually composed of multiple nodes. A group of interconnected nodes work together to process and store massive data. Each node usually has its own storage and computing capabilities, and the nodes in the cluster jointly undertake data processing tasks. For example, pan-Hadoop cluster open source technologies such as Hadoop, Hive, Spark, HBase and Flink can complete the processing of various data needs of enterprises. In order to ensure security, clusters (such as pan-Hadoop clusters, etc.) are usually independently supplied to different enterprises or various business departments of large enterprises. However, clusters have many components, complex configurations, and often need to fix security vulnerabilities. Therefore, how to efficiently complete the installation, deployment, configuration maintenance and vulnerability upgrade of multiple clusters has become a problem that every cloud vendor that provides cloud-based managed big data products must solve.
[0048] The current cluster management methods include manually configuring, managing and maintaining clusters by relevant operation and maintenance personnel, and using scripts to perform cluster configuration and deployment tasks. However, the existing cluster management methods require relevant operation and maintenance personnel to perform a lot of tedious and repetitive work when performing various management and maintenance of clusters, resulting in high difficulty and low efficiency in cluster management.
[0049] In order to solve the above problems, a cluster management method is proposed in the embodiment of the present application, which integrates various cluster management functions into different cluster management workflows, provides implementation programs of cluster management workflows corresponding to various cluster management functions, and provides a front-end interface. Various cluster management functions are displayed through the front-end interface, and information configuration interfaces corresponding to various cluster management functions are provided. The user can select any cluster management function to be used, configure the target cluster to be managed, and implement the configuration information (i.e., cluster configuration information) required for the cluster management function. After completing the configuration of the cluster configuration information corresponding to the cluster management function, the user can send a cluster management instruction through the front-end interface to trigger the cluster management server to run the implementation program of the cluster management workflow corresponding to the cluster management function. During the operation process, the implementation program of the cluster management workflow performs multiple cluster operations on the target cluster according to the management configuration information of the target cluster by calling the cluster operation interface provided by the cloud platform to which the target cluster belongs, and completes the cluster management of the target cluster. After the user completes the configuration on the front-end interface, he can trigger the execution of the cluster management workflow with one click, automatically complete the multiple cluster operations required for the cluster management function, and the user does not need to manually perform various cluster operations to implement various cluster management functions, thereby reducing the difficulty of cluster management and improving the efficiency of cluster management.
[0050] Among them, the cluster management functions that can be implemented in this application include but are not limited to: cluster creation, cluster shrinking, cluster expansion, and cluster version upgrade. Among them, the implementation of a single cluster management function requires the execution of multiple cluster operations. The cloud platform provides interfaces for various cluster operations, and the cluster management server can implement the corresponding cluster operations by calling the cluster operation interface. For example, the implementation of the cluster creation function requires the execution of cluster operations such as creating cluster nodes, initializing cluster nodes, and deploying cluster service components. The implementation of the cluster shrinking function requires cluster operations such as evaluating the current load of the cluster, migrating cluster node data and tasks, and removing cluster nodes. The implementation of the cluster expansion function requires cluster operations such as creating expansion nodes, initializing expansion nodes, deploying cluster service components to expansion nodes, and adding expansion nodes to the target cluster to be expanded. The implementation of the cluster version upgrade function requires cluster operations such as creating a verification cluster, injecting base data into the verification cluster, deploying a new version of cluster service components to the verification cluster, and deploying a new version of cluster service components to the target cluster.
[0051] Figure 1 A scenario diagram of a cluster management system provided in an embodiment of the present application includes a terminal device, a cluster management server and a cloud platform, wherein a communication link is provided between the terminal device and the cluster management server, and a communication line is provided between the cluster management server and the cloud platform.
[0052] The end-side device can be an electronic device running the client of the cluster management system, and can be a hardware device with network communication function, computing function and information display function, including but not limited to smart phones, tablet computers, desktop computers, local servers, cloud servers, etc. The end-side device runs the client of the cluster management system and displays the front-end interface provided by the cluster management system to the customer. The customer configures the information through the displayed front-end interface, and triggers the end-side device to send any cluster management function request and cluster management instruction to the cluster management server.
[0053] The cloud platform provides the resources required for cluster operation, management and maintenance, including but not limited to virtual machines, storage, networks and other infrastructure components. The cloud platform provides a cluster operation interface to the outside world. Various operations on the cluster can be implemented by calling the cluster operation interface. For example, the cluster operation interface includes the following categories: computing resource interface, storage interface, network interface, node management interface, load balancing interface, resource expansion and reduction interface, and configuration management interface. Among them, the computing resource interface is used to manage virtual machines, virtual machine images, virtual machine automatic scaling, etc.; the storage interface is used to manage block storage, object storage interface, file storage, etc.; the network interface is used to configure virtual networks, security groups and firewalls, load balancing, etc.
[0054] The cluster management server is a device with computing capabilities deployed in the cloud or locally, such as a cloud server. The cluster management server provides implementation programs for cluster management workflows corresponding to various cluster management functions, and provides a front-end interface. During the operation of the cluster management workflow implementation program, multiple cluster operations required to perform the corresponding cluster management functions are automatically implemented.
[0055] Figure 2 This is an architecture diagram of a cluster management system provided in an embodiment of the present application. Figure 2 As shown, the cluster management system includes a front-end interface, a cluster management server, a cloud platform, a cluster, a database, and a software package library. The cloud platform may be an IaaS (Infrastructure as a Service) cloud platform.
[0056] Among them, there are communication lines between the cluster management server and the cloud platform, database, and software package library, there are communication lines between the cloud platform and the cluster, and there are communication links between the cluster and the software package library.
[0057] In actual applications, the cluster management server provides a front-end interface to the end-side device. The end-side device displays the front-end interface. Users can configure the cluster configuration information required for various cluster management functions through the front-end interface. When the user submits the front-end interface, the end-side device sends the cluster configuration information configured by the user through the front-end interface to the cluster management server.
[0058] The database is used to store the job flow information, management configuration information and other information required to implement the cluster management function, such as the cluster health management rule information. The cluster management server can store or read the information required to implement the cluster management function by interacting with the database. The software package library is used to store cluster service components. The cluster management server can add cluster service components to the software package library, and the cluster can obtain the required cluster service components from the software package library.
[0059] like Figure 2 As shown, the cluster management server includes the following functional modules:
[0060] The cluster provisioning module provides implementation programs for cluster management workflows corresponding to various cluster management functions, and provides external APIs for implementation programs for cluster management workflows, including APIs for implementation programs for cluster creation, cluster shrinking, cluster expansion, cluster version upgrades, and other cluster management workflows. The cluster provisioning module is also responsible for receiving cluster management instructions from the front-end interface; it has the ability to call multiple cluster operation interfaces provided by the cloud platform to implement various cluster management workflows; it has the ability to execute multiple cluster management workflows simultaneously. The API for the implementation program here can use a RESTful API or other types of APIs, which are not specifically limited in this embodiment.
[0061] The configuration management module manages configuration information and version information, can track configuration modification records, support rollback and comparison of different versions of configurations, and combines with the permission authentication module to ensure that only authorized users can access and modify configuration information.
[0062] The permission authentication module implements the management system of user identity authentication, roles and permissions, divides users into different roles, assigns corresponding permissions to each role, and defines permissions that can perform operations such as configuration management and cluster management functions.
[0063] The operation monitoring module is responsible for monitoring the operation status of the cluster, which may include system resource usage, cluster service component status, job operation status, network status, etc. It also maintains a rule base for formulating cluster health check rules, which can perform health check tasks regularly and feedback problems to relevant system maintenance personnel.
[0064] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0065] Figure 3 The flowchart of a cluster management method provided in the embodiment of the present application is shown in FIG. The execution subject of the present embodiment is a cluster management server. Figure 3 As shown, the method includes:
[0066] S301: In response to a request to execute any cluster management function, a cluster configuration interface corresponding to the cluster management function is displayed, where the cluster configuration interface is used to configure management configuration information of a target cluster.
[0067] The request to execute any cluster management function refers to a request sent to the cluster management server when any cluster management function displayed on the front-end interface is selected and triggered for execution.
[0068] In actual applications, cluster management functions may include cluster creation, cluster scaling, cluster expansion, cluster version upgrade, etc. Users can select any cluster management function as the cluster management function that needs to be executed currently. Users can trigger the execution of the selected cluster management function by clicking or other operations, so that the terminal device sends a request to the cluster management server to execute the corresponding cluster management function.
[0069] In response to receiving a request to execute any cluster management function, the cluster management server provides the terminal device with a cluster configuration interface corresponding to the cluster management function. The terminal device displays the cluster configuration interface corresponding to the cluster management function. In the cluster configuration interface corresponding to the cluster management function, the user can select the target cluster on which the cluster management function needs to be executed, and configure the management configuration information of the target cluster. The target cluster refers to the cluster on which the cluster management function is to be executed.
[0070] For example, if the cluster management function selected by the user is cluster creation, the front-end page displays the cluster creation configuration interface. The user can create one or more target clusters to be created, and configure the cluster creation configuration information of the target cluster. The cluster creation configuration information may include: the cluster name of the target cluster, the cluster topology, the cluster type, the node configuration, the network configuration, the information of the cloud platform selected, the cluster service component configuration, etc.
[0071] Exemplarily, if the cluster management function selected by the user is cluster shrinking, the front page displays the cluster shrinking configuration interface. The user can select one or more target clusters to be shrunk and configure the cluster shrinking configuration information of the target clusters. The cluster shrinking configuration information may include: the cluster name of the target cluster, the cluster node group to be deleted, etc.
[0072] For example, if the cluster management function selected by the user is cluster expansion, the front-end page displays the cluster expansion configuration interface. The user can select one or more target clusters to be expanded and configure the cluster expansion configuration information of the target clusters. The cluster expansion configuration information may include: the cluster name of the target cluster, the cluster node group to be added, etc.
[0073] Exemplarily, if the cluster management function selected by the user is cluster version upgrade, the front-end page displays the cluster version upgrade configuration interface. The user can select one or more target clusters to be upgraded and configure the cluster version upgrade configuration information of the target clusters. The cluster version upgrade configuration information may include: the cluster name of the target cluster, the type of cluster service component to be upgraded, the initial version number of the cluster service component, the target version number, etc. Among them, the cluster version upgrade refers to the version update of each cluster service component in the cluster node.
[0074] S302: In response to the cluster management instruction, run the implementation program of the cluster management workflow corresponding to the cluster management function, and perform multiple cluster operations on the target cluster according to the management configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, thereby completing the cluster management of the target cluster.
[0075] The cluster management instruction refers to an instruction to submit the management configuration information to the cluster management server after completing the configuration of the management configuration information of the target cluster. The cluster management instruction includes the cluster management function to be executed and the management configuration information of the target cluster.
[0076] In response to the received cluster management instruction, the cluster management server obtains the management configuration information of the target cluster and runs the implementation program of the cluster management workflow corresponding to the cluster management function to be executed. During the operation of the implementation program of the cluster management workflow, multiple cluster operations are performed on the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, so as to automatically realize the cluster management of the target cluster.
[0077] The cluster management server provides the API of the cluster management workflow corresponding to each cluster management function, that is, the API of the implementation program of the cluster management workflow corresponding to each cluster management function. The cluster management instruction can be a call request of the end-side device to the API of the workflow corresponding to any cluster management function. The call request contains the management configuration information of the target cluster.
[0078] Exemplarily, if the cluster management function to be executed is cluster creation, the terminal device submits cluster creation configuration information to the cluster management server by calling the API of the cluster creation workflow provided by the cluster management server. In response to receiving the call request of the API of the cluster creation workflow, the cluster management server runs the implementation program of the cluster creation workflow according to the cluster creation configuration information to automatically create the target cluster.
[0079] Exemplarily, if the cluster management function to be executed is cluster scaling, the terminal device submits cluster scaling configuration information to the cluster management server by calling the API of the cluster scaling workflow provided by the cluster management server. In response to receiving the call request of the API of the cluster scaling workflow, the cluster management server runs the implementation program of the cluster scaling workflow according to the cluster scaling configuration information to automatically scale down the target cluster.
[0080] Exemplarily, if the cluster management function to be executed is cluster expansion, the terminal device submits cluster expansion configuration information to the cluster management server by calling the API of the cluster expansion workflow provided by the cluster management server. In response to receiving the call request of the API of the cluster expansion workflow, the cluster management server runs the implementation program of the cluster expansion workflow according to the cluster expansion configuration information to automatically expand the target cluster.
[0081] Exemplarily, if the cluster management function to be executed is a cluster version upgrade, the terminal device submits the cluster version upgrade configuration information to the cluster management server by calling the API of the cluster version upgrade workflow provided by the cluster management server. In response to receiving the call request of the API of the cluster version upgrade workflow, the cluster management server runs the implementation program of the cluster version upgrade workflow according to the cluster version upgrade configuration information, and automatically implements the version upgrade of the target cluster.
[0082] The cluster operation interface refers to the interface provided by the cloud platform to implement various operations for the cluster. Among them, the various operations for the cluster may include creating cluster nodes, initializing cluster nodes, deploying cluster service components, etc. When the cluster management server runs the implementation program of the cluster management workflow corresponding to the cluster management function, it calls one or more of the cluster operation interfaces provided by the cloud platform to which the target cluster belongs to implement the cluster management function. Among them, the cluster operation interface may include computing resource interface, storage interface, network interface, node management interface, load balancing interface, resource expansion and reduction interface, configuration management interface, etc.
[0083] Optionally, when the end-side device sends configuration information to the cluster management server, the configuration information can be integrated into a message in JSON format and sent to the cluster management server as an input parameter when calling the cluster management workflow API provided by the cluster management server. After receiving the message, the cluster management server extracts the configuration information by parsing the message.
[0084] In the embodiment of the present application, the cluster management server integrates various cluster management functions into different cluster management workflows, provides implementation programs of cluster management workflows corresponding to various cluster management functions, and provides a front-end interface. In response to a request to execute any cluster management function, the cluster management server displays a cluster configuration interface corresponding to the cluster management function, and the cluster configuration interface is used to configure the management configuration information of the target cluster. In response to the cluster management instruction, the cluster management server runs the implementation program of the cluster management workflow corresponding to the cluster management function, and performs multiple cluster operations on the target cluster according to the management configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, thereby realizing the cluster management function of the target cluster. After the user completes the configuration on the front-end interface, the execution of the cluster management workflow can be triggered with one click, and multiple cluster operations required for the cluster management function can be automatically completed. The user does not need to manually perform various cluster operations to realize various cluster management functions, thereby reducing the difficulty of cluster management and improving the efficiency of cluster management. In addition, since the implementation and completion of various cluster functions are achieved by running the cluster management workflow implementation program corresponding to the cluster management function, the manual operation of creating a cluster is greatly simplified. The standardized workflow also reduces the hidden dangers caused by human errors and avoids possible human errors in the cluster management process.
[0085] In actual applications, in order to ensure the security and compliance of cluster management operations, user permission verification is required before executing any cluster management operation. Only after confirming that the current user has the permission to perform the current cluster management function on the target cluster can the subsequent steps be continued to implement the cluster management of the target cluster.
[0086] Exemplarily, before using various functions for managing the cluster, the user needs to log in to the cluster management system. Exemplarily, the users who log in to the front-end page can be divided into three levels: the first level, the general administrator, has the authority to use all cluster functions; the second level, the administrator, has the authority to use one or more but not all cluster functions; the third level, the ordinary user, only has the authority to view cluster functions and status.
[0087] Optionally, before performing multiple cluster operations on the target cluster according to the management configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs to complete the cluster management of the target cluster, the method further includes:
[0088] Verify that the current user has the permissions to manage the cluster.
[0089] In this embodiment, before executing the cluster management workflow corresponding to the cluster management function requested by the user, the cluster management server will first extract the user's identity information (such as user ID, user level) and operation request information (such as operation type, target cluster); then obtain the user's cluster management permission information based on the user's identity information, and determine whether the user has the permission for the current cluster management function based on the user's cluster management permission information. If the user does not have the permission for the current cluster management function, the cluster management server will no longer execute the corresponding cluster management workflow and return a response of refusal to execute. If the user has the permission for the current cluster management function, the cluster management server will continue to execute the corresponding cluster management workflow.
[0090] In the embodiment of the present application, through the management of user cluster management permissions, users can only use cluster management functions for which they have usage permissions, thereby enhancing the security of cluster management.
[0091] Figure 4 A flow chart of a cluster creation method provided by an exemplary embodiment of the present application. In an optional embodiment, the cluster management function is cluster creation, such as Figure 4 As shown in the figure, the specific process of cluster creation includes:
[0092] S401: In response to a cluster creation request, display a cluster creation configuration interface, where the cluster creation configuration interface is used to configure cluster creation configuration information of a target cluster to be created.
[0093] In this embodiment, the cluster management function currently required to be executed is the cluster creation function. In response to receiving a request to execute the cluster creation function, the cluster management server provides a cluster creation configuration interface to the terminal device. The terminal device displays the cluster creation configuration interface corresponding to the cluster creation function. In the cluster creation configuration interface corresponding to the cluster creation function, the user can select one or more target clusters for which the cluster creation function needs to be executed, and configure the cluster creation configuration information of the target clusters.
[0094] The cluster creation configuration information of the target cluster may include at least one of the following: cluster name, cluster topology, cluster type, node configuration, network configuration, information of the selected cloud platform, cluster service component configuration, etc.
[0095] The cluster name is a unique identifier for identifying a cluster, which can help users quickly identify a target cluster among multiple clusters. For example, the cluster name can be a string containing at least one of Chinese characters, numbers, and letters.
[0096] The cluster topology includes the connection method between each node in the cluster. There are many cluster topologies, such as star topology, bus topology, ring topology, etc. Users can configure the cluster topology of the target cluster according to specific application requirements and performance requirements.
[0097] Cluster types can be divided according to the purpose of the cluster, including big data clusters, computing clusters, storage clusters, container clusters, etc. Among them, big data clusters are used to analyze big data, computing clusters are used for high-performance computing tasks, storage clusters are used to provide large-capacity and reliable storage services, and container clusters are used to deploy and manage containerized applications. In addition, cluster types can also be divided in other ways. Users can choose the appropriate cluster type based on specific application requirements and performance requirements.
[0098] The node configuration includes the hardware and software specification configuration of each cluster node. The node configuration content may include the CPU (Central Processing Unit) of the cluster node, the number of nodes, the storage type and capacity of the node, the operating system, etc.
[0099] Network configuration includes the network connection method between cluster nodes and its related security settings. The network configuration content can include VPC, subnet, security group, load balancer, etc.
[0100] The information of the cloud platform selected refers to the cloud computing platform / system used to host and manage the cluster. Users can consider the geographical location of the cluster deployment, the services and tools provided by each cloud platform, etc. to select a cloud platform that meets their needs.
[0101] The cluster service component configuration includes the settings of the software services running in each cluster node. For example, if the cluster type is configured as a big data cluster, the content of the cluster service component configuration may include a big data framework, and other applications or services running on the cluster with the big data framework as the core.
[0102] S402: In response to the cluster creation instruction, run the implementation program of the cluster creation workflow, by calling multiple cluster operation interfaces provided by the cloud platform, create cluster nodes for the target cluster on the cloud platform according to the cluster creation configuration information of the target cluster, initialize the cluster nodes, and deploy the cluster service components to the cluster nodes, thereby completing the creation of the target cluster on the cloud platform.
[0103] The cluster creation instruction refers to an instruction to submit the cluster creation configuration information to the cluster management server after completing the configuration of the cluster creation configuration information of the target cluster. The cluster creation instruction includes the cluster creation function to be executed and the cluster creation configuration information of the target cluster.
[0104] In response to the received cluster creation instruction, the cluster management server obtains the cluster creation configuration information of the target cluster and runs the implementation program of the cluster creation workflow corresponding to the cluster creation function to be executed. During the running process of the implementation program of the cluster creation workflow, according to the information of the cloud platform selected in the cluster creation configuration information, multiple cluster operation interfaces provided by the selected cloud platform are called, multiple cluster operations are performed on the target cluster, and the cluster creation of the target cluster is automatically realized.
[0105] Exemplarily, according to the information of the cloud platform selected for use in the cluster creation configuration information, the node management interface and configuration management interface provided by the selected cloud platform are called, and according to the cluster creation configuration information, cluster nodes are created, cluster nodes are initialized, and cluster service components are deployed to the cluster nodes. Among them, the cluster node of the target cluster can be a CVM provided by the cloud platform. When creating a cluster node, it is necessary to create the memory, CPU, storage space, etc. of the CVM; initializing the cluster node includes initializing the operating system, network configuration, necessary software packages, etc. of the CVM, wherein the necessary software packages refer to software components that are crucial for the normal operation of the cluster, resource management, task scheduling and data processing, and the necessary software packages may include network tools, compilation tools, file management tools, etc.; deploying cluster service components to cluster nodes may include deploying big data frameworks, other service components, etc. to the CVM.
[0106] In an embodiment of the present application, the cluster management server integrates the cluster creation function into a cluster creation workflow, provides an implementation program for the cluster creation workflow, and provides a cluster creation configuration interface. In response to a request to execute the cluster creation function, the cluster management server displays the cluster creation configuration interface corresponding to the cluster creation function, and the cluster creation configuration interface is used to configure the cluster creation configuration information of the target cluster. In response to the cluster creation instruction, the cluster management server runs the implementation program of the cluster creation workflow corresponding to the cluster management function, and performs multiple cluster operations on the target cluster according to the cluster creation configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, such as creating CVM, initializing CVM, deploying cluster service components on cluster nodes, etc., to realize the cluster creation function of the target cluster. After completing the configuration of the cluster creation configuration information, the user can trigger the execution of the cluster creation workflow with one click, automatically completing multiple cluster operations required for the cluster creation function, and the user does not need to manually perform various cluster operations, which reduces the difficulty of cluster creation and improves the efficiency of cluster creation.
[0107] In actual applications, in order to ensure the security and compliance of cluster creation operations, user permission verification is required before cluster creation is executed. Only after confirming that the current user has the permission to create the target cluster can the subsequent steps be continued to create the target cluster.
[0108] Optionally, before the process of selecting a cloud platform to be used in the cluster creation configuration information and calling multiple cluster operation interfaces provided by the selected cloud platform, creating cluster nodes for the target cluster on the selected cloud platform, initializing the cluster nodes, and deploying cluster service components on the cluster nodes, and completing the creation of the target cluster on the cloud platform, the process further includes:
[0109] Verify that the current user has permission to create a cluster.
[0110] The cluster management server first verifies the user's permissions. After the verification is passed, it requests to obtain the cluster creation configuration information, and then performs subsequent cluster creation operations based on the cluster creation configuration information.
[0111] Exemplarily, a user logs in to the cluster management system, and after selecting the cluster creation function, the system outputs the cluster creation configuration interface. The user can configure and submit the cluster creation configuration information in the cluster creation configuration interface. The end-side device integrates the cluster creation configuration information into a message in json format, and submits it to the cluster provisioning module through the API provided by the cluster provisioning module. The cluster provisioning module first requests the authority authentication module to verify the user's authority; after the verification is passed, the cluster provisioning module requests the configuration management module to obtain the cluster creation configuration information, and runs the implementation program of the cluster creation job flow corresponding to the cluster creation function, calling multiple cluster operation interfaces provided by the cloud platform to implement cluster creation.
[0112] In the embodiments of the present application, through permission verification, it is possible to better control which users can create a cluster, ensuring that only authorized users can create a cluster. This helps prevent unauthorized users from abusing or misusing resources. Creating a cluster usually takes up a lot of computing, storage and network resources. Limiting user permissions can prevent unnecessary resource consumption, thereby controlling costs.
[0113] Figure 5 A flow chart of a cluster shrinking method provided by an exemplary embodiment of the present application. In an optional embodiment, the cluster management function is cluster shrinking, such as Figure 5 As shown in the figure, the specific process of cluster scaling includes:
[0114] S501: In response to a cluster shrinking request, display a cluster shrinking configuration interface, where the cluster shrinking configuration interface is used to select at least one target cluster to be shrunk and configure shrinking configuration information of the at least one target cluster.
[0115] In this embodiment, the cluster management function currently required to be executed is the cluster shrinking function. In response to receiving a request to execute the cluster shrinking function, the cluster management server provides a cluster shrinking configuration interface to the end-side device. The end-side device displays the cluster shrinking configuration interface corresponding to the cluster shrinking function. The user can select one or more target clusters on which the cluster shrinking function needs to be executed in the cluster shrinking configuration interface corresponding to the cluster shrinking function, and configure the cluster shrinking configuration information of the target cluster.
[0116] The cluster scaling-down configuration information of the target cluster may include at least one of the following: the cluster name of the target cluster, the cluster node group to be deleted, and the like.
[0117] The cluster name of the target cluster to be shrunk is used to determine the target cluster to be shrunk to avoid affecting other clusters due to erroneous operations. The cluster node group to be deleted is used to determine the specific node group to be removed during the scaling process to ensure accurate operations and avoid affecting other node groups.
[0118] S502: In response to the cluster scaling-in instruction, the implementation program of the cluster scaling-in job flow is run, and by calling multiple cluster operation interfaces provided by the cloud platform, data of the target cluster is rebalanced according to the scaling-in configuration information of the target cluster, and the services of the scaling-in nodes are removed from the target cluster. A data integrity check is performed, and the scaling-in nodes are released after the data integrity check passes, thereby completing the scaling-down of the target cluster.
[0119] The cluster shrinking instruction refers to an instruction to submit the cluster shrinking configuration information to the cluster management server after completing the configuration of the cluster shrinking configuration information of the target cluster. The cluster shrinking instruction includes the cluster shrinking function to be executed and the cluster shrinking information of the target cluster.
[0120] Data rebalancing refers to the redistribution of data to different nodes or storage units to ensure uniform data distribution, optimized access performance, and efficient use of storage resources. The data rebalancing process includes developing a plan to redistribute data to different nodes based on the amount of data in the cluster, the storage capacity of the nodes, and the computing power. Then, the services of the cluster node group to be deleted are removed from the target cluster, and the data integrity check is performed on the data in the cluster node group to be released to ensure that the data is not damaged, lost, or tampered with during transmission, storage, or processing.
[0121] In response to the received cluster scaling-in instruction, the cluster management server obtains the cluster scaling-in configuration information of the target cluster and runs the implementation program of the cluster scaling-in job flow corresponding to the cluster scaling-in function to be executed. During the running process of the implementation program of the cluster scaling-in job flow, multiple cluster operations are performed on the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, so as to automatically achieve cluster scaling-in of the target cluster.
[0122] Exemplarily, the user selects the cluster scaling function, selects one or more target clusters to be scaled down, and sends the cluster scaling configuration information of the target cluster to the cluster management server through the RESTful API provided by the cluster management server. The cluster management server first requests data rebalancing for the target cluster, removes the services of the cluster nodes to be deleted, and performs data integrity verification. After the verification passes, the cluster management server requests the cloud platform to which the target cluster belongs to destroy the cluster nodes to be deleted, thereby completing the cluster scaling process.
[0123] In an embodiment of the present application, the cluster management server integrates the cluster shrinking function into a cluster shrinking operation flow, provides an implementation program of the cluster shrinking operation flow, and provides a cluster shrinking configuration interface. In response to a request to execute the cluster shrinking function, the cluster management server displays the cluster shrinking configuration interface corresponding to the cluster shrinking function, and the cluster shrinking configuration interface is used to configure the cluster shrinking configuration information of the target cluster. In response to the cluster shrinking instruction, the cluster management server runs the implementation program of the cluster shrinking operation flow corresponding to the cluster management function, and performs multiple cluster operations on the target cluster according to the cluster shrinking configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, such as rebalancing data on the target cluster, removing shrinking nodes from the target cluster, etc., to realize the cluster shrinking function of the target cluster. After the user completes the configuration on the front-end interface, the execution of the cluster shrinking operation flow can be triggered with one click, and the multiple cluster operations required for the cluster shrinking function can be automatically completed. The user does not need to manually perform various cluster operations, which reduces the difficulty of cluster shrinking and improves the efficiency of cluster shrinking.
[0124] In actual applications, in order to ensure the security and compliance of cluster scaling operations, user permission verification is required before executing cluster scaling. Only after confirming that the current user has the permission to scale down the target cluster can subsequent steps be continued to achieve scaling down the target cluster.
[0125] Optionally, according to the cluster scaling-down configuration information of the target cluster, data of the target cluster is rebalanced on the cloud platform to which the target cluster belongs, services of the scaled-down nodes are removed from the target cluster, data integrity verification is performed on the target cluster, and the scaled-down nodes are released after the data integrity verification passes. Before scaling down the target cluster on the cloud platform is completed, the following is further included:
[0126] Verify that the current user has permission to shrink the cluster.
[0127] The cluster management server first verifies the user's permissions. After the verification is passed, it requests to obtain the cluster shrinking configuration information, and then performs subsequent cluster shrinking operations based on the cluster shrinking configuration information.
[0128] Exemplarily, a user logs in to the cluster management system, and after selecting the cluster shrinking function, the system outputs the cluster shrinking configuration interface. The user can configure and submit the cluster shrinking configuration information in the cluster shrinking configuration interface. The end-side device integrates the cluster shrinking configuration information into a message in json format, and submits it to the cluster supply module through the API provided by the cluster supply module. The cluster supply module first requests the authority authentication module to verify the user's authority; after the verification passes, the cluster supply module requests the configuration management module to obtain the cluster shrinking configuration information, and runs the implementation program of the cluster shrinking job flow corresponding to the cluster shrinking function. In the implementation program of the cluster shrinking job flow, the cluster supply module requests the cloud platform to rebalance the data of the target cluster, remove the services on the shrinking node in the target cluster, and perform a data integrity check on the target cluster after removing the services on the shrinking node. After the data integrity check passes, the cluster supply module requests the cloud platform to which the target cluster belongs to destroy the CVM of the shrinking node to achieve cluster shrinking.
[0129] In the embodiment of the present application, permission verification is performed to ensure that only authorized users can perform scaling operations, thereby preventing cluster instability caused by incorrect operations. By limiting scaling permissions, unnecessary or excessive scaling operations are prevented, thereby optimizing resource management.
[0130] Figure 6 A flow chart of a cluster expansion method provided by an exemplary embodiment of the present application. In an optional embodiment, the cluster management function is cluster shrinking, such as Figure 6 As shown in the figure, the specific process of cluster expansion includes:
[0131] S601: In response to a cluster expansion request, display a cluster expansion configuration interface, where the cluster expansion configuration interface is used to select at least one target cluster to be expanded and configure expansion configuration information of the at least one target cluster.
[0132] In this embodiment, the cluster management function currently required to be executed is the cluster expansion function. In response to receiving a request to execute the cluster expansion function, the cluster management server provides a cluster expansion configuration interface to the terminal device. The terminal device displays the cluster expansion configuration interface corresponding to the cluster expansion function. The user can select one or more target clusters that need to execute the cluster expansion function in the cluster expansion configuration interface corresponding to the cluster expansion function, and configure the cluster expansion configuration information of the target cluster.
[0133] The cluster expansion configuration information of the target cluster may include at least one of the following: a cluster name, a cluster node group to be added, and the like.
[0134] The cluster name of the target cluster to be expanded is used to determine the target cluster to be expanded, and the cluster node group to be added is used to determine the specific node group to be added during expansion.
[0135] S602: In response to the cluster expansion instruction, run the implementation program of the cluster expansion workflow, by calling multiple cluster operation interfaces provided by the cloud platform, according to the expansion configuration information of the target cluster, create an expansion node for the target cluster on the cloud platform, initialize the expansion node, deploy the cluster service components to the expansion node, and add the expansion node to the target cluster to complete the expansion of the target cluster.
[0136] The cluster expansion instruction refers to an instruction to submit the cluster expansion configuration information to the cluster management server after completing the configuration of the cluster expansion configuration information of the target cluster. The cluster expansion instruction includes the cluster expansion function to be executed and the cluster expansion information of the target cluster.
[0137] In response to the received cluster expansion instruction, the cluster management server obtains the cluster expansion configuration information of the target cluster and runs the implementation program of the cluster expansion workflow corresponding to the cluster expansion function to be executed. During the operation of the implementation program of the cluster expansion workflow, multiple cluster operations are performed on the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, so as to automatically realize the cluster expansion of the target cluster.
[0138] Exemplarily, the user selects the cluster expansion function, selects one or more target clusters to be expanded, and sends the cluster expansion configuration information of the target cluster to the cluster management server through the RESTful API provided by the cluster management server. The cluster management server requests the cloud platform to which the target cluster belongs to create the cluster node to be added and initialize and deploy the cluster service components, thereby completing the cluster reduction process. Among them, the process of creating the cluster node to be added and initializing and deploying the cluster service components can be compared to the process of cluster creation.
[0139] In the embodiment of the present application, the cluster management server integrates the cluster expansion function into a cluster expansion operation flow, provides an implementation program of the cluster expansion operation flow, and provides a cluster expansion configuration interface. In response to the request to execute the cluster expansion function, the cluster management server displays the cluster configuration interface corresponding to the cluster expansion function, and the cluster configuration interface is used to configure the cluster expansion configuration information of the target cluster. In response to the cluster expansion instruction, the cluster management server runs the implementation program of the cluster expansion operation flow corresponding to the cluster management function, and performs multiple cluster operations on the target cluster according to the cluster expansion configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, such as creating an expansion node, initializing the expansion node, deploying the cluster service component to the expansion node, adding the expansion node to the target cluster, etc., to realize the cluster expansion function of the target cluster. After the user completes the configuration on the front-end interface, the execution of the cluster expansion operation flow can be triggered by one click, and the multiple cluster operations required for the cluster expansion function can be automatically completed. The user does not need to manually perform various cluster operations, which reduces the difficulty of cluster expansion and improves the efficiency of cluster expansion.
[0140] In actual applications, in order to ensure the security and compliance of cluster expansion operations, user permission verification is required before executing cluster expansion. Only after confirming that the current user has the permission to expand the target cluster can the subsequent steps be continued to achieve the expansion of the target cluster.
[0141] Optionally, according to the cluster expansion configuration information of the target cluster, an expansion node is created for the target cluster on the cloud platform to which the target cluster belongs, the expansion node is initialized, the cluster service component is deployed on the expansion node, and the expansion node is added to the target cluster. Before completing the expansion of the target cluster on the cloud platform, the following steps are further included:
[0142] Verify that the current user has permission to expand the cluster.
[0143] The cluster management server first verifies the user's permissions. After the verification is passed, it requests to obtain the cluster expansion configuration information, and then performs subsequent cluster expansion operations based on the cluster expansion configuration information.
[0144] Exemplarily, a user logs in to the cluster management system, and after selecting the cluster expansion function, the system outputs the cluster expansion configuration interface. Users can configure and submit cluster expansion configuration information in the cluster expansion configuration interface. The end-side device integrates the cluster expansion configuration information into a message in json format, and submits it to the cluster supply module through the API provided by the cluster supply module; the cluster supply module first requests the authority authentication module to verify the user's authority; after the verification, the cluster supply module requests the configuration management module to obtain the cluster expansion configuration information, and runs the implementation program of the cluster reduction job flow corresponding to the cluster expansion function. In the implementation program of the cluster expansion job flow, the cluster supply module requests the cloud platform to create a new CVM, initialize the new CVM, deploy cluster service components to the new CVM, etc., and add the expansion node to the target cluster to achieve cluster expansion.
[0145] In the embodiment of the present application, permission verification is performed to ensure that only users with sufficient knowledge and permissions can perform expansion operations, thereby preventing cluster instability caused by incorrect operations. By limiting expansion permissions, unnecessary or excessive expansion operations are prevented, thereby optimizing resource management.
[0146] Figure 7 A flow chart of a cluster version upgrade method provided by an exemplary embodiment of the present application. In an optional embodiment, the cluster management function is a cluster version upgrade. Figure 7 As shown in the figure, the specific process of cluster version upgrade includes:
[0147] S701: In response to a cluster version upgrade request, display a cluster version upgrade configuration interface, where the cluster version upgrade configuration interface is used to configure an initial version number and a target version number.
[0148] In this embodiment, the cluster management function currently required to be executed is the cluster version upgrade function. In response to receiving a request to execute the cluster version upgrade function, the cluster management server provides a cluster version upgrade configuration interface to the terminal device. The terminal device displays the cluster version upgrade configuration interface corresponding to the cluster version upgrade function. The user can select one or more target clusters that need to execute the cluster version upgrade function in the cluster version upgrade configuration interface corresponding to the cluster version upgrade function, and configure the cluster version upgrade configuration information of the target cluster.
[0149] The cluster version upgrade configuration information of the target cluster may include at least one of the following: the cluster name of the target cluster, the type of cluster service component to be upgraded, the initial version number of the cluster service component, the target version number of the cluster service component, etc.
[0150] S702: Acquire a matching incremental upgrade software package from a software package library according to the initial version number and the target version number.
[0151] Among them, the initial version number refers to the version number of the software package originally installed on the target cluster, and the target version number refers to the version number of the new software package that needs to be installed on the target cluster. The incremental upgrade software package is the software package required to upgrade the software package with the initial version number to the software package with the target version number. Optionally, the incremental upgrade software package can be the incremental part of the software package with the target version number compared to the software package with the initial version number. Optionally, the incremental upgrade software package can also be the software package with the target version number, and the upgrade can be completed by replacing the software package with the initial version number with the software package with the target version number. In this embodiment, the software package library stores multiple versions of software packages, which can be installed and used by cluster nodes.
[0152] In this step, if the incremental upgrade software package is the incremental part of the software package of the target version number compared with the software package of the initial version number, then according to the initial version number and the target version number, the incremental upgrade software package matching the initial version number and the target version number is searched in the software package library. If the incremental upgrade software package is the software package of the target version number, then according to the target version number, the software package corresponding to the target version number is obtained from the software package library.
[0153] S703: Run the plug-in program to upgrade the target cluster using the incremental upgrade software package.
[0154] In this step, the incremental upgrade software package is deployed to the target cluster by running the plug-in program to upgrade the software package of the target cluster.
[0155] In an optional embodiment, the incremental upgrade software package is an incremental part of the software package with the target version number compared to the software package with the initial version number. In this step, by running the plug-in program, the incremental upgrade software package is incrementally deployed on the basis of the software package with the initial version number running on the target cluster, so that the target cluster runs the software package with the target version number. The plug-in program can be developed by relevant technical personnel according to actual application requirements, and has the implementation logic of incremental deployment of incremental upgrade software packages.
[0156] In an optional embodiment, the incremental upgrade software package is a complete software package of the target version number. In this step, the incremental upgrade software package is deployed to the target cluster by running the plug-in program to replace the original software package of the initial version number.
[0157] In an optional embodiment, plug-ins and incremental upgrade software packages used by various cluster version upgrade workflows can be pre-created through a pre-processing process. Plug-ins corresponding to various cluster version upgrade workflows are stored locally, and incremental upgrade software packages corresponding to various cluster version upgrade workflows are stored in a software package library.
[0158] In the embodiment of the present application, the incremental upgrade software package is deployed to each node of the target cluster by running the plug-in program. Different versions of the upgrade workflow correspond to different plug-ins. This is because different versions of software may introduce new functions, modify existing functions, or fix vulnerabilities. These changes will affect the specific operations in the upgrade process. Specific plug-ins are needed to handle the differences between versions to ensure that the upgrade operation can proceed smoothly, thereby simplifying the complexity of the deployment of the upgrade software package.
[0159] Figure 8 A pre-processing flowchart before cluster version upgrade is provided for an exemplary embodiment of the present application.
[0160] like Figure 8 As shown in the figure, the preprocessing process before cluster version upgrade includes:
[0161] S801: Obtain the initial version number and target version number of the cluster upgrade, as well as the uploaded plug-in program and incremental upgrade software package.
[0162] In actual applications, after generating a new version of the software package, relevant technical personnel can build incremental upgrade software packages required to upgrade from each existing version to the new version based on the software packages of each existing version and the new version, and develop plug-ins corresponding to the incremental upgrade software packages.
[0163] For each incremental upgrade package, determine its corresponding initial version number and target version number. The initial version number corresponding to the incremental upgrade package refers to the version number of the existing version corresponding to the incremental upgrade package. The target version number corresponding to the incremental upgrade package refers to the version number of the new version.
[0164] Furthermore, relevant technicians can upload plug-in programs and incremental upgrade software packages through the front-end interface. The cluster management server obtains the uploaded plug-in programs and incremental upgrade software packages, as well as the corresponding initial version numbers and target version numbers.
[0165] S802: Run the implementation program of the cluster creation workflow, and create a cluster with an initial version number on the cloud platform as a verification cluster by calling multiple cluster operation interfaces provided by the cloud platform.
[0166] Before performing a version upgrade on the target cluster, run the implementation program of the cluster creation workflow to create a verification cluster. The verification cluster runs a software package corresponding to the initial version number to verify the feasibility of the cluster upgrade workflow. Optionally, the cluster creation configuration information of the verification cluster can be pre-defined in the implementation program of the cluster version upgrade workflow, or can be configured by the user in the cluster version upgrade configuration interface.
[0167] Exemplarily, the cluster management server obtains the cluster creation configuration information of a pre-defined verification cluster or the verification cluster configuration information in the cluster version upgrade configuration information of the user, runs the implementation program of the cluster creation workflow, calls multiple cluster operation interfaces provided by the cloud platform to which the verification cluster belongs, and performs multiple cluster operations on the verification cluster, such as creating a CVM, initializing a CVM, deploying the software package with the initial version number to the cluster nodes of the verification cluster, etc., to realize the cluster creation of the verification cluster.
[0168] S803: injecting the base data into the verification cluster, running the plug-in program, and upgrading the verification cluster using the incremental upgrade software package.
[0169] The underlying data refers to the basic data set that is pre-loaded or distributed to the verification cluster nodes when the verification cluster is initialized, which is used to support the basic operation of the verification cluster. The underlying data may include system configuration data, service configuration data, application dependency data, etc.
[0170] Exemplarily, a database import tool, such as a command line tool, is used to inject the base data into the verification cluster. If the incremental upgrade software package is an incremental part of the software package of the target version number compared to the software package of the initial version number, the plug-in program is run to deploy the incremental part on the verification cluster. If the incremental upgrade software package is the software package of the target version number, the plug-in program is run to deploy the software package of the target version number on the verification cluster.
[0171] S804: Perform a green light test on the upgraded verification cluster. After the green light test passes, store the plug-in program, and store the incremental upgrade software package and the initial version number and target version number corresponding to the incremental upgrade software package in the software package library.
[0172] Among them, the green light test is a method of testing the status of the upgraded verification cluster through preset standards and indicators. The main purpose of this test is to ensure that all functions and services of the upgraded verification cluster are operating normally without major problems or errors.
[0173] For example, key performance indicators such as response time, throughput, error rate, API call success rate, correctness of database operations, data query, cluster service component operation, etc. of the upgraded verification cluster can be used as preset standards and indicators to judge the status of the upgraded verification cluster.
[0174] Optionally, after the upgraded verification cluster passes the green light test, the plug-in program can be stored in the cluster management server or in each cluster node of the target cluster, and the incremental software upgrade package and the corresponding initial version number and target version number are stored in the software package library.
[0175] In an embodiment of the present application, before the cluster version is upgraded, the upgrade workflow is verified by creating a verification cluster that includes the software package corresponding to the initial version number, and a green light test is performed on the upgraded verification cluster. After ensuring that the upgraded verification cluster can work normally, the target cluster to be upgraded is upgraded, thereby ensuring the security and reliability of the cluster version upgrade.
[0176] Exemplarily, a user logs in to the cluster management system, and after selecting the cluster version upgrade function, the system outputs a cluster version upgrade configuration interface. When the software package library does not contain an incremental upgrade software package, the user can upload a pre-prepared plug-in program and incremental upgrade software package on the cluster version configuration interface. Then, the user can configure and submit the cluster version upgrade configuration information on the cluster version upgrade interface. The end-side device integrates the cluster version upgrade configuration information into a message in json format, and submits it to the cluster supply module through the API provided by the cluster supply module. The cluster supply module runs the implementation program of the cluster creation workflow, and requests the cloud platform to create a verification cluster and inject the base data according to the configuration information of the verification cluster in the cluster version upgrade configuration information or the configuration information of the verification cluster pre-stored in the cluster management server; the verification cluster is upgraded according to the initial version number and the target version number; after the upgrade is completed, the verification cluster is tested for a green light; after the green light test is passed, the plug-in program is stored in each node of the cluster management server or the target cluster, and the incremental upgrade software package is stored in the software package library. Then, the target cluster obtains the matching incremental upgrade software package from the software package library according to the initial version number and the target version number, and runs the plug-in program to upgrade the target cluster using the incremental upgrade software package.
[0177] Based on any of the above embodiments, the cluster management server also provides a cluster health monitoring function. Fig. 9 A flow chart of cluster health monitoring provided by an exemplary embodiment of the present application. Fig. 9 As shown in the figure, the cluster health monitoring process includes:
[0178] S901: Obtain configured health check task information, where the health check task information includes a health check object cluster, monitoring data items, and a scheduling cycle.
[0179] The object cluster refers to the cluster on which the health check task is to be performed.
[0180] Monitoring data items refer to data items that need to be checked in the health check of the object cluster. Monitoring data items may include at least one of the following: hardware resource monitoring, system performance monitoring, network status monitoring, application monitoring, database monitoring, security monitoring, etc. of the object cluster. For example, hardware resource detection may include CPU usage and memory usage. System performance monitoring may include system load, process and thread monitoring. Network status monitoring may include network latency, port and service status. Application monitoring may include service availability and application logs. Database monitoring may include the number of database connections and data synchronization status. Security monitoring includes user login and access control, and intrusion detection.
[0181] The scheduling period refers to the frequency or time interval of health checks for the object cluster. The scheduling period can be set to the level of minutes, hours, or days, depending on actual needs. For example, the scheduling period can be set according to load and business needs. In a high-load production environment, the scheduling period of cluster health checks can be set longer, such as checking every 5 minutes, to quickly detect abnormal conditions of cluster nodes or services; in a low-load production environment, the scheduling period of cluster health checks can be extended to save resources.
[0182] Specifically, after the user logs in to the cluster management system and selects the cluster health monitoring function, in response to receiving a request to execute the cluster health monitoring function, the cluster management server provides the end-side device with a cluster health monitoring configuration interface corresponding to the cluster health monitoring function. The end-side device displays the cluster health monitoring configuration interface corresponding to the cluster health monitoring function. The user can configure health check task information in the cluster health monitoring configuration interface corresponding to the cluster health monitoring function.
[0183] S902: According to the scheduling cycle, monitoring data of monitoring data items of the object cluster are obtained regularly, and the health status of the object cluster is diagnosed according to the monitoring data of the object cluster and the configured health check rule base to obtain a health diagnosis result.
[0184] Among them, the health check rule base is a collection of one or more health check rules. A health check rule specifies the health condition of at least one monitoring data. The health condition of the monitoring data can be a normal value range, etc. The health check rule base can include but is not limited to hardware resource rules, service status rules, etc. For example, the monitoring rules for hardware resources can include that the CPU usage rate cannot exceed 90%, and once it exceeds, an alarm is triggered; the service status rules can include that the service response time must not exceed 200ms, and once it exceeds, it is diagnosed as performance degradation.
[0185] Specifically, the cluster management server runs the implementation program of the cluster monitoring workflow, and obtains the monitoring data of the monitoring data items of the object cluster at regular intervals according to the scheduling cycle in the health check task information. Based on the health check rules in the health check rule library and the detection data of the object cluster, the health status of the object cluster is diagnosed to obtain the health diagnosis result of the object cluster. Exemplarily, for any health check rule, if there is at least one monitoring data that does not meet the corresponding health condition, it is determined that the object cluster has a health problem and anomalies may occur. If all detection data items meet the corresponding health conditions, it is determined that the object cluster does not have a health problem.
[0186] Users can configure the object cluster, monitoring data items and multiple alternative scheduling cycles for health checks in the cluster health monitoring configuration interface. Users can make flexible choices based on their needs, reduce monitoring of unnecessary data items, save resources, and improve the flexibility and adaptability of health checks. In addition, users do not need to manually fill in monitoring data items and manually set scheduling cycles, which reduces configuration time and improves the efficiency of health checks.
[0187] S903: Output the health diagnosis result through the front-end interface.
[0188] After obtaining the monitoring diagnosis results of the target cluster, the cluster management server sends the health diagnosis results to the end-side device, so that the end-side device displays the front-end interface for outputting the health diagnosis results and displays the health diagnosis results. Users can perform corresponding maintenance on the cluster according to the health diagnosis results output by the front-end interface.
[0189] Exemplarily, a user logs in to the cluster management system, selects the cluster health monitoring function, and configures health check information in the cluster health monitoring configuration interface; the end-side device integrates the health check information into a message in json format, sends it to the operation monitoring module through the API provided by the cluster provisioning module, and runs the implementation program of the cluster health monitoring workflow corresponding to the cluster health monitoring function; the built-in scheduler of the operation monitoring module regularly diagnoses the health status of the object cluster based on the health check information, records the diagnosis results in the database and returns them to the front-end interface for display.
[0190] In an embodiment of the present application, a series of health check rules are pre-defined in the health check rule library. The user can configure the health check information for cluster health monitoring in the cluster health monitoring configuration interface. After the configuration is completed, the operation monitoring can regularly run the implementation program of the cluster health monitoring workflow based on the health check information to realize automatic monitoring of the cluster, which greatly reduces the difficulty and workload of users to manually check the health status of each cluster.
[0191] Based on any of the above embodiments, the job flow of any cluster management function implemented by the cluster management server can be divided into multiple task stages.
[0192] The splitting of the job flow of the cluster management function should be reentrant and atomic. Reentrancy means that after the job flow of the cluster management function is split into multiple task stages, when a task stage is interrupted, the execution state before the task stage is interrupted can be correctly saved, and the execution can be re-entered from the starting point of the task stage and continued. Atomicity means that after the job flow of the cluster management function is split into multiple task stages, each task stage is either fully executed or not executed at all. For the multiple task stages obtained by splitting the job flow of any cluster management function, each task stage should be able to be executed repeatedly multiple times, and in each execution, the task stage should either be fully executed or not executed at all.
[0193] In the process of running the implementation program of the cluster management workflow corresponding to the cluster management function, each task stage of the cluster management workflow is executed in sequence, and the workflow operation status table is recorded. Among them, the workflow operation status table records the operation status of each task stage. The operation status of any task stage includes execution success and execution failure.
[0194] When the cluster management job flow fails to execute, the job flow operation status table is used to continue the execution from the task stage where the execution failed.
[0195] Exemplarily, the job flow of cluster creation can be divided into three task stages: creating cluster nodes, initializing cluster nodes, and deploying service components on cluster nodes; the three task stages of the cluster creation job flow are executed in sequence, and a cluster creation job flow running status table is recorded. Optionally, the job flow running status table can record a job flow status according to the three elements of the cluster name, job type, and task stage of the target cluster to be created as a unique identifier. During the execution of the cluster creation job flow, if a failed running state occurs in the cluster node initialization stage, the process returns to the starting point of the cluster node initialization to re-execute the cluster node initialization task stage, and the cluster node creation task stage that has been successfully executed before is no longer repeated.
[0196] Exemplarily, the job flow for cluster scaling down can be split into three task stages, namely, rebalancing the data of the cluster, removing services on the scaled-down nodes and performing data integrity verification, and destroying the scaled-down nodes; the three task stages of the cluster scaling-down job flow are executed in sequence, and a cluster scaling-down job flow operation status table is recorded. Optionally, the job flow operation status table can record a job flow status according to the three elements of the cluster name, job type, and task stage of the target cluster to be scaled down as a unique identifier. During the execution of the cluster scaling-down job flow, if a failed operation status occurs in the stage of destroying the scaled-down nodes, the process returns to the starting point of destroying the scaled-down nodes and re-executes the task stage of destroying the scaled-down nodes, and the task stage that has been successfully executed before is no longer repeated.
[0197] Exemplarily, the cluster expansion workflow can be divided into four task stages: creating a new CVM, initializing a new CVM, deploying cluster service components to the new CVM, and adding the expanded node to the target cluster; the four task stages of the cluster expansion workflow are executed in sequence, and the cluster expansion workflow operation status table is recorded. Optionally, the workflow operation status table can record a workflow status according to the three elements of the cluster name, job type, and task stage of the target cluster to be expanded as a unique identifier. During the execution of the cluster expansion workflow, if a failed operation status occurs in the stage of initializing the new CVM, the process returns to the starting point of initializing the new CVM and re-executes the task stage of initializing the new CVM, and the task stage that has been successfully executed before is no longer repeated.
[0198] Exemplarily, the job flow of cluster version upgrade can be divided into five task stages, namely, creating a verification cluster, injecting base data into the verification cluster, performing version upgrade on the verification cluster, performing green light test on the verification cluster, and upgrading the target cluster; the three task stages of the cluster version upgrade job flow are executed in sequence, and the cluster version upgrade job flow operation status table is recorded. Optionally, the job flow operation status table can record a job flow status according to the three elements of the target cluster to be upgraded, namely, the cluster name, job type, and task stage as unique identifiers. During the execution of the cluster version upgrade job flow, if a failed operation status occurs during the green light test stage of the verification cluster, the system returns to the starting point of the green light test on the verification cluster and re-executes the task stage of the green light test on the verification cluster, and the task stage that has been successfully executed before is no longer repeated.
[0199] In the embodiment of the present application, by splitting the cluster management job flows corresponding to various cluster management functions into multiple task stages, when a task stage fails to execute, it traces back to the failed task stage to continue execution, thereby achieving breakpoint resumption of various cluster management job flows, thereby improving the reliability of cluster management, saving time and resources, and enhancing user experience.
[0200] Fig.10 A schematic diagram of a cluster management device provided in an embodiment of the present application. The cluster management device 1000 includes: a front-end interaction module 1001 and a cluster provisioning module 1002 .
[0201] The front-end interaction module 1001 is used to respond to a request to execute any cluster management function and display a cluster configuration interface corresponding to the cluster management function, where the cluster configuration interface is used to configure management configuration information of the target cluster.
[0202] The cluster supply module 1002 is used to respond to cluster management instructions, run the implementation program of the cluster management workflow corresponding to the cluster management function, and complete the cluster management of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs and performing multiple cluster operations on the target cluster according to the management configuration information of the target cluster.
[0203] In the embodiment of the present application, the cluster supply module integrates various cluster management functions into different cluster management workflows, and provides implementation programs and front-end interfaces of cluster management workflows corresponding to various cluster management functions. In response to a request to execute any cluster management function, the cluster supply module displays the cluster configuration interface corresponding to the cluster management function, and the cluster configuration interface is used to configure the management configuration information of the target cluster. In response to the cluster management instruction, the cluster supply module runs the implementation program of the cluster management workflow corresponding to the cluster management function, and performs multiple cluster operations on the target cluster according to the management configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, so as to realize the cluster management function of the target cluster. Through the front-end interaction module, after completing the configuration on the front-end interface, the user can trigger the execution of the cluster management workflow with one click, and automatically complete the multiple cluster operations required for the cluster management function. The user does not need to manually perform various cluster operations to realize various cluster management functions, which reduces the difficulty of cluster management and improves the efficiency of cluster management. In addition, since the realization and completion of various cluster functions are realized by running the implementation program of the cluster management workflow corresponding to the cluster management function, manual errors that may occur during cluster management are avoided.
[0204] In an optional implementation, the front-end interaction module 1001 is specifically used for:
[0205] In response to the cluster creation request, displaying a cluster creation configuration interface, where the cluster creation configuration interface is used to configure cluster creation configuration information of a target cluster to be created;
[0206] The cluster supply module 1002 is specifically used for: responding to cluster creation instructions, running the implementation program of the cluster creation workflow, creating cluster nodes for the target cluster on the cloud platform according to the cluster creation configuration information of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform, initializing the cluster nodes, and deploying cluster service components to the cluster nodes, thereby completing the creation of the target cluster on the cloud platform.
[0207] In one implementation, the front-end interaction module 1001 is specifically used for:
[0208] In response to the cluster shrink request, displaying a cluster shrink configuration interface, where the cluster shrink configuration interface is used to select at least one target cluster to be shrunk and configure shrink configuration information of the at least one target cluster;
[0209] The cluster provisioning module 1002 is specifically used for:
[0210] In response to the cluster scaling-in instruction, the implementation program of the cluster scaling-in job flow is run. By calling multiple cluster operation interfaces provided by the cloud platform, data of the target cluster is rebalanced according to the scaling-in configuration information of the target cluster, services of the scaling-in nodes are removed from the target cluster, and data integrity verification is performed. After the data integrity verification passes, the scaling-in nodes are released to complete the scaling-down of the target cluster.
[0211] In one implementation, the front-end interaction module 1001 is specifically used for:
[0212] In response to the cluster expansion request, displaying a cluster expansion configuration interface, where the cluster expansion configuration interface is used to select at least one target cluster to be expanded and configure expansion configuration information of the at least one target cluster;
[0213] The cluster provisioning module 1002 is specifically used for:
[0214] In response to the cluster expansion instruction, the implementation program of the cluster expansion workflow is run. By calling multiple cluster operation interfaces provided by the cloud platform, an expansion node is created for the target cluster on the cloud platform according to the expansion configuration information of the target cluster, the expansion node is initialized, the cluster service components are deployed on the expansion node, and the expansion node is added to the target cluster to complete the expansion of the target cluster.
[0215] In one implementation, the front-end interaction module 1001 is specifically used for:
[0216] In response to the cluster version upgrade request, display a cluster version upgrade configuration interface, where the cluster version upgrade configuration interface is used to configure an initial version number and a target version number;
[0217] The cluster provisioning module 1002 is specifically used for:
[0218] Obtain the matching incremental upgrade software package from the software package library according to the initial version number and the target version number;
[0219] Run the plug-in to upgrade the target cluster using the incremental upgrade package.
[0220] In one implementation, the cluster provisioning module 1002 is specifically configured to:
[0221] Obtain the initial version number and target version number of the cluster upgrade, as well as the uploaded plug-in program and incremental upgrade software package;
[0222] Run the implementation program of the cluster creation workflow, and create a cluster with an initial version number on the cloud platform as a verification cluster by calling multiple cluster operation interfaces provided by the cloud platform;
[0223] Inject the base data into the verification cluster, run the plug-in program, and upgrade the verification cluster using the incremental upgrade package;
[0224] A green light test is performed on the upgraded verification cluster. After the green light test is passed, the plug-in program is stored, and the incremental upgrade software package and the initial version number and target version number corresponding to the incremental upgrade software package are stored in the software package library.
[0225] In one implementation, the cluster management device 1000 further includes:
[0226] The permission authentication module is used to verify that the current user has the permission to manage the cluster.
[0227] In one implementation, the cluster management device 1000 further includes:
[0228] The operation monitoring module is used to periodically obtain the monitoring data of the monitoring data items of the object cluster according to the scheduling cycle, diagnose the health status of the object cluster according to the monitoring data of the object cluster and the configured health check rule library, and obtain the health diagnosis result.
[0229] In one implementation, the front-end interaction module 1001 is further used to:
[0230] Get the configured health check task information, which includes the health check object cluster, monitoring data items, and scheduling cycle;
[0231] Output health diagnosis results through the front-end interface.
[0232] In one implementation, the operation monitoring module is further used to:
[0233] Split the cluster management workflow into multiple task stages;
[0234] In the process of running the implementation program of the cluster management workflow corresponding to the cluster management function, each task stage of the cluster management workflow is executed in sequence, and a workflow running status table is recorded, wherein the workflow running status table records the running status of each task stage, and the running status of any task stage includes execution success and execution failure;
[0235] When the cluster management job flow fails to execute, the job flow operation status table is used to continue the execution from the task stage where the execution failed.
[0236] Fig.11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.11 As shown, the electronic device 1100 includes: a memory 1101, a processor 1102, and a transceiver 1103. The memory 1101 communicates with the processor 1102. Exemplarily, the memory 1101, the processor 1102, and the transceiver 1103 can communicate via a communication bus 1104, the memory 1101 is used to store a computer program, and the processor 1102 executes the computer program to implement the method of the above embodiment.
[0237] Optionally, the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps in the method embodiments disclosed in the present application may be directly implemented as being executed by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.
[0238] An embodiment of the present application further provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, a method in any of the above method embodiments is implemented.
[0239] An embodiment of the present application also provides a computer program product, including a computer program, which implements the method in any of the above method embodiments when the computer program is executed by a processor.
[0240] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.
[0241] The order of the above-mentioned embodiments of the present application is only for description and does not represent the advantages and disadvantages of the embodiments. In addition, in some of the processes described in the above-mentioned embodiments and the accompanying drawings, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed or executed in parallel in the order in which they appear in this article, and are only used to distinguish between different operations, and the sequence number itself does not represent any execution order. In addition, these processes may include more or less operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit "first" and "second" to different types. The meaning of "multiple" is more than two, unless otherwise clearly and specifically limited.
[0242] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.
[0243] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.
[0244] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A cluster management method, characterized in that: include: In response to a request to execute any cluster management function, display a cluster configuration interface corresponding to the cluster management function, wherein the cluster configuration interface is used to configure management configuration information of the target cluster; In response to the cluster management instruction, the implementation program of the cluster management workflow corresponding to the cluster management function is run, and by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs, multiple cluster operations are performed on the target cluster according to the management configuration information of the target cluster to complete the cluster management of the target cluster.
2. The method according to claim 1, characterized in that The cluster management function is cluster creation, and the method includes: In response to the cluster creation request, displaying a cluster creation configuration interface, wherein the cluster creation configuration interface is used to configure cluster creation configuration information of a target cluster to be created; In response to the cluster creation instruction, the implementation program of the cluster creation job flow is run, and by calling multiple cluster operation interfaces provided by the cloud platform, a cluster node is created for the target cluster on the cloud platform according to the cluster creation configuration information of the target cluster, the cluster node is initialized, and the cluster service component is deployed to the cluster node, thereby completing the creation of the target cluster on the cloud platform.
3. The method according to claim 1, characterized in that The cluster management function is cluster scaling down, and the method includes: In response to the cluster shrink request, displaying a cluster shrink configuration interface, wherein the cluster shrink configuration interface is used to select at least one target cluster to be shrunk and configure shrink configuration information of the at least one target cluster; In response to the cluster scaling-in instruction, the implementation program of the cluster scaling-in job flow is run, and by calling multiple cluster operation interfaces provided by the cloud platform, data of the target cluster is rebalanced according to the scaling-in configuration information of the target cluster, and the service of the scaling-in node is removed from the target cluster. A data integrity check is performed, and the scaling-in node is released after the data integrity check passes, thereby completing the scaling-down of the target cluster.
4. The method according to claim 1, characterized in that: The cluster management function is cluster expansion, and the method includes: In response to the cluster expansion request, displaying a cluster expansion configuration interface, wherein the cluster expansion configuration interface is used to select at least one target cluster to be expanded and configure expansion configuration information of the at least one target cluster; In response to the cluster expansion instruction, the implementation program of the cluster expansion workflow is run, and by calling multiple cluster operation interfaces provided by the cloud platform, an expansion node is created for the target cluster on the cloud platform according to the expansion configuration information of the target cluster, the expansion node is initialized, the cluster service component is deployed on the expansion node, and the expansion node is added to the target cluster to complete the expansion of the target cluster.
5. The method according to claim 1, characterized in that The cluster management function is cluster version upgrade, and the method includes: In response to the cluster version upgrade request, displaying a cluster version upgrade configuration interface, wherein the cluster version upgrade configuration interface is used to configure an initial version number and a target version number; According to the initial version number and the target version number, obtaining a matching incremental upgrade software package from a software package library; The plug-in program is run to upgrade the target cluster using the incremental upgrade software package.
6. The method according to claim 5, characterized in that Also includes: Obtaining the initial version number and target version number of the cluster upgrade, as well as the uploaded plug-in program and the incremental upgrade software package; Run the implementation program of the cluster creation workflow, and create a cluster of the initial version number on the cloud platform as a verification cluster by calling multiple cluster operation interfaces provided by the cloud platform; Injecting the base data into the verification cluster, running the plug-in program, and upgrading the verification cluster using the incremental upgrade software package; A green light test is performed on the upgraded verification cluster. After the green light test is passed, the plug-in is stored, and the incremental upgrade software package and the initial version number and target version number corresponding to the incremental upgrade software package are stored in the software package library.
7. The method according to any one of claims 1 to 6, characterized in that Before the method completes cluster management of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs and performing multiple cluster operations on the target cluster according to the management configuration information of the target cluster, the method further includes: Verify that the current user has the permissions to manage the cluster.
8. The method according to any one of claims 1 to 6, characterized in that Also includes: Obtain the configured health check task information, which includes the health check object cluster, monitoring data items, and scheduling period; According to the scheduling period, periodically obtain monitoring data of the monitoring data item of the object cluster, diagnose the health status of the object cluster according to the monitoring data of the object cluster and a configured health check rule base, and obtain a health diagnosis result; The health diagnosis result is output through the front-end interface.
9. The method according to any one of claims 1 to 6, characterized in that: Also includes: Splitting the cluster management workflow into multiple task stages; In the process of running the implementation program of the cluster management workflow corresponding to the cluster management function, each of the task stages of the cluster management workflow is executed in sequence, and a workflow running status table is recorded, wherein the workflow running status table records the running status of each of the task stages, and the running status of any task stage includes execution success and execution failure; When the cluster management workflow fails to execute, the workflow continues to execute from the task stage where the execution fails according to the workflow running status table.
10. A cluster management device, characterized in that: include: A front-end interaction module, configured to respond to a request to execute any cluster management function and display a cluster configuration interface corresponding to the cluster management function, wherein the cluster configuration interface is used to configure management configuration information of a target cluster; The cluster supply module is used to respond to cluster management instructions, run the implementation program of the cluster management workflow corresponding to the cluster management function, and complete the cluster management of the target cluster by calling multiple cluster operation interfaces provided by the cloud platform to which the target cluster belongs and performing multiple cluster operations on the target cluster according to the management configuration information of the target cluster.
11. The device according to claim 10, characterized in that Also includes: The authority authentication module is used to verify and confirm that the current user has the authority to perform the cluster management function.
12. The device according to claim 10, characterized in that include: The front-end interaction module is further used to obtain configured health check task information, wherein the health check task information includes a health check object cluster, monitoring data items, and a scheduling cycle; The device further comprises: an operation monitoring module, configured to periodically obtain monitoring data of the monitoring data items of the object cluster according to the scheduling period, diagnose the health status of the object cluster according to the monitoring data of the object cluster and a configured health check rule base, and obtain a health diagnosis result; The front-end interaction module is also used to output the health diagnosis result through the front-end interface.
13. An electronic device, characterized in that: include: memory, processors, and transceivers; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 9.
14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 9 when executed by a processor.
15. A computer program product, characterized in that The method comprises a computer program, which implements the method according to any one of claims 1 to 9 when being executed by a processor.