Unification method and device for database service platform

Abstract

The invention provides a database service platform unification method and device, and the method comprises the steps: deploying a database service platform on a central cloud platform, and installing an Agent program on a virtual machine of a heterogeneous cloud platform for subsequent communication and instruction execution; a user selects required database service through a service directory of a central cloud platform, a service orchestration engine automatically selects a proper heterogeneous cloud platform and a virtual machine according to user requirements and predefined rules, and a deployment scheme is generated; and the central cloud platform sends an instruction to the Agent, and the Agent automatically downloads the database mirror image after receiving the instruction, and creates a database container instance on a selected virtual machine by using a virtualization technology. The method has the beneficial effects that by automatically deploying the script, the rapid deployment of the database is realized, and the error risk of manual operation is reduced; agent communication adopts a secure channel, so that the security of communication is ensured, and sensitive information leakage and illegal access are prevented.

Description

Technical Field

[0001] The present invention belongs to the field of computer technology, and in particular relates to a unified method and device for a database service platform. Background Art

[0002] In the current information age, cloud computing technology has become the core support for digital transformation of government and enterprise customers. The flexibility, elasticity and efficiency of cloud computing have attracted more and more enterprises to migrate their businesses to the cloud. However, the technical and commercial binding of a single cloud vendor has also brought a series of problems, including excessive dependence and inconsistent technology stacks. In order to cope with these challenges, government and enterprise customers have gradually adopted hybrid cloud and heterogeneous cloud technology architecture models.

[0003] In the heterogeneous cloud model, enterprises can choose services from different cloud vendors according to business needs, gaining greater flexibility and selectivity. However, the different technology stacks of different cloud vendors in heterogeneous cloud environments are not unified, which brings a series of complexities and challenges to database management. For example, different cloud platforms may have different ways of creating, configuring, and managing database instances, making unified management and business collaboration between multiple clouds a challenging task. Summary of the invention

[0004] In view of this, the present invention aims to propose a unified method and device for a database service platform to at least solve one problem in the background technology.

[0005] To achieve the above object, the technical solution of the present invention is achieved as follows:

[0006] A unified approach to a database service platform, comprising:

[0007] Deploy the database service platform on the central cloud platform and install the Agent program on the virtual machine of the heterogeneous cloud platform for subsequent communication and instruction execution;

[0008] Users select the required database services through the service catalog of the central cloud platform. The service orchestration engine automatically selects the appropriate heterogeneous cloud platform and virtual machine based on user requirements and predefined rules, and generates a deployment plan.

[0009] The central cloud platform sends instructions to the Agent, which automatically downloads the database image after receiving the instructions and uses virtualization technology to create a database container instance on the selected virtual machine;

[0010] The agent monitors the running status of the database container instance in real time and sends the collected monitoring data to the central cloud platform. The central cloud platform analyzes and displays the data and generates alarm information. Users can view the running status of the database service through the management interface.

[0011] Users can manage the entire life cycle of database services through the management interface of the central cloud platform, including starting and stopping services, adjusting resources, modifying configurations, and performing backup and recovery operations. The Agent is responsible for receiving instructions and performing corresponding operations.

[0012] Furthermore, the database service platform is deployed on the central cloud platform, and the Agent program is installed on the virtual machine of the heterogeneous cloud platform for subsequent communication and instruction execution, including:

[0013] Deploy a database service platform on the central cloud platform, wherein the database service platform includes a service catalog, a service orchestration engine, a monitoring module, and a security management module;

[0014] Install the operating system and necessary software dependencies on the virtual machines of the heterogeneous cloud platform;

[0015] Develop the Agent program and deploy the Agent to each virtual machine.

[0016] Furthermore, the user selects the required database service through the service catalog of the central cloud platform, and the service orchestration engine automatically selects the appropriate heterogeneous cloud platform and virtual machine according to the user's needs and predefined rules, and generates a deployment plan, including:

[0017] Users select database type, version, and specifications through the service catalog of the central cloud platform and submit a service creation request;

[0018] The service orchestration engine selects appropriate heterogeneous cloud platforms and virtual machines based on user requests and pre-defined rules, and generates a deployment plan.

[0019] Furthermore, the central cloud platform sends an instruction to the Agent, and after receiving the instruction, the Agent automatically downloads the database image and creates a database container instance on the selected virtual machine using virtualization technology, including:

[0020] The central cloud platform sends instructions to the Agent on the target virtual machine through the API interface to trigger the automated deployment process;

[0021] The Agent downloads the pre-built database image according to the instructions and uses virtualization technology to create a database container instance;

[0022] The Agent executes the initialization script to configure database parameters, user permissions, and security policies.

[0023] Furthermore, the database parameters include a method for automatically adjusting the database parameters, including:

[0024] Determine the database performance indicators that need to be improved, including throughput and query latency, and use database monitoring tools to collect the values ​​of the objective functions;

[0025] Determine the database parameters that need to be adjusted, and set a reasonable value range for each parameter based on the hardware configuration and actual situation of the database server;

[0026] Use the preset proxy model to simulate the relationship between the objective function and the parameters, initialize the selected proxy model, and set the initial parameters of the model;

[0027] Obtain candidate parameters, apply the candidate parameters to the database, measure the value of the objective function, update the parameters of the proxy model using the new observation data, and repeat the steps of "obtain candidate parameters", "evaluate the objective function", and "update the proxy model" until the preset number of iterations is reached;

[0028] After the iteration, the optimal parameter combination of the prediction given by the proxy model is obtained and applied to the database.

[0029] Furthermore, the Agent monitors the running status of the database container instance in real time and sends the collected monitoring data to the central cloud platform, which analyzes and displays the data and generates alarm information. Users can view the running status of the database service through the management interface, including:

[0030] The agent monitors the running status of the database container instance in real time, collects CPU usage, memory usage, number of connections, query performance indicators, and sends them to the central cloud platform;

[0031] The monitoring module of the central cloud platform analyzes and displays monitoring data and generates alarm information;

[0032] Users can view the operating status, performance indicators, and log information of the database service through the management interface of the central cloud platform.

[0033] Furthermore, the present solution discloses an electronic device, including a processor and a memory that is communicatively connected to the processor and is used to store executable instructions of the processor, wherein the processor is used to execute a unified method of a database service platform.

[0034] Furthermore, the present solution discloses a server comprising at least one processor and a memory communicatively connected to the processor, wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the processor so that the at least one processor executes a unified method of a database service platform.

[0035] Furthermore, the present solution discloses a computer-readable storage medium storing a computer program, wherein the computer program implements a unified method of a database service platform when executed by a processor.

[0036] Compared with the prior art, the unified method and device of a database service platform described in the present invention has the following beneficial effects:

[0037] (1) The unified method and device of a database service platform described in the present invention does not rely on the PaaS capabilities of heterogeneous clouds, reduces dependence on cloud platform characteristics, and improves flexibility; through automated deployment scripts, rapid deployment of databases is achieved, reducing the risk of errors in manual operations; Agent communication uses a secure channel to ensure communication security and prevent sensitive information leakage and illegal access;

[0038] (2) The unified method and device of a database service platform described in the present invention can quickly deploy the database to a heterogeneous cloud virtual machine through an automated deployment script, thereby reducing the time cost of manual intervention; and can ensure the security of Agent files and communications through encryption and identity authentication. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings constituting a part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the accompanying drawings:

[0040] Figure 1 A schematic diagram of a unified method and device for a database service platform according to an embodiment of the present invention. DETAILED DESCRIPTION

[0041] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0042] The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0043] This solution discloses a unified method and device for a database service platform. In one embodiment, the solution includes:

[0044] A unified approach to a database service platform, comprising:

[0045] Deploy the database service platform on the central cloud platform and install the Agent program on the virtual machine of the heterogeneous cloud platform for subsequent communication and instruction execution;

[0046] Users select the required database services through the service catalog of the central cloud platform. The service orchestration engine automatically selects the appropriate heterogeneous cloud platform and virtual machine based on user requirements and predefined rules, and generates a deployment plan.

[0047] The central cloud platform sends instructions to the Agent, which automatically downloads the database image after receiving the instructions and uses virtualization technology to create a database container instance on the selected virtual machine;

[0048] The agent monitors the running status of the database container instance in real time and sends the collected monitoring data to the central cloud platform. The central cloud platform analyzes and displays the data and generates alarm information. Users can view the running status of the database service through the management interface.

[0049] Users can manage the entire life cycle of database services through the management interface of the central cloud platform, including starting and stopping services, adjusting resources, modifying configurations, and performing backup and recovery operations. The Agent is responsible for receiving instructions and performing corresponding operations.

[0050] Furthermore, the database service platform is deployed on the central cloud platform, and the Agent program is installed on the virtual machine of the heterogeneous cloud platform for subsequent communication and instruction execution, including:

[0051] Deploy a database service platform on the central cloud platform, wherein the database service platform includes a service catalog, a service orchestration engine, a monitoring module, and a security management module;

[0052] Install the operating system and necessary software dependencies on the virtual machines of the heterogeneous cloud platform;

[0053] Develop the Agent program and deploy the Agent to each virtual machine.

[0054] Furthermore, the user selects the required database service through the service catalog of the central cloud platform, and the service orchestration engine automatically selects the appropriate heterogeneous cloud platform and virtual machine according to the user's needs and predefined rules, and generates a deployment plan, including:

[0055] Users select database type, version, and specifications through the service catalog of the central cloud platform and submit a service creation request;

[0056] The service orchestration engine selects appropriate heterogeneous cloud platforms and virtual machines based on user requests and pre-defined rules, and generates a deployment plan.

[0057] Furthermore, the central cloud platform sends an instruction to the Agent, and after receiving the instruction, the Agent automatically downloads the database image and creates a database container instance on the selected virtual machine using virtualization technology, including:

[0058] The central cloud platform sends instructions to the Agent on the target virtual machine through the API interface to trigger the automated deployment process;

[0059] The Agent downloads the pre-built database image according to the instructions and uses virtualization technology to create a database container instance;

[0060] The Agent executes the initialization script to configure database parameters, user permissions, and security policies.

[0061] Furthermore, the database parameters include a method for automatically adjusting the database parameters, including:

[0062] Determine the database performance indicators that need to be improved, including throughput and query latency, and use database monitoring tools to collect the values ​​of the objective functions;

[0063] Determine the database parameters that need to be adjusted, and set a reasonable value range for each parameter based on the hardware configuration and actual situation of the database server;

[0064] Use the preset proxy model to simulate the relationship between the objective function and the parameters, initialize the selected proxy model, and set the initial parameters of the model;

[0065] Obtain candidate parameters, apply the candidate parameters to the database, measure the value of the objective function, update the parameters of the proxy model using the new observation data, and repeat the steps of "obtain candidate parameters", "evaluate the objective function", and "update the proxy model" until the preset number of iterations is reached;

[0066] After the iteration, the optimal parameter combination of the prediction given by the proxy model is obtained and applied to the database.

[0067] Furthermore, the Agent monitors the running status of the database container instance in real time and sends the collected monitoring data to the central cloud platform, which analyzes and displays the data and generates alarm information. Users can view the running status of the database service through the management interface, including:

[0068] The agent monitors the running status of the database container instance in real time, collects CPU usage, memory usage, number of connections, query performance indicators, and sends them to the central cloud platform;

[0069] The monitoring module of the central cloud platform analyzes and displays monitoring data and generates alarm information;

[0070] Users can view the operating status, performance indicators, and log information of the database service through the management interface of the central cloud platform.

[0071] In another embodiment, if Figure 1 As shown in the figure, the specific workflow includes:

[0072] 1. Preparation of the central cloud management platform: Write automated deployment scripts on the central cloud management platform and prepare database software packages and Agent files;

[0073] 2. Send to the virtual machine of the heterogeneous cloud: The central cloud management platform sends the automated deployment script, MySQL software package and Agent file to the virtual machine that has been prepared in the heterogeneous cloud through a secure channel;

[0074] 3. Automated deployment: Run automated deployment scripts on heterogeneous cloud virtual machines to install, configure, and start the MySQL database;

[0075] 4. Agent communication establishment: The Agent file on the successfully installed virtual machine establishes a communication channel with the central cloud management platform and begins to implement monitoring and management functions.

[0076] The specific implementation is based on the virtual machine orchestration script, and the Python implementation code called by the central cloud application is given as follows:

[0077] 1. Automated deployment script

[0078] Use shell scripts to implement common deployment capabilities on Linux virtual machines:

[0079] #! / bin / bash

[0080] #Install the MySQL database package

[0081] install_mysql(){

[0082] sudo apt-get update

[0083] sudo apt-get install-y mysql-server

[0084] }

[0085] #Configure MySQL database

[0086] configure_mysql(){

[0087] #Add specific operations for configuring the database here

[0088] #For example: create a database, configure user permissions, etc.

[0089] }

[0090] #Start MySQL service

[0091] start_mysql(){

[0092] sudo service mysql start

[0093] }

[0094] #Automated deployment process

[0095] main(){

[0096] echo "Start automatic deployment of MySQL database..."

[0097] echo "Installing MySQL packages..."

[0098] install_mysql

[0099] echo "Configure MySQL database..."

[0100] configure_mysql

[0101] echo "Starting MySQL service..."

[0102] start_mysql

[0103] echo "MySQL database automatic deployment completed!"

[0104] }

[0105] #Execute the automated deployment process

[0106] main

[0107] The above script is pseudo code. The actual automated deployment script needs to be customized according to the specific heterogeneous cloud's support for the script. In the script, bash script is used to perform the installation, configuration, and startup of the MySQL database. This script can be sent from the central cloud management platform to the heterogeneous cloud virtual machine to achieve automated deployment of the MySQL database.

[0108] 2Agent communication script

[0109] The Agent communication script is responsible for establishing a communication channel with the central cloud management platform to realize monitoring and management functions.

[0110]

[0111]

[0112] This script is implemented in Python and is used to send monitoring data to the central cloud management platform. The Agent communication script needs to be customized according to monitoring and management requirements to meet the implementation requirements of different cloud vendors and ensure the security of communication.

[0113] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0114] In the several embodiments provided in the present application, it should be understood that the disclosed methods and systems can be implemented in other ways. For example, the division of the units described above is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. The above-mentioned units may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present invention.

[0115] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. These modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be included in the scope of the claims and specification of the present invention.

[0116] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A unified method for a database service platform, characterized in that: include: Deploy the database service platform on the central cloud platform and install the Agent program on the virtual machine of the heterogeneous cloud platform for subsequent communication and instruction execution; Users select the required database services through the service catalog of the central cloud platform. The service orchestration engine automatically selects the appropriate heterogeneous cloud platform and virtual machine based on user requirements and predefined rules, and generates a deployment plan. The central cloud platform sends instructions to the Agent, which automatically downloads the database image after receiving the instructions and uses virtualization technology to create a database container instance on the selected virtual machine; The agent monitors the running status of the database container instance in real time and sends the collected monitoring data to the central cloud platform. The central cloud platform analyzes and displays the data and generates alarm information. Users can view the running status of the database service through the management interface. Users can manage the entire life cycle of database services through the management interface of the central cloud platform, including starting and stopping services, adjusting resources, modifying configurations, and performing backup and recovery operations. The Agent is responsible for receiving instructions and performing corresponding operations.

2. A unified method for a database service platform according to claim 1, characterized in that: The database service platform is deployed on the central cloud platform, and the Agent program is installed on the virtual machine of the heterogeneous cloud platform for subsequent communication and instruction execution, including: Deploy a database service platform on the central cloud platform, wherein the database service platform includes a service catalog, a service orchestration engine, a monitoring module, and a security management module; Install the operating system and necessary software dependencies on the virtual machines of the heterogeneous cloud platform; Develop the Agent program and deploy the Agent to each virtual machine.

3. A unified method for a database service platform according to claim 1, characterized in that: The user selects the required database service through the service catalog of the central cloud platform. The service orchestration engine automatically selects the appropriate heterogeneous cloud platform and virtual machine according to user requirements and predefined rules, and generates a deployment plan, including: Users select database type, version, and specifications through the service catalog of the central cloud platform and submit a service creation request; The service orchestration engine selects appropriate heterogeneous cloud platforms and virtual machines based on user requests and pre-defined rules, and generates a deployment plan.

4. A unified method for a database service platform according to claim 1, characterized in that: The central cloud platform sends instructions to the Agent, and after receiving the instructions, the Agent automatically downloads the database image and creates a database container instance on the selected virtual machine using virtualization technology, including: The central cloud platform sends instructions to the Agent on the target virtual machine through the API interface to trigger the automated deployment process; The Agent downloads the pre-built database image according to the instructions and uses virtualization technology to create a database container instance; The Agent executes the initialization script to configure database parameters, user permissions, and security policies.

5. A unified method for a database service platform according to claim 4, characterized in that: The database parameters include the automatic adjustment method of the database parameters, including: Determine the database performance indicators that need to be improved, including throughput and query latency, and use database monitoring tools to collect the values ​​of the objective functions; Determine the database parameters that need to be adjusted, and set a reasonable value range for each parameter based on the hardware configuration and actual situation of the database server; Use the preset proxy model to simulate the relationship between the objective function and the parameters, initialize the selected proxy model, and set the initial parameters of the model; Obtain candidate parameters, apply the candidate parameters to the database, measure the value of the objective function, update the parameters of the proxy model using the new observation data, and repeat the steps of "obtain candidate parameters", "evaluate the objective function", and "update the proxy model" until the preset number of iterations is reached; After the iteration, the optimal parameter combination of the prediction given by the proxy model is obtained and applied to the database.

6. A unified method for a database service platform according to claim 1, characterized in that: The Agent monitors the running status of the database container instance in real time and sends the collected monitoring data to the central cloud platform, which analyzes and displays the data and generates alarm information. Users can view the running status of the database service through the management interface, including: The agent monitors the running status of the database container instance in real time, collects CPU usage, memory usage, number of connections, query performance indicators, and sends them to the central cloud platform; The monitoring module of the central cloud platform analyzes and displays monitoring data and generates alarm information; Users can view the operating status, performance indicators, and log information of the database service through the management interface of the central cloud platform.

7. An electronic device, comprising a processor and a memory connected to the processor for storing instructions executable by the processor, characterized in that: The processor is used to execute a unified method of a database service platform as described in any one of claims 1-6.

8. A server, characterized in that: It includes at least one processor and a memory communicatively connected to the processor, wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the processor so that the at least one processor executes a unified method of a database service platform as described in any one of claims 1-6.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, a unified method for a database service platform as described in any one of claims 1 to 6 is implemented.

Images