Visual deployment method and system for distributed storage and management software thereof

Abstract

The invention discloses a visual deployment method and system for distributed storage and management software thereof, and the method comprises the steps: inputting host information into a system, receiving the uploaded host information at a background, and storing the host information in a server database; then defining a role corresponding to a host, configuring and checking a distributed storage cluster, configuring a management software role, configuring management software, and installing the distributed storage cluster and a management software system; the server database stores host information, host role definition, management software role configuration, distributed storage cluster configuration and management software configuration data; before a management software system is installed, a distributed storage cluster is installed by obtaining data stored in a server database, and then the management software system is installed. According to the method, the problem of complexity in deploying the distributed storage system is solved, the operation cost of operation and maintenance personnel is reduced, the error-tolerant rate is improved, the operation and maintenance personnel can access the visual deployment page, and the method is visual, easy to use, efficient and rapid.

Description

Technical Field

[0001] The present invention relates to the technical field of distributed storage, and in particular to a visual deployment method and system for distributed storage and management software thereof. Background Art

[0002] Distributed storage system is to store data in multiple independent devices. Traditional network storage system uses centralized storage server to store all data. Storage server becomes the bottleneck of system performance and the focus of reliability and security, which cannot meet the needs of large-scale storage applications. Distributed network storage system adopts scalable system structure, uses multiple storage servers to share storage load, and uses location server to locate storage information. It not only improves the reliability, availability and access efficiency of the system, but also makes it easy to expand.

[0003] Yunpan distributed storage software is a fully distributed software-defined storage product for the enterprise market with large-scale horizontal expansion capabilities. Through innovative software-defined storage technology, the original physical storage resources are abstracted and pooled, and algorithms are used to store data in multiple independent devices. Yunpan distributed storage software manages storage resources with a unified and simple operating interface, providing enterprises with highly scalable, convenient, flexible, and cost-effective storage services, effectively meeting the storage business needs of applications on demand.

[0004] When using Yunpan distributed storage software, users need to spend a lot of energy in deployment, which is prone to errors. In addition, relying on Linux system command-based operations requires a certain amount of technical accumulation, and it is also quite cumbersome to deal with problems when they arise. Summary of the invention

[0005] The present invention provides a visual deployment method and system for distributed storage and its management software, which solves the cumbersome problems of users in deploying distributed storage systems, reduces the operating costs of operation and maintenance personnel, and improves fault tolerance.

[0006] To achieve the above purpose, the technical solution provided by the present invention is:

[0007] The first aspect of the present application provides a method for visually deploying distributed storage and management software thereof, comprising the following steps:

[0008] Enter the host information into the system. The background receives the uploaded host information and stores it in the server database. Then, the following steps are performed: define the roles corresponding to the hosts, configure and verify the distributed storage cluster, configure the management software roles and management software, and finally install the distributed storage cluster and management software system.

[0009] The server database stores host information, host role definition, management software role configuration, as well as distributed storage cluster configuration and management software configuration data; before installing the management software system, the distributed storage cluster is installed by obtaining the data stored in the server database, and the management software system is installed after the distributed storage cluster is installed.

[0010] To optimize the above technical solutions, the specific measures taken also include:

[0011] The server database stores uploaded host information, host role definition and management software role configuration through the host table, stores distributed storage cluster configuration through the cluster table, and stores management software configuration through the csms table.

[0012] The definition of the role corresponding to the host includes: selecting an environment and displaying corresponding rules according to the selected environment. After the user checks the role after the corresponding host according to the rules, the triggering judgment method is used to determine whether the corresponding rules are met.

[0013] The distributed storage cluster configuration and verification includes: uploading and verifying certificates. After uploading the certificate, the submiitUpload method is triggered to verify whether the certificate is correct. If correct, the certificate file is stored in the ctstor-deploy directory of the server database, and the certificate name is stored in the cluster table of the server database.

[0014] Furthermore, in the configuration and verification of the distributed storage cluster, if object storage is selected in the role definition, it is necessary to specify an optional area for object storage, add the remaining space of the cache disk to the distributed storage cluster, and select a configuration for the object storage.

[0015] The installation of the distributed storage cluster and the management software system includes: first executing the ctstor-deploy.py Python script, obtaining data in the host table and cluster table of the server database through the script, installing the distributed storage cluster according to the obtained data, and when the distributed storage cluster is successfully installed, obtaining data in the host table and csms table, and installing the management software system according to the obtained data.

[0016] Furthermore, when the installation fails, it is determined whether to clean up the distributed storage cluster or the management software according to the progress of the failure, and the clearCeph method for cleaning up the distributed storage cluster or the clearCsms method for cleaning up the management software is triggered respectively.

[0017] A second aspect of the present application provides a visual deployment system for distributed storage and management software thereof, including:

[0018] The host information entry module is used to enter the host information into the system. The background receives the uploaded host information and stores it in the server database;

[0019] The host role definition module is used to define the role corresponding to the host;

[0020] Cluster configuration module, used to configure and verify distributed storage clusters;

[0021] Management software role configuration module, used to configure management software roles;

[0022] Management software configuration module, used to configure management software;

[0023] Installation module, used to install cluster and management software system;

[0024] The visual deployment system of the distributed storage and its management software is used to execute the visual deployment method of the distributed storage and its management software described above.

[0025] The third aspect of the present application provides an electronic device, characterized in that it includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the visual deployment method of the distributed storage and its management software as described above is implemented.

[0026] A fourth aspect of the present application provides a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the visual deployment method of the distributed storage and its management software as described above.

[0027] Compared with the prior art, the present invention has the following beneficial effects:

[0028] The present invention provides a complete set of distributed storage and its management software visual deployment design solutions to solve the problem that when using Yunpan distributed storage, users need to invest a lot of energy in deploying clusters and management software.

[0029] The visual deployment method and system of distributed storage and management software of the present invention enable operation and maintenance personnel to access a visual deployment page, which is intuitive, easy to use, efficient, fast, concise and clear, and reduces the probability of errors. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 : A flow chart of the method for visually deploying distributed storage and its management software of the present invention.

[0031] Figure 2 : Application reference diagram of the cluster configuration module in an embodiment of the present invention. DETAILED DESCRIPTION

[0032] The above contents of the present invention are further described in detail below in the form of embodiments, but this should not be understood as the scope of the above subject matter of the present invention being limited to the following embodiments, and all technologies realized based on the above contents of the present invention belong to the scope of the present invention.

[0033] In one embodiment, the present invention proposes a visual deployment method for distributed storage and its management software, such as Figure 1 As shown, the following steps are included:

[0034] Enter the host information into the system. The background receives the uploaded host information and stores it in the server database. Then, the following steps are performed: define the roles corresponding to the hosts, configure and verify the distributed storage cluster, configure the management software roles and management software, and finally install the distributed storage cluster and management software system.

[0035] The server database stores host information, host role definition, management software role configuration, as well as distributed storage cluster configuration and management software configuration data; before installing the management software system, the distributed storage cluster is installed by obtaining the data stored in the server database, and the management software system is installed after the distributed storage cluster is installed.

[0036] The server database stores uploaded host information, host role definitions, and management software role configurations through the host table, stores distributed storage cluster configurations through the cluster table, and stores management software configurations through the csms table.

[0037] The roles corresponding to the host are defined, including: selecting an environment, and displaying corresponding rules according to the selected environment. After the user checks the role after the corresponding host according to the rules, the trigger judgment method is used to determine whether the corresponding rules are met.

[0038] Distributed storage cluster configuration and verification include: uploading and verifying certificates. After uploading the certificate, the submiitUpload method is triggered to verify whether the certificate is correct. If correct, the certificate file is stored in the ctstor-deploy directory of the server database, and the certificate name is stored in the cluster table of the server database.

[0039] Furthermore, in the configuration and verification of the distributed storage cluster, if object storage is selected in the role definition, it is necessary to specify the optional area of ​​the object storage, add the remaining space of the cache disk to the distributed storage cluster, and select the configuration for the object storage.

[0040] Installing a distributed storage cluster and a management software system includes: first executing the ctstor-deploy.py Python script, obtaining data in the host table and cluster table of the server database through the script, and installing the distributed storage cluster according to the obtained data. After the distributed storage cluster is successfully installed, obtaining data in the host table and csms table, and installing the management software system according to the obtained data.

[0041] Furthermore, when the installation fails, it is determined whether to clean up the distributed storage cluster or the management software according to the progress of the failure, and the clearCeph method for cleaning up the distributed storage cluster or the clearCsms method for cleaning up the management software is triggered respectively.

[0042] In another embodiment, the present invention provides a visual deployment system for distributed storage and management software thereof, including:

[0043] The host information entry module is used to enter the host information into the system. The background receives the uploaded host information and stores it in the server database;

[0044] The host role definition module is used to define the role corresponding to the host;

[0045] Cluster configuration module, used to configure and verify distributed storage clusters;

[0046] Management software role configuration module, used to configure management software roles;

[0047] Management software configuration module, used to configure management software;

[0048] Installation module, used to install cluster and management software system;

[0049] The visual deployment system of distributed storage and its management software is used to execute the visual deployment method of distributed storage and its management software.

[0050] The present invention is further described in detail below in conjunction with specific application examples:

[0051] Host input:

[0052] Users can download the host entry template and fill in the host information as required, including host IPv4, host IPv6, user name, password, manage network / public network / ALL. After filling in the information, click Upload to select the file on the page, and automatically request the verification method uploadChange to verify whether the filled host information is correct, and return the host status information to display on the page. If all hosts pass the verification, the Next button can be clicked. At this time, click Upload. After the background receives the uploaded form through the interface, it parses and stores it in the host table of the server database.

[0053] Role Definition:

[0054] After the host is successfully entered, jump to the role definition page, where you can select the environment and display the corresponding rules based on the selected environment. After the user checks the role after the corresponding host according to the rules, the RoleDesignerVerify judgment method will be triggered to determine whether it complies with the corresponding rules. If it complies, you can click the next step. If it does not comply with the rules, the next step cannot be clicked, and there will be a prompt which does not comply with the rules when hovering. After clicking the next step, the postRole method is triggered, and the role corresponding to the host is stored in the corresponding mons, osds, rgws, mdss, nfss, and iscsigws fields in the host table. If it is selected, it is 1, and if it is not selected, it is 0.

[0055] Cluster configuration:

[0056] After the role is defined successfully, jump to the cluster configuration page, where you can set whether to enable the firewall, public network segment, cluster network segment, external clock source, whether to automatically generate certificates, etc. The external clock source is an optional item, and you can increase or decrease the input box. Whether to automatically generate certificates. When No is selected, it will display the upload of ssl_key certificate and ssl_crt certificate. After selecting to upload the corresponding file, the submiitUpload method is triggered to verify whether the certificate is correct. If correct, the file is stored in the server / ctstor-deploy directory, and the name is stored in the ssl_key or ssl_cr of the data table cluster. If object storage is selected in the role definition, you need to fill in the specified Wal / db, Wal / db optional area, add the remaining space of the cache disk to the cluster, select Wal / db, OSD configuration and other options. After clicking Next, the postCluster method is triggered, and all fields are stored in the database cluster table. The cluster configuration application diagram is as shown in the figure. Figure 2 shown.

[0057] Management software role configuration:

[0058] After the cluster configuration is successful, jump to the management software role configuration page. After the user checks the role after the corresponding host according to the rules, the RoleDesignerVerify judgment method will be triggered to determine whether it complies with the corresponding rules. If it complies, you can click the next step. If it does not comply with the rules, the next step cannot be clicked, and there is a prompt which does not comply with the rules when hovering. After clicking the next step, the postCsmsRole method is triggered, and the role corresponding to the host is stored in the corresponding controller and alarm fields in the host table. If it is selected, it is 1, and if it is not selected, it is 0.

[0059] Pipeline software configuration:

[0060] After the management software role is configured successfully, jump to the management software configuration page. You can set IPv4 high-availability virtual IP, IPv6 high-availability virtual IP, virtual IP configuration network card, cluster name, whether to enable the log bucket, and IP whitelist. After clicking Next, the postCsms method is triggered and all fields are stored in the csms table of the database.

[0061] Install:

[0062] After the management software is configured successfully, jump to the installation page. All the information of the first 5 steps is displayed. If there are any errors, jump to the corresponding steps to modify them. If there are no errors in the inspection, click the "I have confirmed the configuration first" radio button, and then you can click the install button. After clicking the install button, the setup method is executed, and the websocket request is opened at the same time to obtain the installation progress. Setup method: The deployment start method will execute the ctstor-deploy.pyPython script. The script will obtain the data in the host and cluster tables of the database. According to the obtained data, the cluster will be installed first. When the cluster is installed successfully, the data in the host and csms tables will be obtained. According to the obtained data, the management software system will be installed. Websocket request getInstall method: Get installation progress method, you can get the installation log, and pass it to the page in real time through the websocket interface for display, so that users can see the progress and status of the installation in real time. If the installation fails midway, the user is returned to the failed status. At this time, the page shows that the installation failed, and automatically determines whether to clean up the cluster or the management software according to the progress of the failure. Click the clean button to trigger the clearCeph cluster cleanup method or the clearCsms management software cleanup method. After the cleanup is successful, you can modify all configurations or not, and then continue the installation. If the installation is successful, the deployment ends, and the prompt jumps to the management software system page. You can also clean up the deployed cluster and management software, and then redeploy. If the cleanup fails, you can continue to clean up or contact the administrator to handle it.

[0063] In another embodiment of the present invention, an electronic device is proposed, characterized in that it includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the above-mentioned visual deployment method of distributed storage and its management software is implemented.

[0064] In another embodiment, the present invention provides a computer-readable storage medium storing a computer program, which enables a computer to execute the above-mentioned method for visual deployment of distributed storage and its management software.

[0065] In the embodiments disclosed in the present application, the computer storage medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. The computer storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the above. More specific examples of computer storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0066] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any form. Any technician familiar with the profession, without departing from the scope of the technical solution of the present invention, according to the technical essence of the present invention, any simple modification, equivalent replacement and improvement made to the above embodiment still falls within the protection scope of the technical solution of the present invention.

Claims

1. A method for visual deployment of distributed storage and its management software, characterized in that: The following steps are involved: Enter the host information into the system. The background receives the uploaded host information and stores it in the server database. Then, the following steps are performed: define the roles corresponding to the hosts, configure and verify the distributed storage cluster, configure the management software roles and management software, and finally install the distributed storage cluster and management software system. The server database stores host information, host role definition, management software role configuration, and distributed storage cluster configuration and management software configuration data; Before installing the management software system, the distributed storage cluster is installed by obtaining the data stored in the server database, and the management software system is installed after the distributed storage cluster is installed.

2. The method for visual deployment of distributed storage and its management software according to claim 1, characterized in that: The server database stores uploaded host information, host role definition and management software role configuration through the host table, stores distributed storage cluster configuration through the cluster table, and stores management software configuration through the csms table.

3. The method for visual deployment of distributed storage and its management software according to claim 1, characterized in that: The definition of the role corresponding to the host includes: selecting an environment and displaying corresponding rules according to the selected environment. After the user checks the role after the corresponding host according to the rules, the triggering judgment method is used to determine whether the corresponding rules are met.

4. The method for visual deployment of distributed storage and its management software according to claim 2, characterized in that: The distributed storage cluster configuration and verification includes: uploading and verifying certificates. After uploading the certificate, the submiitUpload method is triggered to verify whether the certificate is correct. If correct, the certificate file is stored in the ctstor-deploy directory of the server database, and the certificate name is stored in the cluster table of the server database.

5. The method for visual deployment of distributed storage and its management software according to claim 1, characterized in that: In the distributed storage cluster configuration and verification, if object storage is selected in the role definition, it is necessary to specify the optional area of ​​the object storage, add the remaining space of the cache disk to the distributed storage cluster, and select the configuration for the object storage.

6. The method for visual deployment of distributed storage and its management software according to claim 2, characterized in that: The installation of the distributed storage cluster and the management software system includes: first executing the ctstor-deploy.py Python script, obtaining data in the host table and cluster table of the server database through the script, installing the distributed storage cluster according to the obtained data, and when the distributed storage cluster is successfully installed, obtaining data in the host table and csms table, and installing the management software system according to the obtained data.

7. The method for visual deployment of distributed storage and its management software according to claim 1, characterized in that: When the installation fails, it is determined whether to clean up the distributed storage cluster or the management software according to the progress of the failure, and the clearCeph method for cleaning up the distributed storage cluster or the clearCsms method for cleaning up the management software is triggered respectively.

8. A visual deployment system for distributed storage and its management software, characterized in that: include: The host information entry module is used to enter the host information into the system. The background receives the uploaded host information and stores it in the server database; The host role definition module is used to define the role corresponding to the host; Cluster configuration module, used to configure and verify distributed storage clusters; Management software role configuration module, used to configure management software roles; Management software configuration module, used to configure management software; Installation module, used to install cluster and management software system; The visual deployment system of distributed storage and its management software is used to execute the visual deployment method of distributed storage and its management software as described in any one of claims 1-7.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for visual deployment of distributed storage and its management software as described in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the method for visual deployment of distributed storage and management software thereof according to any one of claims 1 to 7.

Images