Method, system, device and program for docking and using GPFS (General Purpose File System) of cloud platform

Abstract

The invention discloses a method, a system, equipment and a program for docking and using a GPFS (General Purpose File System) on a cloud platform. The method comprises the following steps: deploying an agent at a GPFS cluster management node; the IaaS file storage service of the cloud platform calls the agent to manage the GPFS cluster; an IaaS network service of the cloud platform receives and manages GPFS cluster network data by calling an RoCE storage switch interface; the cloud platform issues and creates a service cluster; a GPFS file system is mounted on the service cluster. Through the processing scheme disclosed by the invention, resources only need to be directly opened on the cloud platform, automatic mounting and use are realized, the whole use process is streamlined and automatic, the operation and maintenance pressure is reduced, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of cloud computing technology, and in particular to a method, system, device and program for connecting a cloud platform to use GPFS. Background Art

[0002] Currently, in the field of cloud computing, when using the GPFS file system, the computing node or cluster is generally activated first; then the file system is created and configured manually through the GPFS GUI interface or the CLI command on the GPFS cluster node, and the computing node or cluster that will use GPFS is manually authorized; then the network of the activated computing node cluster and the GPFS file system is connected, and the GPFS-related software packages are manually installed on the activated computing nodes, and the previously created and configured GPFS file system is mounted to the specified mount point through the GPFS Client to start using the GPFS file system; The current method of using GPFS file storage for computing nodes or clusters on a cloud platform has the following problems. First, human intervention is required, including the creation, configuration, and authorization of the GPFS file system, the network connection between the computing node cluster and the GPFS file system, and the installation and mounting of related software on the computing node cluster. Second, the operation is complex, the steps are cumbersome, the entire usage process is long, prone to errors, and the workload of operation and maintenance is large.

[0003] It can be seen that the above existing method of docking and using GPFS still has inconveniences and defects in use, and is in urgent need of further improvement. How to create a new method of docking and using GPFS has become a goal that the industry urgently needs to improve. Summary of the invention

[0004] In view of this, an embodiment of the present disclosure provides a method for connecting a cloud platform to use GPFS, which at least partially solves the problems existing in the prior art.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for connecting a cloud platform to use GPFS, the method comprising the following steps: Deploy the agent on the GPFS cluster management node; The IaaS file storage service of the cloud platform manages the GPFS cluster by calling the agent; The cloud platform's IaaS network service manages GPFS cluster network data by calling the RoCE storage switch interface; The cloud platform issues a service cluster creation request; The business cluster mounts the GPFS file system.

[0006] According to a specific implementation of the embodiment of the present disclosure, the IaaS file storage service of the cloud platform manages the GPFS cluster by calling the agent, including: The IaaS file storage service in the cloud platform management area calls the API encapsulated by the agent on the GUI management node in the GPFS cluster to obtain the necessary data and stores it in the database of the file storage service.

[0007] According to a specific implementation of the embodiment of the present disclosure, the necessary data includes: Cluster management IP, storage IP, cluster capacity information, and cluster created file system data.

[0008] According to a specific implementation of the embodiment of the present disclosure, the method further includes: The RoCE storage switch connects the GPFS cluster, cloud platform, and business cluster.

[0009] According to a specific implementation of the embodiment of the present disclosure, the cloud platform sends a message to create a service cluster, including: The cloud platform sends the delivery data for creating the business cluster; the delivery data includes the name, size, number of nodeIds of the created file system and the destination client of the export; The IaaS file storage service calls the agent of the GPFS cluster management node to create a file system with specified parameters, and exports the file system to NFS according to the whitelist issued. IaaS network services allocate network resources to business clusters and configure network parameters; The IaaS computing service opens computing resources and forms corresponding clusters.

[0010] In a second aspect, an embodiment of the present disclosure provides a system for connecting a cloud platform to use GPFS, the system comprising: The deployment module is configured to deploy the agent on the GPFS cluster management node; A management module is configured for the IaaS file storage service of the cloud platform to manage the GPFS cluster by calling the agent; In addition, the cloud platform's IaaS network service manages GPFS cluster network data by calling the RoCE storage switch interface; The business cluster creation module is configured to create business clusters issued by the cloud platform; The mounting module is configured to mount the GPFS file system on the business cluster.

[0011] According to a specific implementation of the embodiment of the present disclosure, the system further includes: In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor implements the method of connecting the cloud platform described in any one of the first aspect or any one of the implementations of the first aspect and using GPFS.

[0012] In a fourth aspect, an embodiment of the present disclosure further provides a computer program product, comprising a computer program stored on a non-transitory computer-readable storage medium, wherein the computer program comprises program instructions, and when the program instructions are executed by a computer, the computer executes the method for connecting a cloud platform to use GPFS in the aforementioned first aspect or any implementation of the first aspect.

[0013] The method for using GPFS in the cloud platform connection in the disclosed embodiment is to manage the GPFS cluster into the cloud platform and centrally manage it, so that when the computing nodes or clusters on the cloud platform use GPFS, human intervention and manual operation are no longer required. Instead, resources need to be directly opened on the cloud platform and automatically mounted for use. The entire use process is streamlined and automated, reducing the pressure of operation and maintenance and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0015] Figure 1 A schematic diagram of a method for connecting a cloud platform to GPFS provided in an embodiment of the present disclosure; Figure 2 A flow chart of a method for connecting a cloud platform to use GPFS provided in an embodiment of the present disclosure; Figure 3 A solution architecture diagram for connecting a cloud computing platform to GPFS provided in an embodiment of the present disclosure; Figure 4 A schematic diagram of a system structure of a cloud platform connected to GPFS provided in an embodiment of the present disclosure; and Figure 5 A schematic diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0016] The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0017] The following describes the embodiments of the present disclosure through specific examples, and those skilled in the art can easily understand other advantages and effects of the present disclosure from the contents disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all of the embodiments. The present disclosure can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present disclosure.

[0018] It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein may be embodied in a wide variety of forms, and any specific structure and / or function described herein is merely illustrative. Based on the present disclosure, it should be understood by those skilled in the art that an aspect described herein may be implemented independently of any other aspect, and two or more of these aspects may be combined in various ways. For example, any number of aspects described herein may be used to implement a device and / or practice a method. In addition, other structures and / or functionalities other than one or more of the aspects described herein may be used to implement this device and / or practice this method.

[0019] Additionally, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects described may be practiced without these specific details.

[0020] Currently in the field of cloud computing, the GPFS file system is generally used by first opening a computing node or cluster; then manually creating and configuring the file system through the GPFS GUI interface or CLI commands on the GPFS cluster node, and then manually authorizing the computing node or cluster to use GPFS; then connecting the network of the opened computing node cluster and the GPFS file system, manually installing GPFS-related software packages on the opened computing node, and mounting the previously created and configured GPFS file system to the specified mount point through the GPFS Client, and starting to use the GPFS file system. This method of using GPFS for computing nodes or clusters on cloud platforms requires human intervention, is complex to operate, has cumbersome steps, and the entire usage process is long, prone to errors, and has a large workload for operation and maintenance.

[0021] The embodiment of the present invention provides a method for connecting a cloud platform to use GPFS, which can manage the GPFS cluster into the cloud platform for centralized management. The use of GPFS by computing nodes on the cloud platform no longer requires human intervention and manual operation. The entire use process is streamlined and automated, which reduces the pressure of operation and maintenance and improves the user experience.

[0022] Figure 1 A schematic diagram of a method flow for connecting a cloud platform using GPFS provided in an embodiment of the present disclosure.

[0023] Figure 2 For Figure 1 Flowchart of the corresponding cloud platform docking method using GPFS.

[0024] like Figure 1 As shown, at step S110, an agent is deployed on the GPFS cluster management node.

[0025] More specifically, the process proceeds to step S120.

[0026] In step S120, the IaaS file storage service of the cloud platform manages the GPFS cluster by calling the agent.

[0027] In an embodiment of the present invention, the IaaS file storage service of the cloud platform manages the GPFS cluster by calling the agent, including: the IaaS file storage service in the cloud platform management area calls the agent-encapsulated API on the GUI management node in the GPFS cluster to obtain necessary data, stores it in the database of the file storage service, and manages the GPFS cluster to the file storage service.

[0028] In the embodiment of the present invention, the necessary data includes: cluster management IP, storage IP, cluster capacity information, and cluster created file system data.

[0029] More specifically, the encapsulated API is to deploy an agent on the node and encapsulate the previous CLI command into a separate API in the agent. When the external needs to connect to the cluster, you can directly call the API, which is convenient and standard.

[0030] Next, go to step S130.

[0031] In step S130, the IaaS network service of the cloud platform manages the GPFS cluster network data by calling the RoCE storage switch interface.

[0032] In the embodiment of the present invention, Figure 3 As shown in the figure, the RoCE storage switch connects the GPFS cluster, cloud platform, and service cluster.

[0033] More specifically, the IaaS network service (hereinafter referred to as network service) in the cloud platform management area calls the RoCE storage switch interface to manage network data information into the network service database.

[0034] Next, go to step S140.

[0035] In step S140, the cloud platform sends a message to create a business cluster.

[0036] More specifically, the cloud platform opens GPFS file system resources, allocates relevant network resources to computing nodes, and then opens corresponding computing resources.

[0037] In an embodiment of the present invention, the cloud platform sends a message to create a business cluster, including: the cloud platform sends delivery data for creating the business cluster; the delivery data includes the name, size, number of nodeIds and destination client of the created file system; the IaaS file storage service calls the agent of the GPFS cluster management node to create a file system with specified parameters, and exports the file system to NFS according to the sent whitelist; the IaaS network service allocates network resources to the business cluster and configures network parameters; the IaaS computing service activates computing resources to form a corresponding cluster.

[0038] More specifically, the whitelist contains client systems that can mount the file, and these clients are exported according to their IP addresses, so that they have permission to mount the file system and access it.

[0039] Allocate cluster management network segment and IP, storage network segment and IP, related VLAN divisions, flow tables on nodes and other configuration information.

[0040] Next, go to step S150.

[0041] In step S150, the service cluster mounts the GPFS file system.

[0042] More specifically, the activated cluster mounts the previously activated GPFS file system to the mount point of the cluster node through the plug-in or agent of the computing node; the activated cluster starts to use the GPFS file system normally.

[0043] The method for docking a cloud platform with GPFS proposed in the present invention adapts multiple cloud platform modules such as file storage services, network services, and computing services through docking. The GPFS cluster is managed into the cloud platform through these service modules, and the GPFS file system is automatically created, exported, and mounted when various cloud service cluster resources are opened. The entire process is fully automated.

[0044] The present invention has the following advantages: The GPFS cluster is managed in the cloud platform and centrally managed. When computing nodes or clusters on the cloud platform use GPFS, manual operations are no longer required. Instead, resources can be directly opened on the cloud platform and automatically mounted for use. The entire usage process is streamlined and automated, reducing operation and maintenance pressure and improving user experience. Figure 4 The system 400 provided by the present invention for docking a cloud platform using GPFS is shown, including a deployment module 410 , a management module 420 , a business cluster creation module 430 and a mounting module 440 .

[0045] The deployment module 410 is used to deploy the agent on the GPFS cluster management node; The management module 420 is used for the IaaS file storage service of the cloud platform to manage the GPFS cluster by calling the agent; and the IaaS network service of the cloud platform to manage the GPFS cluster network data by calling the RoCE storage switch interface; The business cluster creation module 430 is used for the cloud platform to issue and create business clusters; The mounting module 440 is used for the business cluster to mount the GPFS file system.

[0046] See also Figure 5 The present disclosure also provides an electronic device 50, which includes: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method of using GPFS for cloud platform docking in the aforementioned method embodiment.

[0047] The embodiments of the present disclosure also provide a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable the computer to execute the method of using GPFS for cloud platform docking in the aforementioned method embodiment.

[0048] The embodiments of the present disclosure also provide a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the method of using GPFS for cloud platform docking in the aforementioned method embodiment.

[0049] Reference below Figure 5, which shows a schematic diagram of the structure of an electronic device 50 suitable for implementing the embodiment of the present disclosure. The electronic device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0050] like Figure 5 As shown, the electronic device 50 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 50 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0051] Typically, the following devices may be connected to the I / O interface 505: input devices 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 508 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 509. The communication device 509 may allow the electronic device 50 to communicate with other devices wirelessly or by wire to exchange data. Although the electronic device 50 having various devices is shown in the figure, it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or have alternatively.

[0052] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0053] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0054] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0055] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: obtains at least two Internet Protocol addresses; sends a node evaluation request including the at least two Internet Protocol addresses to a node evaluation device, wherein the node evaluation device selects an Internet Protocol address from the at least two Internet Protocol addresses and returns it; receives the Internet Protocol address returned by the node evaluation device; wherein the obtained Internet Protocol address indicates an edge node in a content distribution network.

[0056] Alternatively, the computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device: receives a node evaluation request including at least two Internet Protocol addresses; selects an Internet Protocol address from the at least two Internet Protocol addresses; and returns the selected Internet Protocol address; wherein the received Internet Protocol address indicates an edge node in a content distribution network.

[0057] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0058] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0059] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0060] It should be understood that various parts of the present disclosure may be implemented in hardware, software, firmware or a combination thereof.

[0061] The above is only a specific implementation of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present disclosure should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A method for connecting a cloud platform to GPFS, characterized in that: The method comprises the following steps: Deploy the agent on the GPFS cluster management node; The IaaS file storage service of the cloud platform manages the GPFS cluster by calling the agent; The cloud platform's IaaS network service manages GPFS cluster network data by calling the RoCE storage switch interface; The cloud platform issues a service cluster creation request; The business cluster mounts the GPFS file system.

2. The method for connecting a cloud platform to GPFS according to claim 1, characterized in that: The IaaS file storage service of the cloud platform manages the GPFS cluster by calling the agent, including: The IaaS file storage service in the cloud platform management area calls the API encapsulated by the agent on the GUI management node in the GPFS cluster to obtain the necessary data and stores it in the database of the file storage service.

3. The method for connecting a cloud platform to GPFS according to claim 2, characterized in that: The necessary data include: Cluster management IP, storage IP, cluster capacity information, and cluster created file system data.

4. The method for connecting a cloud platform to GPFS according to claim 1, characterized in that: The method further comprises: The RoCE storage switch connects the GPFS cluster, cloud platform, and business cluster.

5. The method for connecting a cloud platform to GPFS according to claim 1, characterized in that: The cloud platform sends a message to create a business cluster, including: The cloud platform sends the delivery data for creating the business cluster; the delivery data includes the name, size, number of nodeIds of the created file system and the destination client of the export; The IaaS file storage service calls the agent of the GPFS cluster management node to create a file system with specified parameters, and exports the file system to NFS according to the whitelist issued. IaaS network services allocate network resources to business clusters and configure network parameters; The IaaS computing service opens computing resources and forms corresponding clusters.

6. A system for connecting a cloud platform to a GPFS system, characterized in that: The system comprises: The deployment module is configured to deploy the agent on the GPFS cluster management node; A management module is configured for the IaaS file storage service of the cloud platform to manage the GPFS cluster by calling the agent; In addition, the cloud platform's IaaS network service manages GPFS cluster network data by calling the RoCE storage switch interface; The business cluster creation module is configured to create business clusters issued by the cloud platform; The mounting module is configured to mount the GPFS file system on the business cluster.

7. An electronic device, characterized in that: The electronic device includes: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor executes the method for connecting a cloud platform to use GPFS as described in any one of claims 1 to 4.

8. A computer program product, characterized in that The computer program product includes a computing program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the method for connecting a cloud platform to use GPFS as described in any one of claims 1 to 4.

Images