Method for automatically maintaining GPFS (General Purpose File System) based on agent

Abstract

The invention provides an agent-based method for automatically maintaining a GPFS (General Purpose File System), which comprises the following steps: deploying and starting an agent on at least one node in a GPFS cluster, encapsulating a plurality of CLI (Command Line Interface) commands and providing a group of API (Application Program Interface) interfaces by the agent, and interacting an upper-layer application service with the GPFS by the API interfaces. And the upper-layer application service calls an API interface according to a business demand, and automatically initiates a management operation on the GPFS based on the interface. And executing the CLI command on the cluster node, and operating the GPFS based on the CLI command. According to the operation result of the GPFS, mounting operation is automatically executed, the file system is configured, and the mounting operation is dynamically optimized according to the client hardware environment and the network topology. According to the method provided by the invention, the GPFS file system can be automatically maintained, and the maintenance efficiency is improved.

Description

Technical Field

[0001] The present application relates to the technical field of cloud computing, and in particular to an agent-based method for automatically maintaining GPFS. Background Art

[0002] With the continuous development of science and technology, cloud computing is increasingly used in all aspects of life. At present, in the field of cloud computing, the maintenance of GPFS file system is generally done manually through the GUI interface or CLI commands to create, configure, delete, authorize, mount and expand the capacity in steps to maintain and use the GPFS file system. However, manual maintenance of GPFS file system is inefficient.

[0003] Therefore, how to improve the maintenance efficiency of the GPFS file system has become a technical problem that technical personnel in this field need to solve urgently. Summary of the invention

[0004] Based on the above problems, the present application provides an agent-based method for automatically maintaining GPFS, which can automatically maintain GPFS.

[0005] The present application provides a method for automatically maintaining GPFS based on an agent, the method comprising the following steps:

[0006] Deploy and start an agent on at least one node in the GPFS cluster, wherein the agent encapsulates multiple CLI commands and provides a set of API interfaces, wherein the API interfaces are used for upper-layer application services to interact with GPFS;

[0007] The upper-layer application service calls the API interface according to business requirements, and automatically initiates management operations on GPFS based on the API interface;

[0008] Execute CLI commands on cluster nodes and perform operations on GPFS based on the CLI commands, including creation, deletion, configuration, authorization, NFS export, mounting, and expansion of GPFS;

[0009] According to the operation result of GPFS, the mount operation is automatically performed and the file system is configured. The mount operation is dynamically optimized according to the client hardware environment and network topology.

[0010] In a possible implementation, the API interface is specifically used to:

[0011] Dynamically adjust operation strategies based on storage resources in different cloud environments and automatically adapt to different deployment platforms, including private cloud, public cloud and hybrid cloud environments.

[0012] In a possible implementation, the CLI commands include at least one set of optimization commands for GPFS management, where the optimization commands are used to dynamically adjust operation parameters to adapt to different versions of GPFS file systems.

[0013] In a possible implementation, the method further includes:

[0014] When performing operations on the GPFS, real-time monitoring of system resource usage, operation execution progress, and potential risks;

[0015] Automatically optimize operation steps or adjust strategies based on the system resource usage, operation execution progress and potential risks.

[0016] The present application also provides an agent-based automatic maintenance device for GPFS, the device comprising:

[0017] A deployment module, used to deploy and start an agent on at least one node in the GPFS cluster, wherein the agent encapsulates multiple CLI commands and provides a set of API interfaces, wherein the API interfaces are used for interaction between upper-layer application services and GPFS;

[0018] A calling module, used for the upper-layer application service to call the API interface according to business needs, and automatically initiate management operations on GPFS based on the API interface;

[0019] An execution module, used to execute CLI commands on cluster nodes and perform operations on GPFS based on the CLI commands, including creation, deletion, configuration, authorization, NFS export, mounting and expansion of GPFS;

[0020] The configuration module is used to automatically perform a mount operation and configure the file system according to the operation result of the GPFS, and the mount operation is dynamically optimized according to the client hardware environment and the network topology.

[0021] The present application also provides an electronic device, the electronic device comprising a processor and a memory:

[0022] The memory is used to store a computer program and transmit the computer program to the processor;

[0023] The processor is used to execute the steps of the above-mentioned agent-based automatic maintenance GPFS method according to the instructions in the computer program.

[0024] The present application also provides a computer-readable storage medium, which is used to store a computer program. When the computer program is executed by an electronic device, the steps of the above-mentioned agent-based automatic maintenance method of GPFS are implemented.

[0025] Compared with the prior art, this application has the following beneficial effects:

[0026] The present invention provides a method for automatically maintaining GPFS based on an agent. Traditional GPFS file system management usually relies on a GUI interface or a CLI command, involves multi-step operations, and is prone to operational errors due to manual input errors. Through the agent automated management method in the present invention, all operations are triggered through an API interface, and CLI commands are automatically executed, which greatly simplifies the management process. The upper-layer application service only needs to initiate an operation request through the API interface, and the agent is responsible for selecting the correct operation path and executing specific commands, thereby avoiding human errors and improving the accuracy and reliability of system operations. The present invention enables operations such as creation, deletion, configuration, authorization, mounting, and expansion of the GPFS file system to be automatically completed by calling an API interface, eliminating the cumbersome process of manually executing each operation step in the traditional method. By encapsulating these operations into a unified API interface, the system administrator only needs to perform configuration or settings once, and all subsequent operations can be completed through automated scripts and API interfaces, reducing the manual operations of operation and maintenance personnel and greatly saving operation and maintenance costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0028] Figure 1 A flowchart of an agent-based automated maintenance method for GPFS provided in an embodiment of the present application;

[0029] Figure 2 A schematic diagram of the structure of an agent-based automatic maintenance GPFS device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] As described above, in the current cloud computing field, the maintenance of GPFS file systems is generally done manually through the GUI interface or CLI commands to create, configure, delete, authorize, mount, and expand the capacity in steps to maintain and use the GPFS file system. However, manual maintenance of the GPFS file system is inefficient.

[0031] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0032] It is understandable that the method provided in the present application can be applied to a processing device, which is a processing device that can deploy and start an agent on at least one node in a GPFS cluster, for example, a terminal device or server that can deploy and start an agent on at least one node in a GPFS cluster. The method provided in the present application can be executed independently by a terminal device or a server, or it can be applied to a network scenario in which a terminal device and a server communicate, and is executed by the cooperation of a terminal device and a server. Among them, the terminal device can be a computer, a mobile phone and other devices. The server can be understood as an application server or a Web server. In actual deployment, the server can be an independent server or a cluster server.

[0033] Figure 1 A flowchart of a method for automatically maintaining GPFS based on an agent provided in this application, the method comprising the following steps:

[0034] S101: Deploy and start an agent on at least one node in the GPFS cluster.

[0035] The processing device deploys and starts an agent on at least one node in the GPFS cluster. The agent encapsulates multiple CLI commands and provides a set of API interfaces. The API interfaces are used for upper-layer application services to interact with GPFS.

[0036] As the hub of cluster management, the agent can encapsulate multiple common GPFS management CLI commands and provide a set of API interfaces for interacting with upper-layer application services. These API interfaces can effectively simplify GPFS management operations, avoid manual intervention, and improve the level of operation automation. Through this API interface, application services can programmatically trigger file system management operations (such as creation, mounting, etc.) to achieve cross-platform, automated management.

[0037] In a possible implementation, the API interface can dynamically adjust the operation strategy according to the storage resources in different cloud environments and automatically adapt to different deployment platforms. Whether it is a private cloud, public cloud or hybrid cloud environment, the agent's API interface can intelligently judge the different characteristics of the deployed platform and automatically adjust the strategy to ensure efficient management and performance optimization of GPFS. This adaptive design enables the present invention to have a wide range of application scenarios and can adapt to a variety of cloud environments.

[0038] S102: The upper-layer application service calls the API interface according to business requirements, and automatically initiates management operations on the GPFS based on the API interface.

[0039] The upper-layer application service automatically initiates management operations on the GPFS file system by calling the API interface provided by the agent according to actual business needs. The application service no longer needs manual configuration and management, but controls the GPFS system through a programmatic interface. In this way, the application service can dynamically initiate operations such as creation, configuration, and expansion of the file system according to different business needs, thereby simplifying the maintenance process.

[0040] The CLI commands include at least one set of optimization commands for GPFS management. The optimization commands can automatically adjust the operation parameters according to the current cluster status, GPFS version, and resource configuration. The introduction of these optimization commands ensures that the operation parameters can be dynamically adapted in different versions of the GPFS file system, improving the compatibility and operation efficiency of the system and avoiding the management difficulties caused by version differences.

[0041] S103: Execute CLI commands on the cluster nodes, and operate GPFS based on the CLI commands.

[0042] The processing device executes CLI commands on the cluster nodes and performs operations on GPFS based on CLI commands. The operations include creation, deletion, configuration, authorization, NFS export, mounting, and expansion of GPFS.

[0043] After receiving the request from the upper-layer application service, the agent will automatically execute the corresponding CLI command to perform various operations on the file system. Specific operations include: creating, deleting, configuring, authorizing, exporting, mounting, and expanding the file system. These operations usually require multiple manual executions, and each operation involves the execution of multiple commands, which is prone to errors. Through the automated execution of the agent, not only the process is greatly simplified, but also the operational efficiency is improved and manual intervention is reduced.

[0044] For example, when creating a file system, the agent automatically identifies the storage space and configuration parameters that need to be created and executes the corresponding commands without manual intervention.

[0045] S104: According to the operation result of GPFS, the mount operation is automatically performed and the file system is configured.

[0046] The processing device automatically performs the mount operation and configures the file system according to the operation results of GPFS. The mount operation is dynamically optimized according to the client hardware environment and network topology.

[0047] The agent will automatically initiate the mount operation based on the previous operation results of GPFS (such as creation, expansion, etc.), and perform intelligent optimization based on the client's hardware environment, operating system version, and network topology. Through this dynamic optimization, the system can adjust the mount strategy according to the actual needs of the client to ensure that the file system can run efficiently and stably. Dynamic optimization not only improves the mount efficiency, but also adjusts the storage access mode according to actual usage to avoid performance bottlenecks.

[0048] When performing operations, the agent will also monitor the system resource usage, operation execution progress and potential risks in real time to ensure that the entire operation process is carried out within a safe and controllable range. During the monitoring process, the agent will automatically optimize the operation steps according to the resource usage and operation execution progress, or automatically adjust the strategy according to potential risks. For example, if the system resource consumption is too high, the agent will automatically postpone certain operations or change the order of operation execution to ensure system stability and reduce risks in operation.

[0049] The present invention provides a method for automatically maintaining GPFS based on an agent. Traditional GPFS file system management usually relies on a GUI interface or a CLI command, involves multi-step operations, and is prone to operational errors due to manual input errors. Through the agent automated management method in the present invention, all operations are triggered through an API interface, and CLI commands are automatically executed, which greatly simplifies the management process. The upper-layer application service only needs to initiate an operation request through the API interface, and the agent is responsible for selecting the correct operation path and executing specific commands, thereby avoiding human errors and improving the accuracy and reliability of system operations. The present invention enables operations such as creation, deletion, configuration, authorization, mounting, and expansion of the GPFS file system to be automatically completed by calling an API interface, eliminating the cumbersome process of manually executing each operation step in the traditional method. By encapsulating these operations into a unified API interface, the system administrator only needs to perform configuration or settings once, and all subsequent operations can be completed through automated scripts and API interfaces, reducing the manual operations of operation and maintenance personnel and greatly saving operation and maintenance costs.

[0050] This application also provides a Figure 2The schematic diagram of the structure of the agent-based automatic maintenance GPFS device shown in FIG. 200 includes the following modules:

[0051] A deployment module 201 is used to deploy and start an agent on at least one node in a GPFS cluster, wherein the agent encapsulates multiple CLI commands and provides a set of API interfaces, wherein the API interfaces are used for interaction between upper-layer application services and GPFS;

[0052] The calling module 202 is used for the upper layer application service to call the API interface according to the business requirements, and automatically initiate the management operation of GPFS based on the API interface;

[0053] An execution module 203 is used to execute CLI commands on cluster nodes and perform operations on GPFS based on the CLI commands, wherein the operations include creation, deletion, configuration, authorization, NFS export, mounting and expansion of GPFS;

[0054] The configuration module 204 is used to automatically perform a mount operation and configure the file system according to the operation result of the GPFS, and the mount operation is dynamically optimized according to the client hardware environment and the network topology.

[0055] The present invention provides an agent-based device for automatically maintaining GPFS. Traditional GPFS file system management usually relies on a GUI interface or a CLI command, involves multi-step operations, and is prone to operational errors due to manual input errors. Through the agent automated management method in the present invention, all operations are triggered through an API interface, and CLI commands are automatically executed, which greatly simplifies the management process. The upper-layer application service only needs to initiate an operation request through the API interface, and the agent is responsible for selecting the correct operation path and executing specific commands, thereby avoiding human errors and improving the accuracy and reliability of system operations. The present invention enables operations such as creation, deletion, configuration, authorization, mounting, and expansion of the GPFS file system to be automatically completed by calling an API interface, eliminating the cumbersome process of manually executing each operation step in the traditional method. By encapsulating these operations into a unified API interface, the system administrator only needs to perform configuration or settings once, and all subsequent operations can be completed through automated scripts and API interfaces, reducing the manual operations of operation and maintenance personnel and greatly saving operation and maintenance costs.

[0056] An embodiment of the present application also provides a device for automatically maintaining GPFS based on an agent, wherein the device includes a memory and a processor, the memory is used to store instructions or codes, and the processor is used to execute the instructions or codes so that the device performs the steps of the method for automatically maintaining GPFS based on an agent as described in any embodiment of the present application.

[0057] In practical applications, the computer-readable storage medium may be any combination of one or more computer-readable media, which may be a computer-readable signal medium or a computer-readable storage medium.

[0058] The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device, or device.

[0059] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0060] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0061] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0062] It should be noted that each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described above is merely schematic, in which the unit described as a separate component may or may not be physically separated, and the component prompted as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0063] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An agent-based method for automatically maintaining GPFS, characterized in that: include: Deploy and start an agent on at least one node in the GPFS cluster, wherein the agent encapsulates multiple CLI commands and provides a set of API interfaces, wherein the API interfaces are used for upper-layer application services to interact with GPFS; The upper-layer application service calls the API interface according to business requirements, and automatically initiates management operations on GPFS based on the API interface; Execute CLI commands on cluster nodes and perform operations on GPFS based on the CLI commands, including creation, deletion, configuration, authorization, NFS export, mounting, and expansion of GPFS; According to the operation result of GPFS, the mount operation is automatically performed and the file system is configured. The mount operation is dynamically optimized according to the client hardware environment and network topology.

2. The method according to claim 1, characterized in that The API interface is specifically used for: Dynamically adjust operation strategies based on storage resources in different cloud environments and automatically adapt to different deployment platforms, including private cloud, public cloud and hybrid cloud environments.

3. The method according to claim 1, characterized in that The CLI commands include at least one group of optimization commands for GPFS management, where the optimization commands are used to dynamically adjust operation parameters to adapt to different versions of GPFS file systems.

4. The method according to claim 1, characterized in that: The method further comprises: When performing operations on the GPFS, real-time monitoring of system resource usage, operation execution progress, and potential risks; Automatically optimize operation steps or adjust strategies based on the system resource usage, operation execution progress and potential risks.

5. An agent-based automatic maintenance device for GPFS, characterized in that: include: A deployment module, used to deploy and start an agent on at least one node in the GPFS cluster, wherein the agent encapsulates multiple CLI commands and provides a set of API interfaces, wherein the API interfaces are used for interaction between upper-layer application services and GPFS; A calling module, used for the upper-layer application service to call the API interface according to business needs, and automatically initiate management operations on GPFS based on the API interface; An execution module, used to execute CLI commands on cluster nodes and perform operations on GPFS based on the CLI commands, including creation, deletion, configuration, authorization, NFS export, mounting and expansion of GPFS; The configuration module is used to automatically perform a mount operation and configure the file system according to the operation result of the GPFS, and the mount operation is dynamically optimized according to the client hardware environment and the network topology.

6. An electronic device, characterized in that: comprising a memory and a processor, wherein: The memory is used to store the computer program; The processor is used to execute the computer program to implement the agent-based automatic maintenance method of GPFS as described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that: Used to store a computer program, wherein when the computer program is executed by a processor, the agent-based automatic maintenance method of GPFS according to any one of claims 1 to 4 is implemented.

Images