Resource management system and method in multi-cloud environment

Abstract

The invention relates to a resource management system and method in a multi-cloud environment, and belongs to the technical field of data processing.The resource management system in the multi-cloud environment comprises a resource management module used for sending a first resource request to a plurality of plug-in adaptation modules, the first resource request is used for requesting resource information of a plurality of cloud platforms, and the plug-in adaptation modules are used for receiving the resource information of the plurality of cloud platforms; each plug-in adaptation module corresponds to a cloud platform; the plug-in adaptation module is used for sending a second resource request to a target cloud platform based on the first resource request and receiving resource information sent by the target cloud platform, the target cloud platform is a cloud platform corresponding to the plug-in adaptation module, and the second resource request is used for requesting the resource information of the target cloud platform. According to the invention, the complexity of resource management in the multi-cloud environment is reduced, and the efficiency of resource management in the multi-cloud environment is improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a resource management system and method in a multi-cloud environment. Background Art

[0002] With the rapid development of cloud computing, more and more enterprises and organizations are adopting multi-cloud environments to improve system reliability and reduce the risk of a single cloud platform. At the same time, they are choosing cloud services from different vendors to achieve cost optimization and technology diversification. Multi-cloud environments not only make resources more flexible, but also enhance disaster recovery capabilities, but the challenge that comes with it is how to achieve efficient resource management and monitoring between multiple cloud platforms.

[0003] In a multi-cloud environment, each cloud service provider provides independent management interfaces and different application programming interfaces (APIs). In addition, due to differences in data models and resource management methods of different cloud platforms, it is also quite complicated to implement cross-cloud resource operations and automated scheduling. Traditional single cloud platform management tools often cannot meet the complex requirements in a multi-cloud environment. Therefore, how to reduce the complexity of resource management in a multi-cloud environment and improve the efficiency of resource management has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] In view of this, it is necessary to provide a resource management system and method in a multi-cloud environment to solve the problem of high complexity and low efficiency of resource management in the current multi-cloud environment.

[0005] In order to solve the above problems, the present invention provides a resource management system in a multi-cloud environment, comprising: A resource management module, used to send a first resource request to a plurality of plug-in adapter modules, wherein the first resource request is used to request resource information of a plurality of cloud platforms, and each plug-in adapter module corresponds to a cloud platform; The plug-in adaptation module is used to send a second resource request to the target cloud platform based on the first resource request, and receive resource information sent by the target cloud platform. The target cloud platform is the cloud platform corresponding to the plug-in adaptation module, and the second resource request is used to request resource information of the target cloud platform.

[0006] In one possible implementation, the plug-in adaptation module is also used to, after receiving the resource information sent by the target cloud platform, convert the resource information sent by the target cloud platform into a preset data structure, and send the converted resource information sent by the target cloud platform to the resource management module.

[0007] In a possible implementation, the system further includes: A data storage module is used to store the converted resource information sent by the target cloud platform and store the first resource request.

[0008] In a possible implementation, the first resource request is sent by a Web front end to the resource management module through an API gateway.

[0009] In a possible implementation, the second resource request is sent to the target cloud platform based on an API calling standard of the target cloud platform.

[0010] In a possible implementation, the resource information of the target cloud platform includes one or more of the following: Instance information, storage information, network information, virtual machine information, ECS information, and RDS information.

[0011] The present invention also provides a resource management method in a multi-cloud environment implemented based on the resource management system in a multi-cloud environment, comprising: After receiving the first resource request, sending a second resource request to the target cloud platform based on the first resource request, wherein the first resource request is used to request resource information of multiple cloud platforms, and the second resource request is used to request resource information of the target cloud platform; Receive resource information sent by the target cloud platform.

[0012] In a possible implementation, the method further includes: After receiving the resource information sent by the target cloud platform, the resource information sent by the target cloud platform is converted into a preset data structure.

[0013] In a possible implementation, the sending a second resource request to the target cloud platform based on the first resource request includes: determining the second resource request based on the first resource request; The second resource request is sent to the target cloud platform based on the API calling standard of the target cloud platform.

[0014] In a possible implementation, the resource information of the target cloud platform includes one or more of the following: Instance information, storage information, network information, virtual machine information, ECS information, and RDS information.

[0015] The beneficial effect of the present invention is as follows: the resource management system and method in a multi-cloud environment provided by the present invention first sends a first resource request to multiple plug-in adapter modules through a resource management module to request resource information of multiple cloud platforms, and then each plug-in adapter module requests resources from its corresponding cloud platform. By setting multiple plug-in adapter modules to correspond to multiple cloud platforms, interaction with different cloud platforms can be achieved through different plug-in adapter modules, thereby reducing the complexity of resource management in a multi-cloud environment and improving the efficiency of resource management in a multi-cloud environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic diagram of the structure of an embodiment of a resource management system in a multi-cloud environment provided by the present invention; Figure 2 A schematic diagram of a flow chart of an embodiment of a resource management method in a multi-cloud environment provided by the present invention; Figure 3 This is a schematic diagram of the architecture of an embodiment of a resource management platform in a multi-cloud environment provided by the present invention. DETAILED DESCRIPTION

[0017] The preferred embodiments of the present invention are described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of this application and are used together with the embodiments of the present invention to illustrate the principles of the present invention, but are not used to limit the scope of the present invention.

[0018] In the description of the present invention, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0019] In the description of the present invention, reference to an "embodiment" means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the described embodiments may be combined with other embodiments.

[0020] With the rapid development of cloud computing, more and more enterprises and organizations are adopting multi-cloud environments to improve system reliability and reduce the risk of a single cloud platform. At the same time, they are choosing cloud services from different vendors to achieve cost optimization and technology diversification. Multi-cloud environments not only make resources more flexible, but also enhance disaster recovery capabilities, but the challenge that comes with it is how to achieve efficient resource management and monitoring between multiple cloud platforms.

[0021] In a multi-cloud environment, each cloud service provider provides independent management interfaces and different APIs. In addition, due to differences in data models and resource management methods of different cloud platforms, it is also quite complicated to implement cross-cloud resource operations and automated scheduling. Traditional single cloud platform management tools often cannot meet the complex needs of a multi-cloud environment.

[0022] In order to solve the above problems, the present invention provides a resource management system in a multi-cloud environment.

[0023] The specific embodiments are described in detail below: A specific embodiment of the present invention discloses a resource management system in a multi-cloud environment, combining Figure 1 Come and see, Figure 1 This is a schematic diagram of a structure of an embodiment of a resource management system in a multi-cloud environment provided by the present invention. The resource management system 100 in a multi-cloud environment includes: The resource management module 101 is used to send a first resource request to multiple plug-in adapter modules, where the first resource request is used to request resource information of multiple cloud platforms, and each plug-in adapter module corresponds to a cloud platform; The plug-in adaptation module 102 is used to send a second resource request to the target cloud platform based on the first resource request, and receive resource information sent by the target cloud platform. The target cloud platform is the cloud platform corresponding to the plug-in adaptation module, and the second resource request is used to request resource information of the target cloud platform.

[0024] During implementation, a first resource request may be sent to multiple plug-in adapter modules through a resource management module to request resource information of multiple cloud platforms. The first resource request may be operations such as obtaining resources, creating resources, and deleting resources. The requested resources may be instance resources, network resources, storage resources, and the like.

[0025] Each of the multiple plug-in adapter modules corresponds to a cloud platform, so that interaction with different cloud platforms is achieved through different plug-in adapter modules.

[0026] After receiving the first resource request, the plug-in adapter module can determine the second resource request and send it to the target cloud platform based on the resource information of the target cloud platform (i.e., the cloud platform corresponding to the plug-in adapter module) requested in the first resource request to request the resource information of the target cloud platform, and then receive the resource information sent by the target cloud platform.

[0027] Compared with the prior art, the resource management system in a multi-cloud environment provided by this embodiment first sends a first resource request to multiple plug-in adapter modules through a resource management module to request resource information of multiple cloud platforms, and then each plug-in adapter module requests resources from its corresponding cloud platform. By setting multiple plug-in adapter modules to correspond to multiple cloud platforms, interaction with different cloud platforms can be achieved through different plug-in adapter modules, thereby reducing the complexity of resource management in a multi-cloud environment and improving the efficiency of resource management in a multi-cloud environment.

[0028] Exemplarily, the plug-in adaptation module is also used to, after receiving the resource information sent by the target cloud platform, convert the resource information sent by the target cloud platform into a preset data structure, and send the converted resource information sent by the target cloud platform to the resource management module.

[0029] Specifically, after receiving the resource information sent by the target cloud platform, the plug-in adaptation module can also convert the resource information sent by the target cloud platform into a preset data structure. The purpose is to convert the resource information of each cloud platform into a unified resource data structure, thereby further improving the efficiency of resource management.

[0030] Exemplarily, the system further includes: A data storage module is used to store the converted resource information sent by the target cloud platform and store the first resource request.

[0031] Specifically, a data storage module may also be provided in the system to store the resource information and the first resource request sent by the converted target cloud platform, so as to facilitate subsequent quick query and audit.

[0032] Exemplarily, the first resource request is sent from the Web front end to the resource management module through an API gateway.

[0033] Specifically, the first resource request can be initiated by a user, administrator, etc. on the Web front end, and then sent to the resource management module through the API gateway.

[0034] Exemplarily, the second resource request is sent to the target cloud platform based on an API calling standard of the target cloud platform.

[0035] Specifically, since different cloud platforms have different API calling standards, when the plug-in adapter module sends the second resource request to the target cloud platform, it needs to send it according to the API calling standard of the target cloud platform.

[0036] Exemplarily, the resource information of the target cloud platform includes one or more of the following: Instance information, storage information, network information, virtual machine information, ECS information, and RDS information.

[0037] Specifically, the resource information of the target cloud platform may include one or more of instance information, storage information, network information, virtual machine information, cloud server (Elastic Compute Service, ECS) information, and cloud database (Relational Database Service, RDS) information.

[0038] The embodiment of the present invention also provides a resource management method in a multi-cloud environment implemented based on the resource management system in a multi-cloud environment. Figure 2 Come and see, Figure 2 The flowchart of an embodiment of a resource management method in a multi-cloud environment provided by the present invention includes step S201 and step S202, wherein: In step S201, after receiving a first resource request, a second resource request is sent to a target cloud platform based on the first resource request, wherein the first resource request is used to request resource information of multiple cloud platforms, and the second resource request is used to request resource information of the target cloud platform; In step S202, resource information sent by the target cloud platform is received.

[0039] During implementation, after receiving the first resource request, the plug-in adapter module can determine the second resource request and send it to the target cloud platform based on the resource information of the target cloud platform (i.e., the cloud platform corresponding to the plug-in adapter module) requested in the first resource request to request the resource information of the target cloud platform, and then receive the resource information sent by the target cloud platform.

[0040] Compared with the prior art, the resource management method in a multi-cloud environment provided by this embodiment is that the plug-in adapter module requests resources from its corresponding cloud platform, and by setting multiple plug-in adapter modules to correspond to multiple cloud platforms, interaction with different cloud platforms can be achieved through different plug-in adapter modules, thereby reducing the complexity of resource management in a multi-cloud environment and improving the efficiency of resource management in a multi-cloud environment.

[0041] Exemplarily, the method further includes: After receiving the resource information sent by the target cloud platform, the resource information sent by the target cloud platform is converted into a preset data structure.

[0042] Specifically, after receiving the resource information sent by the target cloud platform, the plug-in adaptation module can also convert the resource information sent by the target cloud platform into a preset data structure. The purpose is to convert the resource information of each cloud platform into a unified resource data structure, thereby further improving the efficiency of resource management.

[0043] Exemplarily, the sending a second resource request to the target cloud platform based on the first resource request includes: determining the second resource request based on the first resource request; The second resource request is sent to the target cloud platform based on the API calling standard of the target cloud platform.

[0044] Specifically, after receiving the first resource request, the plug-in adaptation module may first determine the second resource request according to the resource information of the target cloud platform requested in the first resource request.

[0045] Since different cloud platforms have different API calling standards, when the plug-in adapter module sends the second resource request to the target cloud platform, it needs to send it according to the API calling standard of the target cloud platform.

[0046] Exemplarily, the resource information of the target cloud platform includes one or more of the following: Instance information, storage information, network information, virtual machine information, ECS information, and RDS information.

[0047] Specifically, the resource information of the target cloud platform may include one or more of instance information, storage information, network information, virtual machine information, ECS information, and RDS information.

[0048] The technical solution of the present invention is better described below with reference to a specific embodiment: Combination Figure 3 Come and see, Figure 3 This is a schematic diagram of the architecture of an embodiment of a resource management platform in a multi-cloud environment provided by the present invention. The platform specifically includes: 1. User interaction layer.

[0049] The user interaction layer consists of the Web front end and the API gateway.

[0050] Web front-end: Users interact with the system through the web interface, view the resource status across cloud platforms, and perform management operations (such as starting and stopping instances). Front-end frameworks (such as VUE) interact with the business logic layer of the platform through RESTful APIs.

[0051] API Gateway (RESTful API Layer): Provides calls to users and other systems through REST API. The API Gateway handles the routing of requests and forwards them to specific service layers.

[0052] Users request to view cloud platform resources through the web interface. The API gateway receives the request and forwards it to the relevant modules of the business logic layer, such as the resource manager or monitoring module.

[0053] 2. Service layer (business logic layer).

[0054] The service layer consists of a resource manager, a task scheduler, a monitoring and alarm module, and a log management module.

[0055] Resource Manager: Responsible for cross-cloud resource management functions, including obtaining resource information, creating resources, deleting resources, etc. It interacts with the cloud vendor adapters of the plug-in adaptation layer.

[0056] Task Scheduler: Responsible for scheduling automated tasks, such as synchronizing resources at regular intervals, scheduling tasks according to policies, etc. The scheduler is closely integrated with the resource manager to ensure the execution of tasks.

[0057] Monitoring and alarm module: collects and analyzes resource monitoring data of each cloud platform. If a cloud resource is abnormal (such as instance shutdown, high CPU usage), an alarm will be triggered.

[0058] Log management module (Logging): records all operation logs for auditing and troubleshooting. Logs are stored in services such as Elasticsearch.

[0059] User requests are transmitted to the business logic layer through the API gateway. The resource manager calls the cloud platform's API through the plug-in adaptation layer to obtain resource status, configuration and other information. The task scheduler triggers resource synchronization and operations according to predetermined strategies. The monitoring and alarm module analyzes the operating status of resources in real time and issues alarms. All operations will be recorded in the log module to ensure that the operations are traceable.

[0060] 3. Plug-in adaptation layer (Cloud Provider Layer).

[0061] The plug-in adaptation layer consists of plug-in adapters corresponding to different cloud platforms.

[0062] Plug-in adapter: Each cloud vendor uses a separate adapter to connect to the platform. The adapter follows a unified interface specification and implements API interactions between different cloud platforms.

[0063] HUAWEI Cloud Adapter: interacts with HUAWEI Cloud to obtain instance, storage, network and other resource information.

[0064] Tencent Cloud Adapter: interacts with Tencent Cloud API to obtain instance, storage, network and other resource information.

[0065] NST-T adapter: interacts with the NST-T API to obtain instance, storage, network and other resource information.

[0066] AWS Adapter: Interact with AWS API to obtain instance, storage, network and other resource information.

[0067] Azure Adapter: Interact with Azure API to obtain resource information such as virtual machines and storage.

[0068] Alibaba Cloud Adapter: interacts with the Alibaba Cloud API to obtain resource information such as ECS and RDS.

[0069] Google Cloud Adapter: Interact with the GCP API to obtain resource information such as virtual machines and storage.

[0070] The resource manager of the business logic layer initiates a cross-cloud resource request by calling the plug-in adapter interface. The plug-in adapter initiates a request to the corresponding cloud platform according to the cloud vendor API calling standard. After obtaining the data returned by the cloud platform, the plug-in adapter converts the data into a unified resource data structure and returns it to the business logic layer.

[0071] 4. Data Layer

[0072] The data layer can store metadata, logs, and audits.

[0073] Metadata storage: Stores all cloud platform resource information (such as virtual machine ID, status, region, etc.). Use Mongodb to manage this data.

[0074] Log and audit storage: All platform operations (such as starting, stopping, and deleting resources) will be recorded in the log system. Log storage uses Elasticsearch for efficient query and analysis.

[0075] The plug-in adapter converts the resource information obtained from each cloud platform into a standardized data format, which is stored in Mongodb to ensure that the platform can query the status of all resources across clouds. All user operations (such as creating and deleting resources) are recorded in the log system and stored in Elasticsearch to support fast query and audit.

[0076] To ensure good scalability, the present invention designs the adaptation layer of the core architecture to be modular and plug-in-based. In this way, each time a new cloud vendor is added, only a new plug-in needs to be added to the adaptation layer, and other parts do not need to be modified. The access to each cloud platform is implemented through a separate plug-in, and the plug-in is decoupled from other levels of the platform as part of the adaptation layer. The plug-in is mainly responsible for the authentication, API call, resource management and other functions of the cloud platform. Containerization technology (such as Docker and Kubernetes) is used for plug-in management. When a new cloud vendor is added to the platform, it can be dynamically expanded through container updates or Kubernetes deployment.

[0077] Each cloud vendor's plug-in needs to rely on the vendor's SDK or REST API to implement the interface. During integration, the platform's control layer will dynamically load these plug-ins through the factory mode. In order to dynamically expand cloud vendors, the platform uses a plug-in manager to manage the loading and unloading of cloud vendor plug-ins. The plug-in manager supports dynamic loading of plug-ins through configuration files, environment variables, or service registration centers.

[0078] The present invention uses a standardized data model and a unified API interface to enable users to easily manage resources from different cloud vendors (such as Tencent Cloud, Huawei Cloud, Alibaba Cloud, NSX-T, etc.) on a single platform. Whether it is virtual machines, storage or network resources, they can all be viewed and operated in a unified interface, avoiding the trouble of switching multiple management consoles in traditional multi-cloud environments.

[0079] The present invention adopts a plug-in architecture, and each cloud platform is connected to the platform through an independent adapter. When a new cloud vendor needs to be supported, only a new adapter plug-in needs to be added and registered to the platform, which greatly improves the scalability of the platform. The access of new vendors has almost no impact on the operation of the existing system, and supports dynamic loading and unloading of plug-ins to ensure the flexibility of the system.

[0080] The present invention provides cross-cloud real-time monitoring functions to help users track the health status, performance indicators and usage of each cloud platform resource in real time. Through the integrated cost analysis tool, users can accurately understand the cost of each cloud platform resource and reduce unnecessary resource waste through data analysis and optimization suggestions.

[0081] The present invention can help users monitor and record the resource configuration and operation of each cloud platform to ensure compliance with the enterprise's security policies and compliance requirements. At the same time, the platform supports permission management and identity authentication in a multi-cloud environment, further improving data security.

[0082] The present invention manages and schedules cross-cloud resources through a unified platform, which simplifies the work of operation and maintenance personnel, reduces the complex operations required for managing different cloud platforms, improves operation and maintenance efficiency and reduces the risk of errors.

[0083] The present invention discloses a resource management system and method in a multi-cloud environment. First, a first resource request is sent to multiple plug-in adapter modules through a resource management module to request resource information of multiple cloud platforms. Then, each plug-in adapter module requests resources from its corresponding cloud platform. By setting multiple plug-in adapter modules to correspond to multiple cloud platforms, different plug-in adapter modules can be used to interact with different cloud platforms, thereby reducing the complexity of resource management in a multi-cloud environment and improving the efficiency of resource management in a multi-cloud environment.

[0084] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by any technician familiar with the technical field within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention.

Claims

1. A resource management system in a multi-cloud environment, characterized in that: include: A resource management module, used to send a first resource request to a plurality of plug-in adapter modules, wherein the first resource request is used to request resource information of a plurality of cloud platforms, and each plug-in adapter module corresponds to a cloud platform; The plug-in adaptation module is used to send a second resource request to the target cloud platform based on the first resource request, and receive resource information sent by the target cloud platform. The target cloud platform is the cloud platform corresponding to the plug-in adaptation module, and the second resource request is used to request resource information of the target cloud platform.

2. The resource management system in a multi-cloud environment according to claim 1, characterized in that: The plug-in adaptation module is also used to, after receiving the resource information sent by the target cloud platform, convert the resource information sent by the target cloud platform into a preset data structure, and send the converted resource information sent by the target cloud platform to the resource management module.

3. The resource management system in a multi-cloud environment according to claim 2, characterized in that: The system further comprises: A data storage module is used to store the converted resource information sent by the target cloud platform and store the first resource request.

4. The resource management system in a multi-cloud environment according to claim 1, characterized in that: The first resource request is sent from the Web front end to the resource management module through the API gateway.

5. The resource management system in a multi-cloud environment according to claim 1, characterized in that: The second resource request is sent to the target cloud platform based on the API calling standard of the target cloud platform.

6. The resource management system in a multi-cloud environment according to claim 1, characterized in that: The resource information of the target cloud platform includes one or more of the following: Instance information, storage information, network information, virtual machine information, ECS information, and RDS information.

7. A resource management method in a multi-cloud environment implemented based on the resource management system in a multi-cloud environment according to any one of claims 1 to 6, characterized in that: include: After receiving the first resource request, sending a second resource request to the target cloud platform based on the first resource request, wherein the first resource request is used to request resource information of multiple cloud platforms, and the second resource request is used to request resource information of the target cloud platform; Receive resource information sent by the target cloud platform.

8. The resource management method in a multi-cloud environment according to claim 7, characterized in that: The method further comprises: After receiving the resource information sent by the target cloud platform, the resource information sent by the target cloud platform is converted into a preset data structure.

9. The resource management method in a multi-cloud environment according to claim 7, characterized in that: The sending a second resource request to the target cloud platform based on the first resource request includes: determining the second resource request based on the first resource request; The second resource request is sent to the target cloud platform based on the API calling standard of the target cloud platform.

10. The resource management method in a multi-cloud environment according to claim 7, characterized in that: The resource information of the target cloud platform includes one or more of the following: Instance information, storage information, network information, virtual machine information, ECS information, and RDS information.

Images