A logical node configuration method based on a cloud management platform and a cloud management platform

Abstract

The application discloses a logical node configuration method based on a cloud management platform and the cloud management platform, and can improve the utilization of resources for creating and managing logical nodes. The method of the application comprises the following steps: a tenant can send a logical node creation request of a logical node of the tenant to the cloud management platform, the request being used for indicating the computing resource requirement, the storage resource requirement and the network resource requirement of the logical node, so that the cloud management platform can select a first physical server satisfying the computing resource requirement and the storage resource requirement, select a first NPU satisfying the network resource requirement, and select a first SPU for managing the first physical server and the first NPU. Then, the cloud management platform can inform the first SPU to create the logical node on the first physical server and the first NPU. Then, the cloud management platform can inform the first SPU to install an operating system image prepared by the tenant in the logical node, so that the logical node installed with the operating system image can allow the tenant to remotely access.

Description

Technical Field

[0001] This application relates to the field of cloud technology, and in particular to a logical node configuration method based on a cloud management platform and a cloud management platform. Background Technology

[0002] With the rapid development of cloud technology, more and more tenants are choosing to use cloud resources provided by cloud providers to complete their business. These cloud resources may include computing resources, storage resources, and network resources provided by physical servers in the cloud. Therefore, tenants can create cloud instances that meet their requirements on these cloud resources to satisfy their business needs.

[0003] In related technologies, cloud resources provided by cloud providers to tenants are typically located on different physical servers. Generally, physical servers can contain various resources such as processors, memory, and network interface cards (NICs). To improve the utilization of these resources, cloud providers can insert additional offload cards into the physical servers to offload some tasks of the processor and NICs to the offload cards for execution. In other words, the offload card can replace the processor to perform resource management functions, and can also replace the NIC to perform data forwarding functions, etc.

[0004] In the above process, since cloud providers can configure corresponding offload cards for several physical servers used to create cloud instances, not every offload card on each physical server needs to perform its corresponding function during the operation of the cloud instance, which leads to low resource utilization of the offload cards. Summary of the Invention

[0005] This application provides a logical node configuration method based on a cloud management platform and a cloud management platform, which can improve the utilization of resources used to create and manage logical nodes.

[0006] The first aspect of this application provides a logical node configuration method based on a cloud management platform. The cloud management platform implementing this method can manage infrastructure providing cloud services to tenants. This infrastructure includes a physical server pool, a network process unit (NPU) pool, and a service process unit (SPU) pool. Multiple physical servers in the physical server pool, multiple NPUs in the NPU pool, and multiple SPUs in the SPU pool are interconnected within and between pools via a high-speed interconnect network. Each SPU can manage at least one physical server and at least one NPU among the multiple physical servers. The method includes:

[0007] When a tenant needs to create its logical node, the tenant can submit a logical node creation request to the creation interface provided by the cloud management platform. In this way, the cloud management platform can receive the logical node creation request sent by the tenant through the creation interface. The request includes the resource requirements set by the tenant for the logical node, including the computing resource requirements, storage resource requirements, and network resource requirements for the logical node.

[0008] After receiving a logical node creation request, the cloud management platform can determine the tenant's computing resource requirements, storage resource requirements, and network resource requirements for the logical node based on the request. Therefore, the cloud management platform can select the first physical server that meets the computing resource requirements and the storage resource requirements from among the multiple physical servers, select the first NPU that meets the network resource requirements from among the multiple NPUs, and select the first SPU for managing the first physical server and the first NPU from among the multiple SPUs.

[0009] After determining the first physical server, the first NPU, and the first SPU, the cloud management platform can request the first SPU to create logical nodes for the tenant on the first physical server and the first NPU to meet the tenant's logical node creation requirements.

[0010] After the logical node is created, the cloud management platform can obtain the operating system image specified by the tenant. The cloud management platform can then instruct the first SPU to install the tenant-specified operating system image on the logical node. The logical node with the installed operating system image can then be remotely logged into and accessed by the tenant, thereby meeting the tenant's business needs.

[0011] As can be seen from the above method, since each SPU in the SPU pool can be used to manage at least one physical server in the physical server pool and at least one NPU in the NPU pool, regardless of the number of first physical servers and first NPUs occupied by the tenant's logical node, a smaller number of first SPUs can be used to manage these first physical servers and first NPUs. This makes the logical node more lightweight overall, and during the operation of the logical node, there are fewer first SPUs in the idle state and more first SPUs in the working state, thereby improving the resource utilization of SPUs.

[0012] In one possible implementation, the method further includes: a cloud management platform notifying multiple SPUs to obtain resource information from multiple physical servers and multiple NPUs; the cloud management platform receiving the resource information from multiple physical servers and multiple NPUs sent by the multiple SPUs; and the cloud management platform determining a first physical server that meets the computing and storage resource requirements from the multiple physical servers based on a logical node creation request, and determining a first NPU that meets the network resource requirements from the multiple NPUs, including: the cloud management platform determining a first physical server that meets the computing and storage resource requirements from the multiple physical servers based on the logical node creation request, the resource information from the multiple physical servers, and the resource information from the multiple NPUs, and determining a first NPU that meets the network resource requirements from the multiple NPUs. In the aforementioned implementation, for any one of the multiple SPUs, the cloud management platform may notify that SPU to obtain resource information from at least one physical server it manages and resource information from at least one NPU it manages, and provide the resource information from at least one physical server it manages and resource information from at least one NPU it manages to the cloud management platform. For the remaining SPUs in the SPU pool other than the one mentioned, the cloud management platform can perform similar operations. Therefore, the cloud management platform can ultimately obtain the resource information of these multiple physical servers and the resource information of these multiple NPUs. Based on this, after receiving a logical node creation request, the cloud management platform can determine the computing resource requirements, storage resource requirements, and network resource requirements of the logical node based on the request. Therefore, the cloud management platform can refer to the resource information of these multiple physical servers to select the first physical server that meets the computing and storage resource requirements, and based on the resource information of these multiple NPUs, select the first NPU that meets the network resource requirements. Thus, the cloud management platform can accurately select the physical server (i.e., the first physical server) and NPU (i.e., the first NPU) that meet the resource requirements of the tenant's logical node from the physical server pool and NPU pool by obtaining the resource information of these multiple physical servers and NPUs in advance. This is beneficial for subsequently creating logical nodes that meet the tenant's needs by managing the SPUs (i.e., the first SPUs) of these physical servers and NPUs.

[0013] In one possible implementation, the resource information of multiple physical servers includes the total amount of computing resources, the available amount of computing resources, the total amount of storage resources, and the available amount of storage resources of the multiple physical servers; the resource information of multiple NPUs includes the total amount of network resources and the available amount of network resources of the multiple NPUs. In the aforementioned implementation, for any one physical server in the physical server pool, the resource information of that physical server may include the total amount of computing resources, the available amount of computing resources, the total amount of storage resources, and the available amount of storage resources, etc. For any one NPU in the NPU pool, the resource information packet of that NPU may include the total amount of network resources and the available amount of network resources of that NPU. Therefore, for any physical server and any NPU, the cloud management platform can determine whether the physical server and the NPU meet the resource requirements of the tenant's logical node based on the total amount and availability of the resources of the physical server and the NPU. This allows for the accurate selection of physical servers and NPUs that meet the resource requirements from multiple physical servers and multiple NPUs, thereby successfully creating logical nodes that meet the tenant's needs.

[0014] In one possible implementation, the first SPU includes a second SPU and a third SPU. The cloud management platform notifies the first SPU to create a logical node based on the first physical server and the first NPU. This includes: the cloud management platform acquiring the load of the second SPU and the load of the third SPU; if the load of the second SPU is less than the load of the third SPU, the cloud management platform notifies the second SPU to create a logical node based on the first physical server and the first NPU; if the load of the second SPU is greater than the load of the third SPU, the cloud management platform notifies the third SPU to create a logical node based on the first physical server and the first NPU; if the load of the second SPU is equal to the load of the third SPU, the cloud management platform notifies either the second SPU or the third SPU to create a logical node based on the first physical server and the first NPU. In the aforementioned implementation, not only is the second SPU used to manage the first physical server and the first NPU, but the second SPU is also used to manage the first physical server and the first NPU. Based on this, the cloud management platform can collect the load of the second SPU and the load of the third SPU, and compare the loads of the second SPU and the third SPU. If the load of the second SPU is less than that of the third SPU, the cloud management platform notifies the second SPU to create a logical node for the tenant on the first physical server and the first NPU. If the load of the second SPU is greater than that of the third SPU, the cloud management platform notifies the third SPU to create a logical node for the tenant on the first physical server and the first NPU. If the load of the second SPU is equal to that of the third SPU, the cloud management platform can notify either the second or third SPU to create a logical node for the tenant on the first physical server and the first NPU. In the aforementioned implementation, since the same batch of physical servers (the first physical server) and NPUs (the first NPU) can be managed by different SPUs (the second and third SPUs), these SPUs can act as primary and backups for each other. Even if one of these SPUs fails or is overloaded, the remaining SPUs can still successfully complete the creation and management of logical nodes.

[0015] In one possible implementation, the load of the second SPU includes at least one of the following: the resource utilization of the second SPU and the number of tasks that the second SPU needs to process.

[0016] In one possible implementation, the method further includes: the cloud management platform determining that the first physical server is faulty, and notifying the first SPU to determine a second physical server from at least two physical servers managed by the first SPU that meets the computing and storage resource requirements, wherein the first physical server and the second physical server are different physical servers; the cloud management platform notifies the first SPU to migrate the logical node from the first physical server and the first NPU to the second physical server and the first NPU. In the aforementioned implementation, if the first physical server is faulty, the cloud management platform can notify the first SPU to determine a second physical server from the remaining physical servers managed by the first SPU that meets the computing and storage resource requirements of the logical node. In this way, the first SPU can migrate the tenant's logical node from the first physical server and the first NPU to the second physical server and the first NPU. Therefore, once the first physical server occupied by the tenant's logical node fails, the cloud management platform can promptly notify the first SPU to select a second physical server that can replace the first physical server and migrate the logical node to the second physical server, thus ensuring the normal operation of the logical node.

[0017] In one possible implementation, the method further includes: the cloud management platform determining that the first NPU is faulty, and notifying the first SPU to determine a second NPU that meets the network resource requirements from at least two NPUs managed by the first SPU, wherein the first NPU and the second NPU are different NPUs; the cloud management platform notifies the first SPU to migrate the logical node from the first physical server and the first NPU to the first physical server and the second NPU. In the aforementioned implementation, if the first NPU is faulty, the cloud management platform can notify the first SPU to determine a second NPU that meets the network resource requirements of the logical node from the remaining NPUs managed by the first SPU (excluding the first NPU). In this way, the first SPU can migrate the tenant's logical node from the first physical server and the first NPU to the first physical server and the second NPU. Therefore, once the first NPU occupied by the tenant's logical node fails, the cloud management platform can promptly notify the first SPU to select a second NPU that can replace the first NPU and migrate the logical node to the second NPU, thus ensuring the normal operation of the logical node.

[0018] A second aspect of this application provides a cloud management platform for managing infrastructure providing cloud services. The infrastructure includes a physical server pool, an NPU pool, and an SPU pool. Multiple physical servers in the physical server pool, multiple NPUs in the NPU pool, and multiple SPUs in the SPU pool are interconnected via a high-speed interconnect network. Each SPU manages at least one physical server and at least one NPU. The cloud management platform includes a receiving module for receiving a logical node creation request input by a tenant. The logical node creation request indicates the resource requirements of the logical node, including computing resource requirements and storage resource requirements. The system includes: a first determination module, used to determine, based on the logical node creation request, a first physical server that meets the computing and storage resource requirements from multiple physical servers, a first NPU that meets the network resource requirements from multiple NPUs, and a first SPU for managing the first physical server and the first NPU from multiple SPUs; a first notification module, used to notify the first SPU to create a logical node based on the first physical server and the first NPU; a second determination module, used to determine the operating system image entered or selected by the tenant; and a second notification module, used to notify the first SPU to install the operating system image in the logical node, wherein the logical node with the operating system image installed allows the tenant to log in remotely.

[0019] In one possible implementation, the cloud management platform further includes: a third notification module for notifying multiple SPUs to obtain resource information from multiple physical servers and multiple NPUs; an acquisition module for receiving resource information from multiple physical servers and multiple NPUs sent by multiple SPUs; and a first notification module for determining, based on the logical node creation request, the resource information from multiple physical servers, and the resource information from multiple NPUs, a first physical server that meets the computing resource requirements and storage resource requirements from the multiple physical servers, and a first NPU that meets the network resource requirements from the multiple NPUs.

[0020] In one possible implementation, the resource information of the multiple physical servers includes the total amount of computing resources of the multiple physical servers, the available amount of computing resources of the multiple physical servers, the total amount of storage resources of the multiple physical servers, and the available amount of storage resources of the multiple physical servers; the resource information of the multiple NPUs includes the total amount of network resources of the multiple NPUs and the available amount of network resources of the multiple NPUs.

[0021] In one possible implementation, the first SPU includes a second SPU and a third SPU. A first notification module is configured to: obtain the load of the second SPU and the load of the third SPU; if the load of the second SPU is less than the load of the third SPU, notify the second SPU to create a logical node based on the first physical server and the first NPU; if the load of the second SPU is greater than the load of the third SPU, notify the third SPU to create a logical node based on the first physical server and the first NPU; if the load of the second SPU is equal to the load of the third SPU, notify either the second SPU or the third SPU to create a logical node based on the first physical server and the first NPU.

[0022] In one possible implementation, the load of the second SPU includes at least one of the following: the resource utilization of the second SPU and the number of tasks that the second SPU needs to process.

[0023] In one possible implementation, the cloud management platform further includes: a fourth notification module, used to determine that the first physical server is faulty, and to notify the first SPU to determine a second physical server that meets the computing resource requirements and storage resource requirements from at least two physical servers managed by the first SPU, wherein the first physical server and the second physical server are different physical servers; and a fifth notification module, used to notify the first SPU to migrate logical nodes from the first physical server and the first NPU to the second physical server and the first NPU.

[0024] In one possible implementation, the cloud management platform further includes: a sixth notification module, used to determine that the first NPU is faulty and to notify the first SPU to determine a second NPU that meets the network resource requirements from at least two NPUs managed by the first SPU, wherein the first NPU and the second NPU are different NPUs; and a seventh notification module, used to notify the first SPU to migrate the logical node from the first physical server and the first NPU to the first physical server and the second NPU.

[0025] A third aspect of this application provides a computing device cluster, which includes at least one computing device, each computing device including a processor and a memory: the memory is used to store instructions; the processor is used to cause the computing device cluster to perform the method described in the first aspect or any possible implementation of the first aspect according to the instructions.

[0026] A fourth aspect of this application provides a computer storage medium storing one or more instructions that, when executed by one or more computers, cause the one or more computers to perform the method described in the first aspect or any possible implementation of the first aspect.

[0027] A fifth aspect of this application provides a computer program product storing instructions that, when executed by a computer, cause the computer to perform the method described in the first aspect or any possible implementation of the first aspect.

[0028] In this embodiment, when a tenant needs to create its logical node, the tenant can send a logical node creation request to the creation interface provided by the cloud management platform. Since the logical node creation request indicates the resource requirements set by the tenant for the logical node, including computing resource requirements, storage resource requirements, and network resource requirements, the cloud management platform can select a first physical server from the physical server pool that meets the computing and storage resource requirements, a first NPU from the NPU pool that meets the network resource requirements, and a first SPU from the SPU pool to manage the first physical server and the first NPU. In this way, the cloud management platform can notify the first SPU to create the tenant's required logical node on the first physical server and the first NPU. Then, the cloud management platform can notify the first SPU to install the operating system image specified by the tenant on the logical node, so that the logical node with the operating system image installed can be remotely accessed by the tenant. Therefore, the logical node with the operating system image installed can complete the tenant's business based on the tenant's remote access operation. In the aforementioned process, since each SPU in the SPU pool can be used to manage at least one physical server in the physical server pool and at least one NPU in the NPU pool, regardless of the number of first physical servers and first NPUs occupied by the tenant's logical node, a smaller number of first SPUs can be used to manage these first physical servers and first NPUs. This makes the logical node more lightweight overall, and during the operation of the logical node, there are fewer first SPUs in the idle state and more first SPUs in the working state, thereby improving the resource utilization of SPUs. Attached Figure Description

[0029] Figure 1 A schematic diagram of the structure of the cloud service system provided in the embodiments of this application;

[0030] Figure 2a A schematic diagram of the infrastructure provided in the embodiments of this application;

[0031] Figure 2b Another structural diagram of the infrastructure provided in the embodiments of this application;

[0032] Figure 3 A flowchart illustrating a logical node configuration method based on a cloud management platform provided in an embodiment of this application;

[0033] Figure 4 Another schematic diagram of the cloud service system is provided for the embodiments of this application;

[0034] Figure 5 This is another schematic diagram of the cloud service system provided in the embodiments of this application;

[0035] Figure 6 A schematic diagram of the structure of the cloud management platform provided in the embodiments of this application;

[0036] Figure 7 A schematic diagram of the structure of a computing device provided in an embodiment of this application;

[0037] Figure 8 A schematic diagram of the structure of a computing device cluster provided in an embodiment of this application;

[0038] Figure 9 This is a schematic diagram illustrating the network connection of computer devices in a computer cluster provided in an embodiment of this application. Detailed Implementation

[0039] This application provides a logical node configuration method based on a cloud management platform and a cloud management platform, which can improve the utilization of resources used to create and manage logical nodes.

[0040] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such terms are interchangeable where appropriate; this is merely a way of distinguishing objects with the same attributes in the embodiments of this application. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, so that a process, method, system, product, or apparatus that comprises a series of elements is not necessarily limited to those elements, but may include other elements not explicitly listed or inherent to those processes, methods, products, or apparatuses.

[0041] With the rapid development of cloud technology, more and more tenants are choosing to use cloud resources provided by cloud providers to complete their business. These cloud resources may include computing resources, storage resources, and network resources provided by physical servers in the cloud. Therefore, tenants can create cloud instances that meet their requirements on these cloud resources to satisfy their business needs.

[0042] In related technologies, cloud resources provided by cloud providers to tenants are typically located on different physical servers. Generally, physical servers can contain various resources such as processors, memory, and network interface cards (NICs). To improve the utilization of these resources, cloud providers can insert additional offload cards into the physical servers to offload some tasks of resources such as processors and NICs to the offload cards for execution. For example, the offload card can contain service process units (SPUs) and network process units (NPUs). The SPU can replace the processor to perform resource management functions, and the NPU can replace the NIC to perform data forwarding functions, and so on.

[0043] In the above process, since the creation of a tenant's cloud instance requires several physical servers, the cloud provider can configure SPUs and NPUs for each of these physical servers. During the operation of the cloud instance, not all SPUs on the physical servers occupied by the cloud instance need to perform their corresponding functions. This results in most of the SPUs on the physical servers being idle, leading to low SPU resource utilization.

[0044] Furthermore, for any physical server among the several physical servers occupied by a cloud instance, if that physical server or the NPU on that physical server fails, its functionality will be impaired, which in turn will prevent the cloud instance from operating normally.

[0045] To address the aforementioned issues, this application provides a logical node configuration method based on a cloud management platform. This method can be implemented through a cloud service system. Figure 1 A schematic diagram of the cloud service system provided in the embodiments of this application is shown below. Figure 1 As shown, a cloud service system includes the infrastructure that provides cloud services and a cloud management platform that manages this infrastructure. The cloud management platform and the infrastructure are described separately below:

[0046] A cloud management platform can centrally manage the infrastructure of the entire cloud service system (e.g., within the infrastructure, creating one or more logical nodes to serve the tenant according to the tenant's instructions; these logical nodes can be used to complete the tenant's business, etc.). The cloud management platform can also be open to tenants outside the cloud service system and respond to their requests. For example, the cloud management platform can provide various interfaces such as login and creation interfaces for tenant clients (e.g., the terminal device used by the tenant or the browser on the terminal device, etc.) to access. Specifically, the cloud management platform can authenticate the tenant's client through the login interface; after successful authentication, the tenant's client can be allowed to log in to the cloud management platform. For example, the cloud management platform can also create an interface that allows tenant clients to send logical node creation requests to the cloud management platform for the tenant's logical nodes. Since the logical node creation request is used to indicate the (custom) resource requirements set by the tenant for the logical node, and the resource specification requirements describe the specifications of various resources required to create the logical node, such as computing resource requirements, storage resource requirements, and network resource requirements, the cloud management platform can select idle physical devices (such as at least one physical server, at least one SPU, and at least one NPU, etc.) from various physical device pools that meet the specifications of the logical node, and create the logical node on these physical devices. Therefore, the cloud management platform can subsequently install the operating system image specified by the tenant on the logical node in a certain way, so that the logical node with the operating system image installed can be remotely accessed by the tenant. Thus, the logical node with the operating system image installed can complete the tenant's business based on the tenant's remote access operation.

[0047] The infrastructure comprises multiple physical device pools, including physical server pools, SPU pools, and NPU pools. Multiple physical servers in the physical server pool, multiple SPUs in the SPU pool, and multiple NPUs in the NPU pool can all be connected to a high-speed interconnect network. The high-speed interconnect network is used to enable interconnection between these multiple physical servers, multiple SPUs, and multiple NPUs within and between pools.

[0048] It should be noted that since the multiple physical servers in the physical server pool each contain a central processing unit (CPU), memory, and disk, and these multiple physical servers are interconnected, the CPU, memory, and disk of different physical servers can be shared (that is, the CPU, memory, and disk of one physical server can be provided to the CPU of another physical server, etc.). In other words, the multiple physical servers in the physical server pool constitute a CPU pool, a memory pool, and a disk pool. The CPU pool contains the CPUs of these multiple physical servers (these CPUs can be the same or different in specifications), the memory pool contains the memory of these multiple physical servers (these memory can be the same or different in specifications), and the disk pool contains the disks of these multiple physical servers (these disks can be the same or different in specifications).

[0049] It should also be noted that multiple NPUs in the NPU pool (these NPUs can be of the same or different specifications) can be used to implement data forwarding functions, etc. In other words, NPUs can be used to implement communication between physical servers or between physical servers and external cloud service systems. These multiple NPUs can be presented in various forms. For example, they can be smart network interface cards (NICs), which themselves include traditional network adapters and microprocessors. Alternatively, they can be service-driven infrastructure (SDI) cards, which include traditional network adapters and microprocessors. They can also be data processing units (DPUs), and so on; no specific limitations are made here.

[0050] It should also be noted that multiple SPUs in the SPU pool can be used to implement resource management functions, etc. In other words, any one of these SPUs can be used to manage at least one physical server and at least one NPU. These multiple SPUs can be presented in various forms, such as a graphics processing unit (GPU) device pool, a neural network processing unit (NPU) device pool, a tensor processing unit (TPU) device pool, and a DPU device pool, etc., without specific limitations here.

[0051] As can be seen, the cloud management platform can select several physical devices from these physical device pools that meet the tenant's needs and have certain specifications to build the tenant's logical nodes.

[0052] It is also worth noting that these multiple physical device pools are presented and communicate with each other in various ways:

[0053] (1) As Figure 2a As shown ( Figure 2a (A schematic diagram of the infrastructure provided in this application embodiment) In these multiple physical device pools, all physical devices in each physical device pool are randomly and dispersedly arranged on different racks, that is, different types of physical devices may exist in the same rack (for example, physical servers, NPUs, and SPUs may be stored in the same rack). Therefore, in these multiple physical device pools, any two physical devices in any physical device pool can communicate with each other through a high-speed interconnect device, and physical devices in any two physical device pools can also communicate with each other through a high-speed interconnect device. The high-speed interconnect device may include a high-speed interconnect bus and a high-speed interconnect bus switch, etc. Thus, the high-speed interconnect device connects all physical devices in multiple physical device pools, forming a high-speed interconnect network among all physical devices (the "high-speed" in high-speed interconnect network refers to a bandwidth of not less than 40G / S). In other words, multiple physical servers in the physical server pool, multiple SPUs in the SPU pool, and multiple NPUs in the NPU pool are all connected to the high-speed interconnect network, so these physical devices can communicate with each other through the high-speed interconnect network.

[0054] It is also worth noting that after the cloud management platform determines the resource requirements of a tenant's logical nodes—namely, the computing resource requirements (e.g., CPU requirements), storage resource requirements (e.g., memory and disk requirements), and network resource requirements (e.g., network interface card requirements)—the cloud management platform can select several physical devices from a pool of physical devices that meet these resource requirements. Specifically, it can select target physical servers from a pool of physical servers that meet both the computing and storage resource requirements (e.g., ...). Figure 2a The physical servers within the dashed box), and the target NPUs selected from the NPU pool that meet the network resource requirements (e.g., Figure 2a The NPU in the dashed box), and select the target SPU from the SPU pool to manage the target physical server and the target NPU (e.g., Figure 2a (The SPU is within the dashed box). In this way, the cloud management platform can instruct the target SPU to create the logical nodes required by the tenant on the target physical server and the target NPU. This is used to implement the network formed between the target physical server, the target NPU, and the target SPU, which is part of the high-speed interconnect network, or a sub-network of the high-speed interconnect network (e.g., Figure 2a (dashed box).

[0055] (2) Figure 2bAs shown ( Figure 2b (Another structural diagram of the infrastructure provided in this application embodiment) In these multiple physical device pools, all physical devices in each physical device pool are arranged in the same rack or adjacent racks according to a certain pattern. The same rack contains physical devices of the same type (for example, one rack contains physical servers, another rack contains NPUs, and yet another rack contains SPUs). Therefore, in these multiple physical device pools, any two physical devices in any physical device pool can communicate with each other through a high-speed interconnect device, and physical devices in any two physical device pools can also communicate with each other through a high-speed interconnect device. This high-speed interconnect device may include a high-speed interconnect bus and a high-speed interconnect bus switch, etc. Thus, the high-speed interconnect device connects all physical devices in multiple physical device pools, forming a high-speed interconnect network (the "high-speed" in high-speed interconnect network refers to a bandwidth of not less than 40G / S). That is, multiple physical servers in the physical server pool, multiple SPUs in the SPU pool, and multiple NPUs in the NPU pool are all connected to the high-speed interconnect network, so these physical devices can communicate with each other through the high-speed interconnect network.

[0056] It is also worth noting that after the cloud management platform determines the resource requirements of a tenant's logical nodes—namely, the computing, storage, and network resource requirements of the logical nodes—the cloud management platform can select several physical devices from a pool of physical devices to meet those resource requirements. Specifically, it can select target physical servers from a pool of physical servers that meet those computing and storage resource requirements (e.g., ...). Figure 2b The physical servers within the dashed box), and the target NPUs selected from the NPU pool that meet the network resource requirements (e.g., Figure 2b The NPU in the dashed box), and select the target SPU from the SPU pool to manage the target physical server and the target NPU (e.g., Figure 2b (The SPU is within the dashed box). In this way, the cloud management platform can instruct the target SPU to create the logical nodes required by the tenant on the target physical server and the target NPU. This is used to implement the network formed between the target physical server, the target NPU, and the target SPU, which is part of the high-speed interconnect network, or a sub-network of the high-speed interconnect network (e.g., Figure 2b (dashed box).

[0057] Furthermore, such as Figure 2a As shown, in these multiple physical device pools, each physical device has a certain type of interface. For any given physical device, it can connect to a high-speed interconnect bus switch through its interface, and then communicate with other physical devices through the high-speed interconnect bus.

[0058] Furthermore, for the tenant's logical node, the logical node can typically be regarded as a cloud instance in the infrastructure. These cloud instances can be presented in various ways. For example, these cloud instances can be (one or more) physical servers selected by the cloud management platform in the infrastructure; they can also be bare metal servers selected by the cloud management platform in the infrastructure; they can also be virtual machines (VMs) created by the cloud management platform on physical servers using virtualization technology; they can also be containers (Docker) created by the cloud management platform on physical servers using virtualization technology; they can also be micro VMs created by the cloud management platform on physical servers using virtualization technology, and so on.

[0059] Furthermore, for the aforementioned multiple physical device pools, these multiple physical device pools can be deployed in the same site or different sites. The site can be presented in various forms, such as a region in the infrastructure, an availability zone in the infrastructure, a data center (DC) in the infrastructure, a room in the infrastructure, and so on.

[0060] Furthermore, the high-speed interconnection network built between these multiple physical device pools can be implemented based on multiple high-speed interconnect bus switches. Suppose these multiple physical device pools are deployed across a data center, which often contains multiple racks. These racks are used to house several physical devices from each physical device pool. In order to enable communication between physical devices in different racks, each rack often needs to deploy at least one high-speed interconnect bus switch. In this way, the racks can communicate with each other through the high-speed interconnect bus switches, thereby forming a high-speed interconnection network within the data center.

[0061] Furthermore, the aforementioned high-speed interconnect network can take many forms. For example, it can be a Peripheral Component Interconnect Express (PCIE) network, an InfiniBand (IB) network, a Compute Express Link (CXL) network, or even an interconnect network between devices developed by a cloud vendor (the bandwidth of which also needs to be no less than 40 Gbps), etc. Correspondingly, the high-speed interconnect devices connected to each physical device can be communication devices based on the PCIE, CXL, IB, or cloud vendor-developed communication protocols. Similarly, the interfaces used by the physical devices in each physical device pool to access the high-speed interconnect network can be PCIE interfaces, CXL interfaces, IB interfaces, or cloud vendor-developed interfaces, etc.

[0062] Based on the aforementioned cloud service system, when a tenant needs to create its logical node, the tenant can send a logical node creation request to the creation interface provided by the cloud management platform. Since the logical node creation request indicates the resource requirements set by the tenant for that logical node, including computing, storage, and network resource requirements, the cloud management platform can select a target physical server from the physical server pool that meets the computing and storage resource requirements, a target NPU from the NPU pool that meets the network resource requirements, and a target SPU from the SPU pool to manage the target physical server and target NPU. In this way, the cloud management platform can instruct the target SPU to create the tenant's required logical node on the target physical server and target NPU. Then, the cloud management platform can instruct the target SPU to install the tenant's specified operating system image on the logical node, enabling the logical node with the installed operating system image to be remotely accessed by the tenant. Therefore, the logical node with the installed operating system image can complete the tenant's business based on the tenant's remote access operations. In the aforementioned process, since each SPU in the SPU pool can be used to manage at least one physical server in the physical server pool and at least one NPU in the NPU pool, regardless of the number of target physical servers and target NPUs occupied by a tenant's logical node, a smaller number of target SPUs can be used to manage these target physical servers and target NPUs. This makes the overall logical node more lightweight, and during the operation of the logical node, there are fewer target SPUs in an idle state and more target SPUs in an active state, thereby improving the resource utilization of SPUs. To further understand the workflow of the cloud management platform, the following section... Figure 3 This workflow will be described in further detail. Figure 3 A flowchart illustrating a logical node configuration method based on a cloud management platform provided in this application embodiment is shown below. Figure 3 As shown, this method can be achieved through Figure 1 The cloud service system implementation shown includes infrastructure providing cloud services to tenants and a cloud management platform for managing this infrastructure. This infrastructure may include a physical server pool, an NPU pool, and an SPU pool. Multiple physical servers in the physical server pool, multiple NPUs in the NPU pool, and multiple SPUs in the SPU pool are interconnected via a high-speed interconnect network. Each SPU manages at least one physical server and at least one NPU among the multiple physical servers and NPUs, respectively. The method includes:

[0063] 301. The cloud management platform receives a logical node creation request from a tenant. The logical node creation request indicates the resource requirements of the logical node, including computing resource requirements, storage resource requirements, and network resource requirements.

[0064] In this embodiment, when a tenant needs to create its logical node, the cloud management platform can provide a creation interface to the tenant's client (e.g., a logical node creation section on the tenant's interface). The tenant can then input a logical node creation request for that logical node into the creation interface through their client. In this way, the cloud management platform can receive the logical node creation request sent by the tenant through their client via the creation interface. It is worth noting that the logical node creation request includes the resource requirements set by the tenant for that logical node. These resource requirements include the logical node's computing resource requirements, storage resource requirements, and network resource requirements. Specifically, the computing resource requirements describe the specifications of computing resources such as CPU required to create the logical node; the storage resource requirements describe the specifications of storage resources such as memory and disk required to create the logical node; and the network resource requirements describe the specifications of network resources such as network interface cards required to create the logical node.

[0065] For example, when a tenant needs to create its VM, the tenant can log in to the cloud management platform. The cloud management platform can provide the tenant with a tenant interface, which includes a logical node creation field. The tenant can then enter a VM creation request for its VM into the logical node creation field. This request is used to indicate the resource requirements of the VM, including the VM's CPU requirements (e.g., the VM needs a 32-core CPU), memory requirements (e.g., the VM needs 16GB of memory), disk requirements (e.g., the VM needs a 100GB disk), and network card requirements (e.g., the VM needs an 8GB network card), etc.

[0066] 302. Based on the logical node creation request, the cloud management platform determines the first physical server that meets the computing and storage resource requirements from multiple physical servers, determines the first NPU that meets the network resource requirements from multiple NPUs, and determines the first SPU for managing the first physical server and the first NPU from multiple SPUs.

[0067] Upon receiving a logical node creation request, the cloud management platform can parse the request to determine the resource requirements of the tenant's logical node. Since the resource requirements of the logical node include its computing resource requirements, storage resource requirements, and network resource requirements, the cloud management platform can select a first physical server from multiple physical servers in the physical server pool that meets the computing and storage resource requirements and is available, select a first NPU from multiple NPUs in the NPU pool that meets the network resource requirements and is available, and select a first SPU from multiple SPUs in the SPU pool to manage the first physical server and the first NPU.

[0068] Specifically, before executing step 301, the cloud management platform may also perform the following operations:

[0069] For any one SPU in the SPU pool, since that SPU can manage at least one physical server in the physical server pool and at least one NPU in the NPU pool, that means multiple physical servers in the physical server pool and multiple NPUs in the NPU pool are assigned to be managed by multiple SPUs in the SPU pool. It should be noted that for any two different SPUs, these two SPUs can either manage the same physical server and the same NPU, or they can manage different physical servers and different NPUs.

[0070] Based on this, for any one SPU in the SPU pool, the cloud management platform can notify that SPU to obtain resource information of at least one physical server and at least one NPU it manages, and then provide that resource information to the cloud management platform. For the other SPUs in the SPU pool, the cloud management platform can also perform the same operations on them as on the SPU. Therefore, the cloud management platform ultimately obtains resource information for multiple physical servers in the physical server pool and multiple NPUs in the NPU pool.

[0071] More specifically, for any one physical server in a physical server pool, the resource information of that physical server may include the total amount of computing resources of that physical server (e.g., the total number of CPUs of that physical server), the available amount of computing resources of that physical server (e.g., the available amount of CPUs of that physical server), the total amount of storage resources of that physical server (e.g., the total amount of memory and disk space of that physical server), and the available amount of storage resources of that physical server (e.g., the available amount of memory and disk space of that physical server), etc. For any one NPU in an NPU pool, the resource information packet of that NPU may include the total amount of network resources of that NPU (e.g., the total amount of network channels and bandwidth of that NPU), and the available amount of network resources of that NPU (e.g., the available amount of network channels and bandwidth of that NPU), etc.

[0072] As in the example above, such as Figure 4 As shown ( Figure 4 (This is another schematic diagram of the cloud service system provided in this application embodiment). Assume that the physical server pool contains physical servers 1 to 8, the NPU pool contains NPU1 to NPU8, and the SPU pool contains SPU1 to SPU4. SPU1 is used to manage physical servers 1, 2, 3, 4, NPU1, NPU2, NPU3, and NPU4. SPU2 is used to manage physical servers 1, 2, 3, 4, NPU1, NPU2, NPU3, and NPU4. SPU3 is used to manage physical servers 5, 6, 7, 8, NPU5, NPU6, NPU7, and NPU8. SPU4 is used to manage physical servers 5, 6, 7, 8, NPU5, NPU6, NPU7, and NPU8.

[0073] Host agents are created on SPU1 through SPU4, and hypervisors are created on physical servers 1 through 8.

[0074] Based on this, the SPU1 host agent has a built-in scope of physical servers and NPUs that it needs to manage. Based on this scope, the SPU1 host agent can send resource information retrieval requests to the hypervisors of physical server 1, physical server 2, physical server 3, physical server 4, NPU1, NPU2, NPU3, and NPU4. This allows the hypervisor of physical server 1 to return resource information about physical server 1 to the SPU1 host agent (e.g., the total and available CPU resources, total and available memory resources, total and available disk resources, etc.), the hypervisor of physical server 2 to return resource information about physical server 2, the hypervisor of physical server 3 to return resource information about physical server 3, the hypervisor of physical server 4 to return resource information about physical server 4, and so on. The agent returns resource information for NPU1 (e.g., the total number and availability of network channels for NPU1, the total number and availability of bandwidth for NPU1, etc.), NPU2 returns resource information for NPU2 to the host agent of SPU1, NPU3 returns resource information for NPU3 to the host agent of SPU1, and NPU4 returns resource information for NPU4 to the host agent of SPU1.

[0075] Then, the host agent of SPU1 can provide the cloud management platform with the resource information of physical server 1, physical server 2, physical server 3, physical server 4, NPU1, NPU2, NPU3 and NPU4 that it receives. Similarly, the host agent of SPU2 can provide the cloud management platform with the resource information of physical server 1, physical server 2, physical server 3, physical server 4, NPU1, NPU2, NPU3, and NPU4 that it receives. The host agent of SPU3 can provide the cloud management platform with the resource information of physical server 5, physical server 6, physical server 7, physical server 8, NPU5, NPU6, NPU7, and NPU8 that it receives. The host agent of SPU4 can provide the cloud management platform with the resource information of physical server 5, physical server 6, physical server 7, physical server 8, NPU5, NPU6, NPU7, and NPU8 that it receives.

[0076] Subsequently, because the cloud management platform receives two identical resource information sets, it can deduplicate the received resource information to obtain a single set of resource information, namely the global resource view. This view includes the resource information of physical server 1, physical server 2, physical server 3, physical server 4, physical server 5, physical server 6, physical server 7, physical server 8, NPU1, NPU2, NPU3, NPU4, NPU5, NPU6, NPU7, and NPU8.

[0077] More specifically, the cloud management platform can determine the first physical server, the first NPU, and the first SPU in the following ways:

[0078] Because the cloud management platform obtains resource information from multiple physical servers in the physical server pool and multiple NPUs in the NPU pool in advance, upon receiving a logical node creation request, the cloud management platform can determine the resource requirements of the logical node to be created for the tenant, namely the computing resource requirements, storage resource requirements, and network resource requirements of the logical node. Therefore, the cloud management platform can refer to the resource information of these multiple physical servers and select the first physical server that meets the computing resource requirements and is idle, and select the first NPU that meets the network resource requirements and is idle, based on the resource information of these multiple NPUs. In this way, the cloud management platform can select the first SPU from multiple SPUs in the SPU pool to manage the first physical server and the first NPU.

[0079] As in the example above, such as Figure 5 As shown ( Figure 5 (This is another schematic diagram of the cloud service system provided in this application embodiment). After receiving a VM creation request sent by a tenant, the cloud management platform can determine the resource requirements of the VM to be created by the tenant based on the request. The resource requirements may include the VM's CPU requirements, memory requirements, disk requirements, and network card requirements, etc. Therefore, the cloud management platform can open a global resource view and use the resource information of physical servers 1 to 8 to select physical servers that meet the CPU requirements, memory requirements, and disk requirements and are idle, assuming they are physical servers 1 and 2 (i.e., the aforementioned first physical servers). And using the resource information of NPU1 and NPU2, it can select NPUs that meet the network card requirements and are idle, assuming they are NPU1 and NPU2 (i.e., the aforementioned first NPUs). Therefore, the cloud management platform can further determine the SPUs used to manage physical servers 1, physical servers 2, NPU1, and NPU2, i.e., SPU1 and SPU2 (i.e., the aforementioned first SPUs).

[0080] 303. The cloud management platform notifies the first SPU to create a logical node based on the first physical server and the first NPU.

[0081] After determining the first physical server, the first NPU, and the first SPU, the cloud management platform can issue a logical node creation request to the first SPU. Since this request includes the logical node's computing resource requirements, storage resource requirements, and network resource requirements, the first SPU can allocate computing resources (which may be all or part of the computing resources on the first physical server, without limitation) that match the computing resource requirements from the first physical server, allocate storage resources (which may be all or part of the storage resources on the first physical server, without limitation) that match the storage resource requirements, and allocate network resources (which may be all or part of the network resources on the first NPU, without limitation) that match the network resource requirements from the first NPU to complete resource preparation. Then, the first SPU can create the tenant's logical node on these allocated resources, thereby satisfying the tenant's logical node creation requirements.

[0082] Specifically, the cloud management platform can create logical nodes in the following ways:

[0083] Suppose that the first SPU, which manages the first physical server and the first NPU, includes a second SPU and a third SPU. That is, not only is the second SPU used to manage the first physical server and the first NPU, but the third SPU is also used to manage the first physical server and the first NPU. Based on this, the cloud management platform can notify the second SPU to provide its load (e.g., the resource utilization of the second SPU and the number of tasks the second SPU needs to process, etc.), and notify the third SPU to provide its load (e.g., the resource utilization of the third SPU and the number of tasks the third SPU needs to process, etc.). Next, the cloud management platform can compare the load of the second SPU with the load of the third SPU. If the load of the second SPU is less than that of the third SPU, the cloud management platform notifies the second SPU to partition the resources of the first physical server and the first NPU, and create logical nodes for the tenant on the partitioned resources. If the load of the second SPU is greater than that of the third SPU, the cloud management platform notifies the third SPU to partition the resources of the first physical server and the first NPU, and create logical nodes for the tenant on the partitioned resources. If the load of the second SPU is equal to the load of the third SPU, the cloud management platform randomly selects either the second or the third SPU to notify it to partition the resources of the first physical server and the first NPU, and create logical nodes for the tenant on the partitioned resources.

[0084] As in the example above, after determining SPU1 (i.e., the second SPU mentioned above) and SPU2 (i.e., the third SPU mentioned above), the cloud management platform can obtain the load of SPU1 and the load of SPU2. Since the load of SPU1 is lower than the load of SPU2, the cloud management platform can send a request to the host agent of SPU1 so that the host agent of SPU1 can notify the hypervisors of physical server 1 and physical server 2 to allocate CPUs, memory, and disks that meet the CPU requirements, memory requirements, and disk requirements of the VM in physical server 1 and physical server 2. In addition, resources that meet the network card requirements of the VM should be allocated in NPU1 and NPU2 to complete the resource preparation. Then, the host agent of SPU1 can call the hypervisor of physical server 1 and the hypervisor of physical server 2 to create the VM on these allocated resources using virtualization technology. The VM includes virtual CPU, virtual memory, virtual disk and virtual network card. The virtual CPU, virtual memory and virtual disk are implemented based on the CPU, memory and disk of physical server 1 and physical server, and the virtual network card is implemented based on NPU1 and NPU2.

[0085] It should be understood that, in this embodiment, after the first SPU creates the logical node on the first physical server and the first NPU, the availability of computing and storage resources of the first physical server changes, and the availability of network resources of the first NPU also changes. Therefore, the first SPU can update the resource information of the first physical server and the resource information of the first NPU. Thus, the first SPU can provide the updated resource information of the first physical server and the updated resource information of the first NPU to the cloud management platform, so that the cloud management platform can obtain the updated resource information of multiple physical servers and the updated resource information of multiple NPUs.

[0086] It should also be understood that, since the logical node is managed by the first SPU, the first SPU can obtain the status of the logical node in real time (e.g., whether the logical node is in a working state or an idle state, etc.) and provide the status of the logical node to the cloud management platform. In this way, the cloud management platform allows tenants to determine the status of their logical nodes.

[0087] 304. The cloud management platform determines the operating system image entered or selected by the tenant.

[0088] 305. The cloud management platform notifies the first SPU to install the operating system image on the logical node. The logical node with the operating system image installed allows tenants to log in remotely.

[0089] After the logical node is created, the cloud management platform can prompt the tenant to provide a self-defined operating system image or an operating system image selected by the tenant on the cloud management platform. The cloud management platform can then instruct the first SPU to install the tenant-specified operating system image on the logical node. The logical node with the installed operating system image can be remotely logged into and accessed by the tenant, thus meeting the tenant's business needs.

[0090] Continuing with the example above, after creating a tenant's VM, the cloud management platform can provide the tenant's specified operating system image to the SPU1 host agent. This allows the SPU1 host agent to install the operating system image onto the VM, giving it an operating system. Therefore, the VM with the operating system installed can run the tenant's applications. The tenant can then remotely log in to the VM with the operating system installed to access the application, thus meeting the tenant's business needs.

[0091] Specifically, the cloud management platform can also perform the following operations:

[0092] (1) The cloud management platform can monitor the first physical server and the first NPU occupied by the logical node in real time. If the first physical server fails, the cloud management platform can notify the first SPU to determine a second physical server from the other physical servers managed by the first SPU (that is, the first SPU manages at least two physical servers) that meets the computing resource requirements and storage resource requirements of the logical node. In this way, the first SPU can use the second physical server to replace the first physical server.

[0093] After the second physical server is determined, the first SPU can migrate the logical node from the first physical server and the first NPU to the second physical server and the first NPU. In this way, the second physical server and the first NPU occupied by the logical node are both fault-free resources, so the logical node can continue to provide business services to the tenant.

[0094] It should be understood that after the first SPU migrates the logical node to the second physical server and the first NPU, the availability of computing and storage resources on the second physical server changes. Therefore, the first SPU can update the resource information of the second physical server. Thus, the first SPU can provide the updated resource information of the second physical server to the cloud management platform, so that the cloud management platform can obtain the updated resource information of multiple physical servers and multiple updated resource information of multiple NPUs.

[0095] Continuing with the example above, the cloud management platform can include a hardware monitoring sub-platform deployed close to the physical servers and NPUs. Therefore, the hardware monitoring platform can monitor in real time the physical servers 1, 2, NPU1, and NPU2 occupied by the VM. If the hardware monitoring platform detects a fault in physical server 1, it can inform the hypervisor of physical server 1. The hypervisor of physical server 1 can then inform the host agent of SPU1 that physical server 1 is faulty. Therefore, the host agent of SPU1 can determine a suitable physical server 3 to replace physical server 1 based on the global resource view. Thus, the host agent of SPU1 can migrate the VM from physical servers 1, 2, NPU1, and NPU2 to physical servers 3, 2, NPU1, and NPU2.

[0096] (2) The cloud management platform can monitor the first physical server and the first NPU occupied by the logical node in real time. If the first NPU fails, the cloud management platform can notify the first SPU to determine the second NPU that meets the network resource requirements of the logical node from the other NPUs managed by the first SPU (that is, the first SPU manages at least two NPUs). In this way, the first SPU can use the second NPU to replace the first NPU.

[0097] After the second NPU is determined, the first SPU can migrate the logical node from the first physical server and the first NPU to the first physical server and the second NPU. In this way, the first physical server and the second NPU occupied by the logical node are both fault-free resources, so the logical node can continue to provide business services to the tenant.

[0098] It should be understood that after the first SPU migrates the logical node to the first physical server and the second NPU, the availability of network resources of the second NPU changes. Therefore, the first SPU can update the resource information of the second NPU. Thus, the first SPU can provide the updated resource information of the second NPU to the cloud management platform, so that the cloud management platform can obtain the updated resource information of multiple physical servers and multiple updated resource information of multiple NPUs.

[0099] Continuing with the example above, the hardware monitoring platform can monitor the physical servers 1, 2, NPU1, and NPU2 occupied by the VM in real time. If the hardware monitoring platform detects a fault in NPU1, it can inform the host agent of SPU1 that NPU1 is faulty. Therefore, the host agent of SPU1 can determine the NPU3 that can replace NPU1 based on the global resource view. Thus, the host agent of SPU1 can migrate the VM from physical servers 1, 2, NPU1, and NPU2 to physical servers 1, 2, NPU3, and NPU2.

[0100] In this embodiment, when a tenant needs to create its logical node, the tenant can send a logical node creation request to the creation interface provided by the cloud management platform. Since the logical node creation request indicates the resource requirements set by the tenant for the logical node, including computing resource requirements, storage resource requirements, and network resource requirements, the cloud management platform can select a first physical server from the physical server pool that meets the computing and storage resource requirements, a first NPU from the NPU pool that meets the network resource requirements, and a first SPU from the SPU pool to manage the first physical server and the first NPU. In this way, the cloud management platform can notify the first SPU to create the tenant's required logical node on the first physical server and the first NPU. Then, the cloud management platform can notify the first SPU to install the operating system image specified by the tenant on the logical node, so that the logical node with the operating system image installed can be remotely accessed by the tenant. Therefore, the logical node with the operating system image installed can complete the tenant's business based on the tenant's remote access operation. In the aforementioned process, since each SPU in the SPU pool can be used to manage at least one physical server in the physical server pool and at least one NPU in the NPU pool, regardless of the number of first physical servers and first NPUs occupied by the tenant's logical node, a smaller number of first SPUs can be used to manage these first physical servers and first NPUs. This makes the logical node more lightweight overall, and during the operation of the logical node, there are fewer first SPUs in the idle state and more first SPUs in the working state, thereby improving the resource utilization of SPUs.

[0101] Furthermore, in this embodiment, once the first physical server or the first NPU occupied by the tenant's logical node fails, the cloud management platform can promptly notify the first SPU to select a second physical server to replace the first physical server or a second NPU to replace the first NPU, and migrate the logical node to the second physical server or the second NPU, thus ensuring the normal operation of the logical node.

[0102] Furthermore, in this embodiment of the application, since the first physical server and the first NPU can be managed by different SPUs, namely the second SPU and the third SPU, the second SPU and the third SPU can serve as backups for each other. Even if one of the second SPUs or the third SPU fails or is overloaded, the remaining SPUs can still successfully complete the creation and management of logical nodes on the first physical server and the first NPU.

[0103] The above is a detailed description of the logical node configuration method based on the cloud management platform provided in the embodiments of this application. The cloud management platform provided in the embodiments of this application will be introduced below. Figure 6 A schematic diagram of the structure of the cloud management platform provided in the embodiments of this application is shown below. Figure 6 As shown, the cloud management platform is used to manage the infrastructure providing cloud services. The infrastructure includes a physical server pool, an NPU pool, and an SPU pool. Multiple physical servers in the physical server pool, multiple NPUs in the NPU pool, and multiple SPUs in the SPU pool are interconnected via a high-speed interconnect network. Each SPU manages at least one physical server and at least one NPU. The cloud management platform includes:

[0104] The receiving module 601 is used to receive a logical node creation request input by a tenant. The logical node creation request indicates the resource requirements of the logical node, including computing resource requirements, storage resource requirements, and network resource requirements. For example, the receiving module 601 is used to implement... Figure 3 Step 301 of the illustrated embodiment.

[0105] The first determining module 602 is used to determine, based on a logical node creation request, a first physical server that meets the computing and storage resource requirements from multiple physical servers, a first NPU that meets the network resource requirements from multiple NPUs, and a first SPU for managing the first physical server and the first NPU from multiple SPUs; for example, the first determining module 602 is used to implement Figure 3 Step 303 of the illustrated embodiment.

[0106] The first notification module 603 is used to notify the first SPU to create a logical node based on the first physical server and the first NPU; for example, the first notification module 603 is used to implement Figure 3 Step 303 of the illustrated embodiment.

[0107] The second determining module 604 is used to determine the operating system image input or selected by the tenant; for example, the second determining module 604 is used to implement Figure 3 Step 304 of the illustrated embodiment.

[0108] The second notification module 605 is used to notify the first SPU to install an operating system image on the logical node, wherein the logical node with the operating system image installed allows tenants to log in remotely. For example, the second notification module 605 is used to implement... Figure 3 Step 305 of the illustrated embodiment.

[0109] In one possible implementation, the cloud management platform further includes: a third notification module for notifying multiple SPUs to obtain resource information from multiple physical servers and multiple NPUs; an acquisition module for receiving resource information from multiple physical servers and multiple NPUs sent by multiple SPUs; and a first notification module for determining, based on the logical node creation request, the resource information from multiple physical servers, and the resource information from multiple NPUs, a first physical server that meets the computing resource requirements and storage resource requirements from the multiple physical servers, and a first NPU that meets the network resource requirements from the multiple NPUs.

[0110] In one possible implementation, the resource information of the multiple physical servers includes the total amount of computing resources of the multiple physical servers, the available amount of computing resources of the multiple physical servers, the total amount of storage resources of the multiple physical servers, and the available amount of storage resources of the multiple physical servers; the resource information of the multiple NPUs includes the total amount of network resources of the multiple NPUs and the available amount of network resources of the multiple NPUs.

[0111] In one possible implementation, the first SPU includes a second SPU and a third SPU. A first notification module is configured to: obtain the load of the second SPU and the load of the third SPU; if the load of the second SPU is less than the load of the third SPU, notify the second SPU to create a logical node based on the first physical server and the first NPU; if the load of the second SPU is greater than the load of the third SPU, notify the third SPU to create a logical node based on the first physical server and the first NPU; if the load of the second SPU is equal to the load of the third SPU, notify either the second SPU or the third SPU to create a logical node based on the first physical server and the first NPU.

[0112] In one possible implementation, the load of the second SPU includes at least one of the following: the resource utilization of the second SPU and the number of tasks that the second SPU needs to process.

[0113] In one possible implementation, the cloud management platform further includes: a fourth notification module, used to determine that the first physical server is faulty, and to notify the first SPU to determine a second physical server that meets the computing resource requirements and storage resource requirements from at least two physical servers managed by the first SPU, wherein the first physical server and the second physical server are different physical servers; and a fifth notification module, used to notify the first SPU to migrate logical nodes from the first physical server and the first NPU to the second physical server and the first NPU.

[0114] In one possible implementation, the cloud management platform further includes: a sixth notification module, used to determine that the first NPU is faulty and to notify the first SPU to determine a second NPU that meets the network resource requirements from at least two NPUs managed by the first SPU, wherein the first NPU and the second NPU are different NPUs; and a seventh notification module, used to notify the first SPU to migrate the logical node from the first physical server and the first NPU to the first physical server and the second NPU.

[0115] It should be noted that the information interaction and implementation process between the modules / units of the above-mentioned device are based on the same concept as the method embodiments of this application, and the resulting technical effects are the same as those of the method embodiments of this application. For details, please refer to the description in the method embodiments shown above in the embodiments of this application, and will not be repeated here.

[0116] Please see Figure 7 , Figure 7 This is a schematic diagram of the structure of a computing device provided in an embodiment of this application. Figure 7 As shown, the computing device 700 (which can be used to present the aforementioned cloud management platform) includes: a processor 701, a memory 702, a communication interface 703, and a bus 704. The processor 701, memory 702, and communication interface 703 are coupled via the bus (not shown in the figure). The memory 702 stores instructions. When the instructions in the memory 702 are executed, the computing device 700 performs the method executed by the cloud management platform in the above method embodiment.

[0117] The computing device 700 may be one or more integrated circuits configured to implement the methods described above, such as: one or more application-specific integrated circuits (ASICs), or one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs), or a combination of at least two of these forms of integrated circuits. Furthermore, when the units in the device can be implemented in the form of a processing element scheduler, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor capable of calling programs. Alternatively, these units may be integrated together to implement a system-on-a-chip (SOC).

[0118] The processor 701 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. A general-purpose processor can be a microprocessor or any conventional processor.

[0119] The memory 702 can be volatile memory or non-volatile memory, or it can include both. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0120] The memory 702 stores executable program code, and the processor 701 executes this executable program code to implement the functions of the aforementioned receiving module, first determining module, first notification module, second determining module, and second notification module, thereby realizing the above-mentioned logical node configuration method based on the cloud management platform. That is, the memory 702 stores instructions for executing the above-mentioned logical node configuration method based on the cloud management platform.

[0121] The communication interface 703 uses transceiver modules, such as, but not limited to, network interface cards and transceivers, to enable communication between the computing device 700 and other devices or communication networks.

[0122] In addition to the data bus, the 704 bus can also include a power bus, a control bus, and a status signal bus. The bus can be a Peripheral Component Interconnect Express (PCIe) bus, an Extended Industry Standard Architecture (EISA) bus, a Unified Bus (Ubus or UB), a Compute Express Link (CXL) bus, a Cache Coherent Interconnect for Accelerators (CCIX) bus, etc. The bus can be divided into address bus, data bus, and control bus.

[0123] Please see Figure 8 , Figure 8 This is a schematic diagram of a computing device cluster provided in an embodiment of this application. Figure 8 As shown, the computing device cluster 800 includes at least one computing device 700.

[0124] like Figure 8 As shown, the computing device cluster 800 includes at least one computing device 700. The memory 702 of one or more computing devices 700 in the computing device cluster 800 may store the same instructions for executing the above-described logical node configuration method based on the cloud management platform.

[0125] In some possible implementations, the memory 702 of one or more computing devices 700 in the computing device cluster 800 may also store partial instructions for executing the aforementioned logical node configuration method based on the cloud management platform. In other words, a combination of one or more computing devices 700 can jointly execute the aforementioned logical node configuration method based on the cloud management platform.

[0126] It should be noted that the memory 702 in different computing devices 700 within the computing device cluster 800 can store different instructions, each used to execute a portion of the functions of the aforementioned cloud management platform. That is, the instructions stored in the memory 702 of different computing devices 700 can implement the functions of one or more modules, such as the receiving module, the first determining module, the first notification module, the second determining module, and the second notification module.

[0127] In some possible implementations, one or more computing devices 700 in the computing device cluster 800 can be connected via a network. This network can be a wide area network (WAN) or a local area network (LAN), etc.

[0128] Please see Figure 9 , Figure 9 This is a schematic diagram illustrating the network connection of computer devices in a computer cluster 900 provided in an embodiment of this application. Figure 9 As shown, the two computing devices 700A and 700B are connected via a network. Specifically, they are connected to the network through the communication interfaces in each computing device.

[0129] In one possible implementation, the memory in computing device 700A stores instructions for performing the functions of modules such as the receiving module. Meanwhile, the memory in computing device 700B stores instructions for performing the functions of modules such as the first determining module, the first notifying module, the second determining module, and the second notifying module.

[0130] It should be understood that Figure 9 The functions of computing device 700A shown can also be performed by multiple computing devices. Similarly, the functions of computing device 700B can also be performed by multiple computing devices.

[0131] This application also relates to a computer storage medium storing a program for signal processing, which, when run on a computer, causes the computer to perform actions such as... Figure 3 The steps performed by the cloud management platform in the illustrated embodiment.

[0132] This application also relates to a computer program product that stores instructions that, when executed by a computer, cause the computer to perform actions such as... Figure 3 The steps performed by the cloud management platform in the illustrated embodiment.

[0133] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0134] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between apparatuses or units through some interfaces, and may be electrical, mechanical, or other forms.

[0135] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0136] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0137] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A logical node configuration method based on a cloud management platform, characterized in that, The cloud management platform is used to manage the infrastructure providing cloud services. The infrastructure includes a physical server pool, a network processing unit (NPU) pool, and a service processing unit (SPU) pool. Multiple physical servers in the physical server pool, multiple NPUs in the NPU pool, and multiple SPUs in the SPU pool are interconnected via a high-speed interconnect network. Each SPU manages at least one physical server among the multiple physical servers and at least one NPU among the multiple NPUs. The method includes: The cloud management platform receives a logical node creation request input by a tenant. The logical node creation request is used to indicate the resource requirements of the logical node, including computing resource requirements, storage resource requirements, and network resource requirements. Based on the logical node creation request, the cloud management platform determines a first physical server from the plurality of physical servers that meets the computing resource requirements and the storage resource requirements, determines a first NPU from the plurality of NPUs that meets the network resource requirements, and determines a first SPU from the plurality of SPUs for managing the first physical server and the first NPU. The cloud management platform notifies the first SPU to create the logical node based on the first physical server and the first NPU; The cloud management platform determines the operating system image entered or selected by the tenant; The cloud management platform notifies the first SPU to install the operating system image on the logical node, wherein the logical node with the operating system image installed allows the tenant to log in remotely.

2. The method according to claim 1, characterized in that, The method further includes: The cloud management platform notifies the multiple SPUs to obtain resource information from the multiple physical servers and the multiple NPUs; The cloud management platform receives resource information from the multiple physical servers and the multiple NPUs sent by the multiple SPUs; Based on the logical node creation request, the cloud management platform determines a first physical server from the plurality of physical servers that meets the computing resource requirements and the storage resource requirements. The first NPU from the plurality of NPUs that meets the network resource requirements includes: The cloud management platform determines, based on the logical node creation request, the resource information of the multiple physical servers, and the resource information of the multiple NPUs, a first physical server that meets the computing resource requirements and the storage resource requirements from the multiple physical servers, and a first NPU that meets the network resource requirements from the multiple NPUs.

3. The method according to claim 2, characterized in that, The resource information of the multiple physical servers includes the total amount of computing resources of the multiple physical servers, the available amount of computing resources of the multiple physical servers, the total amount of storage resources of the multiple physical servers, and the available amount of storage resources of the multiple physical servers. The resource information of the multiple NPUs includes the total amount of network resources of the multiple NPUs and the amount of network resources available for the multiple NPUs.

4. The method according to any one of claims 1 to 3, characterized in that, The first SPU includes a second SPU and a third SPU. The cloud management platform notifies the first SPU to create the logical node based on the first physical server and the first NPU, including: The cloud management platform obtains the load of the second SPU and the load of the third SPU; When the load of the second SPU is less than the load of the third SPU, the cloud management platform notifies the second SPU to create the logical node based on the first physical server and the first NPU; If the load of the second SPU is greater than the load of the third SPU, the cloud management platform notifies the third SPU to create the logical node based on the first physical server and the first NPU; When the load of the second SPU is equal to the load of the third SPU, the cloud management platform notifies the second SPU or the third SPU to create the logical node based on the first physical server and the first NPU.

5. The method according to claim 4, characterized in that, The load of the second SPU includes at least one of the following: the resource utilization of the second SPU and the number of tasks that the second SPU needs to process.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: The cloud management platform determines that the first physical server is faulty and notifies the first SPU to determine a second physical server that meets the computing resource requirements and the storage resource requirements from at least two physical servers managed by the first SPU, wherein the first physical server and the second physical server are different physical servers; The cloud management platform notifies the first SPU to migrate the logical node from the first physical server and the first NPU to the second physical server and the first NPU.

7. The method according to any one of claims 1 to 5, characterized in that, The method further includes: The cloud management platform determines that the first NPU is faulty and notifies the first SPU to determine a second NPU that meets the network resource requirements from at least two NPUs managed by the first SPU, wherein the first NPU and the second NPU are different NPUs; The cloud management platform notifies the first SPU to migrate the logical node from the first physical server and the first NPU to the first physical server and the second NPU.

8. A cloud management platform, characterized in that, The cloud management platform is used to manage the infrastructure providing cloud services. The infrastructure includes a physical server pool, an NPU pool, and an SPU pool. Multiple physical servers in the physical server pool, multiple NPUs in the NPU pool, and multiple SPUs in the SPU pool are interconnected via a high-speed interconnect network. Each SPU manages at least one physical server and at least one NPU among the multiple physical servers and NPUs, respectively. The cloud management platform includes: A receiving module is used to receive a logical node creation request input by a tenant, wherein the logical node creation request is used to indicate the resource requirements of the logical node, and the resource requirements include computing resource requirements, storage resource requirements and network resource requirements; The first determining module is configured to, based on the logical node creation request, determine a first physical server from the plurality of physical servers that meets the computing resource requirements and the storage resource requirements, determine a first NPU from the plurality of NPUs that meets the network resource requirements, and determine a first SPU from the plurality of SPUs for managing the first physical server and the first NPU. The first notification module is used to notify the first SPU to create the logical node based on the first physical server and the first NPU; The second determining module is used to determine the operating system image input or selected by the tenant; The second notification module is used to notify the first SPU to install the operating system image on the logical node, wherein the logical node with the operating system image installed allows the tenant to log in remotely.

9. The cloud management platform according to claim 8, characterized in that, The cloud management platform also includes: The third notification module is used to notify the multiple SPUs to obtain the resource information of the multiple physical servers and the resource information of the multiple NPUs; The acquisition module is used to receive resource information of the multiple physical servers and resource information of the multiple NPUs sent by the multiple SPUs; The first notification module is used to determine, based on the logical node creation request, the resource information of the plurality of physical servers and the resource information of the plurality of NPUs, a first physical server that meets the computing resource requirements and the storage resource requirements from the plurality of physical servers, and a first NPU that meets the network resource requirements from the plurality of NPUs.

10. The cloud management platform according to claim 9, characterized in that, The resource information of the multiple physical servers includes the total amount of computing resources of the multiple physical servers, the available amount of computing resources of the multiple physical servers, the total amount of storage resources of the multiple physical servers, and the available amount of storage resources of the multiple physical servers. The resource information of the multiple NPUs includes the total amount of network resources of the multiple NPUs and the amount of network resources available for the multiple NPUs.

11. The cloud management platform according to any one of claims 8 to 10, characterized in that, The first SPU includes a second SPU and a third SPU. The first notification module is used for: Obtain the load of the second SPU and the load of the third SPU; If the load of the second SPU is less than the load of the third SPU, the second SPU is notified to create the logical node based on the first physical server and the first NPU; If the load of the second SPU is greater than the load of the third SPU, the third SPU is notified to create the logical node based on the first physical server and the first NPU; If the load of the second SPU is equal to the load of the third SPU, notify the second SPU or the third SPU to create the logical node based on the first physical server and the first NPU.

12. The cloud management platform according to claim 11, characterized in that, The load of the second SPU includes at least one of the following: the resource utilization of the second SPU and the number of tasks that the second SPU needs to process.

13. The cloud management platform according to any one of claims 8 to 12, characterized in that, The cloud management platform also includes: The fourth notification module is used to determine that the first physical server has a fault and to notify the first SPU to determine a second physical server that meets the computing resource requirements and the storage resource requirements from at least two physical servers managed by the first SPU, wherein the first physical server and the second physical server are different physical servers. The fifth notification module is used to notify the first SPU to migrate the logical node from the first physical server and the first NPU to the second physical server and the first NPU.

14. The cloud management platform according to any one of claims 8 to 12, characterized in that, The cloud management platform also includes: The sixth notification module is used to determine that the first NPU has a fault and to notify the first SPU to determine a second NPU that meets the network resource requirements from at least two NPUs managed by the first SPU, wherein the first NPU and the second NPU are different NPUs; The seventh notification module is used to notify the first SPU to migrate the logical node from the first physical server and the first NPU to the first physical server and the second NPU.

15. A computing device cluster, characterized in that, The computing device cluster includes at least one computing device, each computing device including a processor and memory: The memory is used to store instructions; The processor is configured to, according to the instructions, cause the computing device cluster to perform the method of any one of claims 1 to 7.

16. A computer storage medium, characterized in that, The computer storage medium stores one or more instructions that, when executed by one or more computers, cause the one or more computers to perform the method of any one of claims 1 to 7.

17. A computer program product, characterized in that, The computer program product stores instructions that, when executed by a computer, cause the computer to perform the method described in any one of claims 1 to 7.

Images