Cloud product data processing method, system, device, and storage medium
By parsing cloud product requirements into candidate resource deployment schemes and leveraging the underlying resource supply capabilities of cloud service providers for resource orchestration and loss cost estimation, the problem of cloud service providers being unable to quickly meet user needs is solved, achieving elasticity in resource supply and improved cost-effectiveness.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HANGZHOU ALICLOUD FEITIAN INFORMATION TECH CO LTD
- Filing Date
- 2023-09-28
- Publication Date
- 2026-04-10
AI Technical Summary
Cloud service providers struggle to quickly meet users' sudden surge in cloud product demands, resulting in insufficient resource supply elasticity and cost-effectiveness.
By parsing cloud product requirements into candidate resource deployment schemes, leveraging the underlying resource supply capabilities of cloud service providers for resource orchestration and loss cost estimation, generating target resource deployment schemes, and executing resource processing tasks within the target availability zone, the required cloud products are automatically generated.
It enables flexible resource supply, quickly provides users with the cloud products they need, and improves the cost-effectiveness of resource supply.
Smart Images

Figure CN119722210B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of cloud computing, and particularly relates to a cloud product data processing method and system, a device and a storage medium. BACKGROUND
[0002] With the continuous development of cloud computing technology, the specifications and types of cloud products provided by cloud service providers are more and more, and the available zones and geographical areas covered by various cloud products are more and more extensive. Users can purchase or release the required types and specifications of cloud products as needed, such as a cloud server with 2-core virtual processors (vCPUs) and 4G memory, or a cloud database with 1-core vCPUs and 2G memory, without the need to maintain various hardware resources, which not only reduces management costs, but also enjoys the advantages of reliable, stable and scalable performance.
[0003] With the increasing demand for cloud products, cloud service providers have perfect supply and deployment plans for various cloud products to meet user needs. However, even so, it is difficult to avoid the phenomenon that sudden user needs cannot be met, that is, the cloud service provider cannot provide the required cloud product within a short time. Therefore, how to quickly provide users with the required cloud product on the basis of improving resource supply flexibility and resource supply cost performance has become a difficult problem to be solved. SUMMARY
[0004] Aspects of the present application provide a cloud product data processing method, system, device and storage medium to quickly provide users with the required cloud product on the basis of improving resource supply flexibility and resource supply cost performance.
[0005] The cloud product data processing system provided in an embodiment of the present application comprises: a demand management module configured to obtain cloud product demand information and parse the cloud product demand information into at least one candidate resource deployment scheme;
[0006] A resource arrangement module is configured to perform resource arrangement and resource consumption cost information estimation processing on the at least one candidate resource deployment scheme according to at least one resource supply capability provided by a cloud service provider, to obtain a target resource solution and its corresponding target resource deployment scheme whose resource consumption cost information meets the requirements;
[0007] An execution delivery module is configured to perform a resource processing task in an available zone corresponding to the target resource deployment scheme according to the target resource solution, to obtain a cloud product corresponding to the cloud product demand information.
[0008] The cloud product data processing method provided in an embodiment of the present application comprises:
[0009] obtain cloud product demand information, parse the cloud product demand information into at least one candidate resource deployment scheme;
[0010] perform resource arrangement and resource consumption cost information estimation processing on the at least one candidate resource deployment scheme according to at least one resource supply capability provided by a cloud service provider, to obtain a target resource solution and a corresponding target resource deployment scheme whose resource consumption cost information meets requirements;
[0011] perform a resource processing task in an available zone corresponding to the target resource deployment scheme according to the target resource solution, to obtain a cloud product corresponding to the cloud product demand information.
[0012] The application also provides a cloud product data processing method, comprising:
[0013] obtain a candidate resource deployment scheme and at least one resource supply capability, the candidate resource deployment scheme including at least resource information to be deployed and available zone information to be deployed;
[0014] estimate unit resource consumption cost information of the at least one resource supply capability when providing required resources for any candidate resource deployment scheme according to the at least one resource supply capability;
[0015] generate a resource solution and resource consumption cost information corresponding to the resource deployment scheme according to unit resource consumption cost information corresponding to at least one resource supply capability and the resource information to be deployed.
[0016] The application also provides an electronic device, comprising a memory and a processor; the memory is used to store a computer program, and the processor is coupled with the memory and used to execute the computer program to execute steps in any method provided by the application.
[0017] The application also provides a computer readable storage medium storing a computer program, when the computer program is executed by a processor, the processor can implement steps in any method provided by the application.
[0018] In the embodiment of the present application, the cloud product demand is effectively combined with the resource supply capability of the cloud service provider bottom layer, the cloud product demand is parsed into at least one candidate resource deployment scheme, resource arrangement and resource consumption cost information estimation processing are performed on the at least one candidate resource deployment scheme according to at least one resource supply capability provided by the cloud service provider, a target resource deployment scheme whose resource consumption cost information meets the requirements and a corresponding target resource solution scheme are obtained, and a resource processing task is performed in the available area corresponding to the target resource deployment scheme according to the target resource solution scheme, so that the cloud product corresponding to the cloud product demand can be automatically output. With the help of the resource supply capability of the cloud service provider bottom layer, the required cloud product can be quickly provided for the user, the elasticity of resource supply is realized, and in addition, the resource consumption cost of the resource solution scheme is considered, which is beneficial to improve the cost performance of resource supply. BRIEF DESCRIPTION OF DRAWINGS
[0019] The accompanying drawings, which are included to provide a further understanding of the present application, constitute a part of the present application and illustrate the illustrative embodiments of the present application and their description serve to explain the present application, and do not constitute improper limitations on the present application. In the drawings:
[0020] Figure 1a A structural schematic diagram of a cloud product data processing system provided by the embodiment of the present application;
[0021] Figure 1b An internal implementation structure of a demand management module provided by the embodiment of the present application;
[0022] Figure 1c An internal implementation structure of a resource arrangement module provided by the embodiment of the present application;
[0023] Figure 1d A display schematic diagram of receiving cloud product demand information provided by the embodiment of the present application;
[0024] Figure 1e A schematic diagram of cloud product demand information type and conversion provided by the embodiment of the present application;
[0025] Figure 2a A combination schematic diagram of specifications, available areas and providers provided by the embodiment of the present application;
[0026] Figure 2b A schematic diagram of demand time corresponding to resource provision by the provider provided by the embodiment of the present application;
[0027] Figure 2c A flowchart schematic diagram of target resource solution scheme delivery execution provided by the embodiment of the present application;
[0028] Figure 2dA dynamic priority state diagram provided by the embodiment of the present application;
[0029] Figure 2e A cloud product data processing system overall job block diagram provided by the embodiment of the present application;
[0030] Figure 3a A flow diagram of a cloud product data processing method provided by the embodiment of the present application;
[0031] Figure 3b A flow diagram of another cloud product data processing method provided by the embodiment of the present application;
[0032] Figure 4 A structure diagram of an electronic device provided by the embodiment of the present application. DETAILED DESCRIPTION
[0033] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be described clearly and completely in combination with the specific embodiments of the present application and corresponding drawings. Obviously, the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.
[0034] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant national and regional laws, regulations and standards, and provide corresponding operation portal for user to choose authorization or refusal.
[0035] With the development of cloud computing technology and the increasing demand for cloud products, how to quickly provide users with the required cloud products on the basis of improving the elasticity of resource supply and the cost performance of resource supply has become a difficult problem to be solved. In the embodiments of the present application, a scheme capable of quickly and automatically producing cloud products is provided, which effectively combines cloud product demand with the underlying resource supply capability of a cloud service provider. The cloud product demand is parsed into at least one candidate resource deployment scheme, resource arrangement and resource consumption cost information estimation processing are performed on the at least one candidate resource deployment scheme according to at least one resource supply capability provided by the cloud service provider, a target resource deployment scheme whose resource consumption cost information meets the requirements and a target resource solution scheme corresponding to the target resource deployment scheme and formed by at least one resource supply capability are obtained, and resource processing tasks are performed in the available area corresponding to the target resource deployment scheme according to at least one resource supply capability in the target resource solution scheme, so as to automatically produce a cloud product corresponding to the cloud product demand. Wherein, by means of the underlying resource supply capability of the cloud service provider, the required cloud product can be quickly and on-demand provided to the user, the elasticity of resource supply is realized, and in addition, since the resource consumption cost of the resource solution scheme is considered, the cost performance of resource supply is improved.
[0036] In addition, the scheme provided by the embodiments of the present application is also helpful for the cloud service provider to effectively manage the underlying resource supply capability and the lower layer available resources, solve the problem of optimal use of resources, and make the underlying resources create greater efficiency and value.
[0037] Further, the scheme provided by the embodiments of the present application can also be combined with the conventional cloud product supply scheme of the cloud service provider, discover and utilize the underlying resource supply capability and cloud resources on the basis of the conventional cloud product supply scheme, automatically produce cloud products meeting the user's demand in an efficient and rapid manner in the case that the conventional cloud product supply scheme cannot meet the user's cloud product demand, improve the user experience, and increase the user's stickiness to the cloud service provider.
[0038] The technical scheme provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0039] Figure 1a A structure schematic diagram of a cloud product data processing system provided by the embodiments of the present application is shown in FIG. 1. As shown in the figure, the system 100 includes a demand management module 10, a resource arrangement module 20 and an execution delivery module 30. Figure 1a
[0040] In the embodiments of the present application, the deployment and implementation form of the demand management module 10, the resource orchestration module 20 and the execution delivery module 30 are not limited. The three modules of the demand management module 10, the resource orchestration module 20 and the execution delivery module 30 can be integrated and deployed on the same physical machine, or can be distributed and deployed on multiple physical machines. The physical machine can be a conventional server, a server cluster, a cloud server or the like, or can be a notebook computer, a smart phone or the like. In addition, the demand management module 10, the resource orchestration module 20 and the execution delivery module 30 can also be deployed in a virtual instance, such as a virtual machine (VM), a container or the like, and can be centrally deployed in the same virtual instance or can be distributed and deployed in multiple virtual instances, and the present application is not limited thereto. In the embodiments of the present application, the focus is on the functions realized by the cooperation between the three modules of the demand management module 10, the resource orchestration module 20 and the execution delivery module 30.
[0041] In the embodiments of the present application, the demand management module 10 is the demand management entrance of the system 100, and can receive various cloud product demands. The cloud product demands can come from the users of the cloud product, the operation and maintenance personnel in the cloud service provider, the traditional cloud product supply system of the cloud service provider or a third-party cloud service provider.
[0042] For example, the system 100 provided in the embodiments of the present application can be open to the users of the cloud product, and the demand management module 10 provides a first demand providing entrance for the users of the cloud product. The first demand providing entrance can be a web page, an application page or a command window, etc. The users of the cloud product can submit cloud product demand information through the first demand providing entrance. The demand management module 10 can receive the cloud product demand information submitted by the users of the cloud product through the first demand providing entrance. The cloud product demand information describes the demand information of the user for the cloud product, and includes the description information of the user for the cloud product. The description information at least describes at least one of the type, the resource specification, the function, the start time of use and the coverage area of the cloud product required by the user.
[0043] For another example, the system 100 provided by the embodiment can be open to the operation and maintenance personnel of the cloud service provider, and the demand management module 10 provides a second demand providing entrance for the operation and maintenance personnel of the cloud service provider, which can be a web page, an application page or a command window, etc. The operation and maintenance personnel of the cloud service provider can submit the cloud product demand information through the second demand providing entrance, and the demand management module 10 can receive the cloud product demand information submitted by the operation and maintenance personnel of the cloud service provider through the second demand providing entrance. The cloud product demand information describes the demand information of the operation and maintenance personnel for the cloud product, including the description information of the operation and maintenance personnel for the cloud product, which at least describes at least one of the type, resource specification, function, start time of use and coverage area of the cloud product required by the operation and maintenance personnel. The operation and maintenance personnel can generate the cloud product demand in various operation and maintenance projects.
[0044] For another example, the system 100 provided by the embodiment can be connected with the traditional cloud product supply system of the cloud service provider, specifically, the demand management module 10 is connected with the traditional cloud product supply system. The traditional cloud product supply system provides various ready-made cloud products for users, and the users can purchase the required cloud products through the cloud product supply system. In the case of failed purchase of the cloud product by the user, the traditional cloud product supply system collects the information of the failed purchase of the cloud product by the user, and converts the information of the purchase of the cloud product by the user into cloud product demand information and provides it to the demand management module 10. The demand management module 10 can receive the cloud product demand information provided by the traditional cloud product supply system in the case of failed purchase of the cloud product by the user, so as to automatically produce the required cloud product for the user by the system 100. The present case combines with the conventional cloud product supply scheme of the cloud service provider, discovers and utilizes the underlying resource supply capability and cloud resource on the basis of the conventional cloud product supply scheme, and automatically produces the cloud product meeting the demand of the user in an efficient and rapid manner in the case that the conventional cloud product supply scheme cannot meet the demand of the user for the cloud product, so as to improve the user experience and increase the stickiness of the user to the cloud service provider.
[0045] For example, the cloud service provider to which the system 100 provided in this embodiment belongs can cooperate with a third-party cloud service provider to jointly provide various cloud products for users. Based on this, the system 100 provided in this embodiment can be connected to a related system or device of the third-party cloud service provider, specifically, the demand management module 10 is connected to the related system or device of the third-party cloud service provider, and is configured to receive cloud product demand information provided by the third-party cloud service provider. Alternatively, the third-party cloud service provider can provide the cloud product demand information of a user to the demand management module 10 when it is unable to provide the required cloud product for the user; or the third-party cloud service provider provides the cloud product demand of a specific user to the demand management module 10, and the cloud product demand of the specific user can be determined by a cooperation mode between the two parties. The combination of the present case and the third-party cloud service provider is conducive to enhancing cooperation between the two parties, and can also automatically produce cloud products that meet the user's demand for users in an efficient and fast manner, improve the user experience, and increase the user's stickiness to the cloud service provider.
[0046] In the embodiments of the present application, the format of the cloud product demand is not limited, and can be standardized cloud product demand information or non-standardized cloud product demand information, and the non-standardized cloud product demand information can be converted into standardized cloud product demand information. The standardized cloud product demand information refers to cloud product demand information with clear resource demand. For example, the cloud product demand information can have clear demand for virtualized resources, such as an ECS requiring 100 cores of vCPU, or clear demand for physical resources, such as an ECS requiring 2 physical servers. Correspondingly, the non-standardized cloud product demand information refers to cloud product demand information with less clear resource demand, such as cloud product demand information from an operation and maintenance personnel, for example, an ECS is required, but the resource specification of the ECS is not limited. The conversion of non-standardized cloud product demand information into standardized cloud product demand information mainly refers to the process of specifying the resource specification for non-standardized cloud product resource demand information, for example, specifying the number of cores of vCPU required by the ECS for cloud product demand information requiring an ECS, such as 10 cores of vCPU.
[0047] In the embodiments of the present application, the demand management module 10 can parse the cloud product demand information into K candidate resource deployment schemes, where K is a positive integer. Each candidate resource deployment scheme refers to a resource deployment scheme corresponding to the cloud product demand information, which is used to describe which resources are deployed in which availability zones, and a cloud product corresponding to the cloud product demand information can be obtained. A cloud product is a product that uses cloud resources and can provide a certain cloud service, such as ECS, SLB service, cloud database, object storage service, video on demand service, domain name service, log service system, short message service, and the like. In the present case, a plurality of resource deployment schemes correspond to the same cloud product demand information, and one resource deployment scheme needs to be selected from them, and resource deployment is performed according to the selected resource deployment scheme to obtain a cloud product. For ease of description and distinction, each resource deployment scheme parsed by the demand management module 10 is referred to as a candidate resource deployment scheme, and the resource deployment scheme selected from the plurality of candidate resource deployment schemes is referred to as a target resource deployment scheme. Each candidate resource deployment scheme includes at least resource information to be deployed and availability zone information to be deployed, the resource information to be deployed is used to describe the required resource information in the case of implementing a cloud product using the candidate resource deployment scheme, including the type of resource, the specification of resource, and the like, and the availability zone information to be deployed is used to describe the information of the availability zone where the cloud product is located in the case of implementing the cloud product using the candidate resource deployment scheme. An availability zone refers to a physical data center in the same geographical region that is independent in power and network, and fault isolation can be achieved between availability zones.
[0048] In the embodiments of the present application, the internal implementation structure of the demand management module 10 is not limited. In an optional embodiment, as shown in Figure 1b the demand management module 10 includes a demand entry module 11, a demand conversion unit 12, and a demand parsing unit 13.
[0049] The demand entry module 11 is configured to receive standardized cloud product demand information and / or non-standardized cloud product demand information. The demand conversion unit 12 is configured to convert non-standardized cloud product demand information into standardized cloud product demand information. For the standardized cloud product demand information and the non-standardized cloud product demand, and the conversion process therebetween, please refer to the description above, which will not be repeated here. The demand parsing unit 13 is interconnected with the demand entry module 11 and the demand conversion unit 12, and is configured to generate at least one candidate resource deployment scheme according to the explicit resource demand corresponding to the standardized cloud product demand information provided by the demand entry module 11 or the demand conversion unit 12. For ease of description, in the following, the at least one candidate resource deployment scheme is denoted as K candidate resource deployment schemes, where K is a positive integer.
[0050] In an optional embodiment, the demand analysis unit 13 is specifically configured to: determine XI kinds of resource information and Y1 kinds of available zone information according to the explicit resource demand corresponding to the standardized cloud product demand information; and generate K kinds of candidate resource deployment schemes according to the XI kinds of resource information and the Y1 kinds of available zone information, where XI and Y1 are positive integers.
[0051] Further optionally, the demand analysis unit 13 can directly combine the XI kinds of resource information and the Y1 kinds of available zone information, and take each combination of a kind of resource information and a kind of available zone information as a candidate resource deployment scheme, thereby obtaining K kinds of candidate resource deployment information. Alternatively, the demand analysis unit 13 can filter the XI kinds of resource information and the Y1 kinds of available zone information according to the attributes of the resource information and the attributes of the available zone information, to obtain X2 kinds of resource information and Y2 kinds of available zone information, where X2 and Y2 are positive integers, and X2≤XI and Y2≤Y1; for example, resource information whose resource specification obviously does not meet the requirements (for example, resource information whose resource specification exceeds the upper limit or whose resource specification is less than the lower limit) can be filtered out, and available zone information that obviously does not meet the requirements (for example, available zone information whose geographic location is too remote or whose available zone specification is too small or too large) can also be filtered out; then, the X2 kinds of resource information and the Y2 kinds of available zone information are combined to obtain P kinds of candidate resource deployment schemes, where P is a positive integer and P≥K; further, based on M kinds of resource supply capabilities and / or available zone resource capability information, the P kinds of candidate resource deployment schemes are filtered to obtain K kinds of candidate resource deployment schemes, where M is a positive integer and M≤N. Wherein, filtering the P kinds of candidate resource deployment schemes based on the M kinds of resource supply capabilities and / or available zone resource capability information mainly filters out candidate resource deployment schemes that exceed the resource supply capabilities, exceed the available zone resource capability information, or do not match the resource function capabilities and the available zone resource capability information. For example, assuming that a candidate resource deployment scheme includes resource information with a resource specification of 10000 vCPUs and available zone A, and the resource capability upper limit of available zone A is to provide 8000 vCPUs, then the candidate resource deployment scheme is obviously not feasible and should be filtered out.
[0052] After obtaining the K kinds of candidate resource deployment schemes, the demand management module 10 provides the K kinds of candidate resource deployment schemes to the resource orchestration module 20. The resource orchestration module 20 performs resource orchestration and resource consumption cost information estimation processing on the K kinds of candidate resource deployment schemes by means of at least one resource supply capability provided by a cloud service vendor, and obtains a target resource deployment scheme whose resource consumption cost information meets the requirements and a corresponding target resource solution scheme. Similarly, for ease of description, in the following, at least one resource supply capability is denoted as N kinds of resource supply capabilities, where N is a positive integer.
[0053] In the embodiment, resource orchestration mainly refers to a process of finding resource solutions for various candidate resource deployment schemes by means of resource provisioning capabilities of a cloud service provider. The resource provisioning capability is any underlying capability provided by the cloud service provider that can provide idle resources, and can also be understood as a way to provide idle resources, for example, an instance migration capability (a migrated instance releases the originally occupied resources), a procurement capability of purchasing physical servers (purchased physical servers can provide new resources), a capability of turnover inventory, a mixed operation, a variable configuration capability, a temporary resource selling capability, and the like. The capability of turnover inventory refers to a capability of temporarily scheduling resources below the water level in the emergency resource library. The mixed operation refers to a capability of temporarily generating a resource specification that is not supported on a physical machine and allowing the resource specification to be provided within a certain range. The variable configuration capability refers to a capability of taking idle physical machines offline, reconfiguring the underlying virtualization template, and deploying the physical machines online to provide resources of a new specification. The temporary resource selling capability can also be referred to as a SPOT (Spot in Time) capability, which allows part of the out-of-safety period resources to be temporarily sold to other users for use. If no protection period is set, the resources can be recovered at any time after a set time, for example, 1 hour, and therefore the cost of using such resources is relatively low.
[0054] The resource solution of the candidate resource deployment scheme refers to a solution of providing the required to-be-deployed resource information for the candidate resource deployment scheme. The resource solution includes at least one resource provisioning capability, each resource provisioning capability in the at least one resource provisioning capability is responsible for providing at least part of the to-be-deployed resource information in the candidate resource deployment scheme, and the sum of the at least part of the resource information provided by the at least one resource provisioning capability is greater than or equal to the to-be-deployed resource information in the candidate resource deployment scheme. In other words, the to-be-deployed resource information in a candidate resource deployment scheme can be provided by one or more resource provisioning capabilities provided by the cloud service provider, and the one or more resource provisioning capabilities responsible for providing the resource information and the resource information provided by each resource provisioning capability form the resource solution of the candidate resource deployment scheme. For example, assume that a resource candidate deployment scheme requires resource information (i.e., to-be-deployed resource information) of 100 cores of vCPU, and the resource solution of the resource candidate deployment scheme obtained through resource orchestration includes: 60 cores of vCPU obtained by using the instance migration capability, 20 cores of vCPU obtained by using the mixed operation, and 20 cores of vCPU obtained by using the variable configuration capability.
[0055] In this embodiment, the resource consumption cost information refers to the relevant resource consumption cost information involved in the process of finding a resource solution for each candidate resource deployment scheme, and the resource consumption cost information at least includes the resource consumption cost information generated by the resource solution corresponding to each candidate resource deployment scheme. In this embodiment, based on the resource consumption cost information, a target resource solution with required resource consumption cost information is selected, and the candidate resource deployment scheme corresponding to the target resource solution is obtained as a target resource deployment scheme. In the embodiments of the present application, the implementation manner of selecting the target resource solution with required resource consumption cost information is not limited, and can be flexibly implemented according to application scenarios. For example, in an application scenario, the resource solution with the minimum resource consumption cost information can be selected as the target resource solution; in another application scenario, the resource solution with resource consumption cost information less than a set cost threshold can be selected as the target resource solution; and in still another application scenario, the resource solution with resource consumption cost information within a set cost range can be selected as the target resource solution.
[0056] It is explained that the selection process of the target resource solution is also the selection process of the target resource deployment scheme. The target resource solution can be selected, and then the target resource deployment scheme is determined by the target resource solution. Alternatively, the target resource deployment scheme can be selected, and then the target resource solution is determined by the target resource deployment scheme. Both of the two description manners are supported in the embodiments of the present application.
[0057] After obtaining the target resource deployment scheme and the corresponding target resource solution, the resource arrangement module 20 can provide the target resource deployment scheme and the corresponding target resource solution to the execution delivery module 30. The execution delivery module 30 can execute a resource processing task in the available zone corresponding to the to-be-deployed available zone information in the target resource deployment scheme according to the target resource solution, to obtain a cloud product corresponding to the cloud product requirement information. Here, the resource processing task mainly refers to the process of reserving corresponding resource information according to each resource supply capability in the target resource solution. In the case that all the resource information to be deployed in the target resource deployment scheme is successfully reserved, the successfully reserved resource information can be assembled into a cloud product corresponding to the cloud resource requirement. For example, 60-core vCPUs reserved by using instance migration capability, 20-core vCPUs reserved by using mixed operation, and 20-core vCPUs reserved by using variable configuration capability can be assembled into an ECS with 100-core vCPUs.
[0058] In the embodiments of the present application, by means of the resource supply capability of the cloud service provider, the required cloud product can be quickly and on-demand provided for the user, and the elasticity of resource supply is realized. In addition, since the resource consumption cost of the resource solution is considered, the cost performance of resource supply is improved.
[0059] In the embodiments of the present application, the internal implementation structure of the resource arrangement module 20 is not limited, and the implementation manner of the resource arrangement module 20 for estimating the resource consumption cost information of the K candidate resource deployment schemes according to the N resource supply capabilities is not limited. Wherein, Figure 1c An internal implementation structure of the resource arrangement module 20 provided in the embodiments of the present application is provided. The detailed implementation manner of the resource arrangement module 20 for estimating the resource consumption cost information of the K candidate resource deployment schemes according to the N resource supply capabilities will be described in detail below in combination with the structure shown in Figure 1c
[0060] As shown in Figure 1c The resource arrangement module 20 includes a first resource arrangement unit 21, a second resource arrangement unit 22, and a scheme selection unit 23.
[0061] The first resource arrangement unit 21 is configured to, for any candidate resource deployment scheme, estimate the unit resource consumption cost information when the N resource supply capabilities respectively provide the required resources for the any candidate resource deployment scheme according to the resource information to be deployed and the available zone information to be deployed in the any candidate resource deployment scheme.
[0062] The second resource arrangement unit 22 is configured to generate the resource solution corresponding to any candidate resource deployment scheme and the resource consumption cost information of the resource solution according to the unit resource consumption cost information when the N resource supply capabilities respectively provide the required resources for the any candidate resource deployment scheme and the resource information to be deployed in the any candidate resource deployment scheme.
[0063] The scheme selection unit 23 is configured to select the target resource deployment scheme and the target resource solution corresponding to the target resource deployment scheme according to the resource consumption cost information of the resource solution corresponding to each of the K candidate resource deployment schemes.
[0064] In detail, for each candidate resource deployment scheme, the first resource arrangement unit 21 needs to provide the required resources for the candidate resource deployment scheme by using the N resource supply capabilities, and estimate the unit resource consumption cost information generated when each resource supply capability provides the required resources for the candidate resource deployment scheme. Wherein, the unit resource consumption cost information refers to the resource cost consumed by a resource supply capability for providing a unit resource for a candidate resource deployment scheme. In the embodiments of the present application, the unit or specification of the unit resource is not limited, and can be determined according to the resource type, for example, if the resource is vCPU, the unit resource can be a single vCPU, if the resource is memory resource, the unit resource can be 1G memory resource, which is not limited.
[0065] For the convenience of description and distinction, any candidate resource deployment scheme A is taken as an example for description. For any candidate resource deployment scheme A, the first resource arrangement unit 21 estimates N kinds of resource supply capabilities to provide the required resources for any candidate resource deployment scheme A, and provides N kinds of unit resource loss cost information corresponding to the N kinds of resource supply capabilities to the second resource arrangement unit 22.
[0066] In an optional embodiment, the first resource arrangement unit 21 estimates the unit resource loss cost information of N kinds of resource supply capabilities to provide the required resources for any candidate resource deployment scheme A, including: for any kind of resource supply capability, obtaining target resource information and target time information consumed when any kind of resource supply capability provides the required resources for any candidate resource deployment scheme A; generating target resource loss cost information when any kind of resource supply capability provides the required resources for any candidate resource deployment scheme A according to the target resource information and the target time information; and calculating the unit resource loss cost information when any kind of resource supply capability provides the required resources for any candidate resource deployment scheme A according to the target resource loss cost information and the resource information to be deployed in any candidate resource deployment scheme A.
[0067] For any kind of resource supply capability, the resource amount consumed when it provides the required resources for any candidate resource deployment scheme A is greater than or equal to the resource amount required by any candidate resource deployment scheme A (the resource amount is the resource amount in the resource information to be deployed in any candidate resource deployment scheme A), and it needs to consume a certain time to provide the required resources for any candidate resource deployment scheme A. In the embodiment of the application, the target resource information and the target time information consumed when any kind of resource supply capability provides the required resources for any candidate resource deployment scheme A are used to measure the resource loss cost information generated when any kind of resource supply capability provides the required resources for any candidate resource deployment scheme A. For the convenience of distinction and description, the resource loss cost information generated when any kind of resource supply capability provides the required resources for any candidate resource deployment scheme A is called target resource loss cost information.
[0068] In the embodiment of the application, the way in which the first resource arrangement unit 21 obtains the target resource information and the target time information consumed when any kind of resource supply capability provides the required resources for any candidate resource deployment scheme A is not limited. An optional implementation is given below, which is as follows:
[0069] After the cloud product requirement information is parsed into K candidate resource deployment schemes, the K candidate resource deployment schemes can wait to be scheduled. There is no limitation on how to schedule the K resource deployment schemes. The K resource deployment schemes can be scheduled randomly, according to the order of the identifiers of the candidate resource deployment schemes from small to large, or according to the order of the resource information to be deployed in the candidate resource deployment schemes from small to large, and the like. In this way, any candidate resource deployment scheme A has a scheduling processing start time. In addition, the expected resource usage start time can also be included in any candidate resource deployment scheme A. Based on this, the first resource arrangement unit 21 can determine the resource waiting time of any resource supply capability according to the scheduling processing start time of any candidate resource deployment scheme A, the resource processing time of any resource supply capability, and the resource usage start time in any candidate resource deployment scheme A. The target time information includes the resource processing time and the resource waiting time. The resource processing time of any resource supply capability can be determined according to its supply capability and the amount of resources to be deployed in any candidate resource deployment scheme A. In addition, the first resource arrangement unit 21 can obtain the effective resource information occupied and the resource fragment information generated when any resource supply capability provides the required resources for any candidate resource deployment scheme A according to the resource information to be deployed in any candidate resource deployment scheme A. The target resource information includes the effective resource information and the resource fragment information. The effective resource information refers to the minimum resource information required to ensure the required resources of any candidate resource deployment scheme A. The amount of resources in the effective resource information is greater than or equal to the amount of resources to be deployed in any candidate resource deployment scheme A. The resource fragment information refers to the resource fragments that have to be generated in order to generate the effective resource information. For example, a physical machine can have 300 cores of vCPU. For a scenario that requires 1000 cores of vCPU, four physical machines can be opened to have a total of 1200 cores of vCPU. Actually, 1000 cores of vCPU are required, and the other 200 cores of vCPU are resource fragments.
[0070] Suppose that any candidate resource deployment scheme A requires 1000 cores of vCPU. Taking the example of using mixed opening capability to provide the required resources for the any candidate resource deployment scheme A, it is assumed that the candidate resource deployment scheme A starts to use after 7 days, the process of using mixed opening capability to provide the required resources for the any candidate resource deployment scheme A takes 5 minutes, there is a 2% risk, and the success rate of execution is expected to be 95%. The effective resource information is 1200 cores of vCPU and 100 cores of vCPU of resource fragments.
[0071] After obtaining the target resource information and the target time information consumed when any resource supply capability provides required resources for any candidate resource deployment scheme A, the first resource arrangement unit 21 can generate target resource consumption cost information when any resource supply capability provides required resources for any candidate resource deployment scheme A according to the target resource information and the target time information. Optionally, the first resource arrangement unit 21 can perform certain numerical processing on the target resource information and the target time information, for example, normalization, and then perform weighted summation on the normalized target resource information and the target time information using a set resource cost parameter, and the like, to obtain the target resource consumption cost information when any resource supply capability provides required resources for any candidate resource deployment scheme A.
[0072] In another optional embodiment, the risk of each resource supply capability when providing required resources for any candidate resource deployment scheme A, the additional resource information that has to be provided to ensure the satisfaction rate, and the filtering conditions that should be met, and the like, can also be considered to more accurately estimate the target resource consumption cost information when any resource supply capability provides required resources for any candidate resource deployment scheme A. Based on this, the first resource arrangement unit is further configured to: obtain at least one of a corresponding risk probability, an additional resource proportion for ensuring the satisfaction rate, and / or a filtering condition when any resource supply capability provides required resources for any candidate resource deployment scheme A.
[0073] Further optionally, the first resource arrangement unit 21 obtains the corresponding risk probability when any resource supply capability provides required resources for any candidate resource deployment scheme A, including: generating the risk probability according to the influence information on other resource objects and / or other users when any resource supply capability provides required resources for any candidate resource deployment scheme A. Taking the instance migration capability as an example, in order to provide required resources for any candidate resource deployment scheme A, instance migration needs to be performed, wherein the migrated instance, the original physical machine and the target physical machine where the migrated instance is located, and the user to which the migrated instance belongs, and the like, will be affected by the migration operation, which poses a certain risk to the system, and the risk probability can be determined according to the influence information on other resource objects and / or other users when any resource supply capability provides required resources for any candidate resource deployment scheme A.
[0074] Further optionally, the first resource arrangement unit 21 acquires the extra resource proportion for guaranteeing the satisfaction rate when any resource supply capability provides the required resources for any candidate resource deployment scheme A, including: generating the execution success rate when any resource supply capability provides the required resources for any candidate resource deployment scheme A according to the historical deployment data of the available zones corresponding to the available zone information to be deployed in any candidate resource deployment scheme A; and calculating the extra resource proportion for guaranteeing the satisfaction rate according to the user's expected satisfaction rate and the execution success rate. The execution success rate refers to the probability that any resource supply capability can successfully provide the required resources for any candidate resource deployment scheme A, which can be obtained by statistical analysis according to the historical deployment data of the available zones corresponding to the available zone information to be deployed in any candidate resource deployment scheme A.
[0075] Based on the above, one optional implementation of the first resource arrangement unit 21 generating target resource loss cost information when any resource supply capability provides the required resources for any candidate resource deployment scheme A according to target resource information and target time information includes: generating the target resource loss cost information according to at least one of the risk probability, the extra resource proportion for guaranteeing the satisfaction rate, and / or the filtering condition, and the effective resource information, the resource fragmentation information, the resource processing time length, and the resource waiting time length.
[0076] Further optionally, the first resource arrangement unit 21 generates the target resource loss cost information according to the risk probability, the extra resource proportion for guaranteeing the satisfaction rate, and the filtering condition, and the effective resource information, the resource fragmentation information, the resource processing time length, and the resource waiting time length, including: generating resource processing cost information according to the effective resource information, the resource fragmentation information, and the resource processing time length; respectively correcting the resource processing cost information according to the risk probability and the extra resource proportion for guaranteeing the satisfaction rate to obtain first intermediate state cost information and second intermediate state cost information; generating resource waiting cost information according to the resource information to be deployed in any candidate resource deployment scheme A and the resource waiting time length; and generating the target resource loss cost information according to the first intermediate state cost information, the second intermediate state cost information, the resource waiting cost information, and the filtering condition. In this embodiment, the implementation of generating resource processing cost information according to the effective resource information, the resource fragmentation information, and the resource processing time length is not limited, and the implementation of respectively correcting the resource processing cost information to obtain the first intermediate state cost information and the second intermediate state cost information according to the risk probability and the extra resource proportion for guaranteeing the satisfaction rate is not limited, which can be referred to the examples in the subsequent scenario embodiments.
[0077] Further optionally, the first resource arrangement unit 21 generates target resource consumption cost information according to the first intermediate state cost information, the second intermediate state cost information, the resource waiting cost information and the filtering condition, including: performing weighted summation on the first intermediate state cost information, the second intermediate state cost information and the resource waiting cost information to obtain initial resource consumption cost information; in the case that any resource supply capability meets the filtering condition, taking the initial resource consumption cost information as the target resource consumption cost information; in the case that any resource supply capability does not meet the filtering condition, taking preset resource consumption cost information as the target resource consumption cost information.
[0078] Further optionally, the system 100 can further include a confidence module configured to calculate a confidence of any resource supply capability according to actual resource consumption information of any candidate resource deployment scheme when the resource supply capability provides required resources for the candidate resource deployment scheme and resource information to be deployed in any candidate resource deployment scheme, and adjust weight information required for calculating resource consumption cost information corresponding to any resource supply capability according to the confidence. Since there is a risk probability and a demand for guaranteeing a satisfaction rate, actual resource consumption information of any candidate resource deployment scheme when any resource supply capability provides required resources for the candidate resource deployment scheme is greater than resource information to be deployed in any candidate resource deployment scheme, and at least includes effective resource information generated by any resource supply capability, resource fragment information and resource information consumed additionally for guaranteeing the satisfaction rate.
[0079] After obtaining the target resource consumption cost information of any candidate resource deployment scheme A when any resource supply capability provides required resources for the candidate resource deployment scheme A, the first resource arrangement unit 21 can calculate unit resource consumption cost information of any candidate resource deployment scheme A when any resource supply capability provides required resources for the candidate resource deployment scheme A according to the target resource consumption cost information and resource information to be deployed in any candidate resource deployment scheme A. For example, the target resource consumption cost information is divided by the amount of resources to be deployed in any candidate resource deployment scheme A, and unit resource consumption cost information of any candidate resource deployment scheme A when any resource supply capability provides required resources for the candidate resource deployment scheme A can be obtained.
[0080] After obtaining the unit resource consumption cost information when any one of the resource supply capabilities provides the required resources for any candidate resource deployment scheme A, the first resource arrangement unit 21 can provide the unit resource consumption cost information when any one of the resource supply capabilities provides the required resources for any candidate resource deployment scheme A to the second resource arrangement unit 22. After obtaining the unit resource consumption cost information when N kinds of resource supply capabilities respectively provide the required resources for the candidate resource deployment scheme A, the second resource arrangement unit 22 can generate the resource solution corresponding to the candidate resource deployment scheme A and the resource consumption cost information thereof according to the unit resource consumption cost information when N kinds of resource supply capabilities respectively provide the required resources for the candidate resource deployment scheme A and the resource information to be deployed in the candidate resource deployment scheme A.
[0081] Specifically, the second resource arrangement unit 22 is specifically configured to: determine, according to the resource information to be deployed in any candidate resource deployment scheme A and the upper limit resource information that can be provided by each of the N kinds of resource supply capabilities, at least one resource supply capability required to meet the resource information to be deployed in any candidate resource deployment scheme A and at least part of the resource information responsible for providing by the at least one resource supply capability, as the resource solution corresponding to any candidate resource deployment scheme A; and further generate the resource consumption cost information of the resource solution corresponding to any candidate resource deployment scheme A according to the unit resource consumption cost information corresponding to the at least one resource supply capability and the at least part of the resource information responsible for providing. For example, assuming that the amount of resources to be deployed in any candidate resource deployment scheme A is 100 cores of vCPU, among the N kinds of resource supply capabilities, the instance migration capability can provide up to 60 cores of vCPU, the mixed operation can provide up to 20 cores of vCPU, the variable allocation capability can provide up to 20 cores of vCPU, the turnover inventory capability can provide up to 30 cores of vCPU, and the procurement capability can provide up to 40 cores of vCPU. In view of this, the instance migration capability, the mixed operation, and the variable allocation capability can be selected, the instance migration capability is responsible for providing 60 cores of vCPU, the mixed operation is responsible for providing 20 cores of vCPU, and the variable allocation capability is responsible for providing 20 cores of vCPU, to obtain the resource solution of any candidate resource deployment scheme A. Further, the resource consumption cost information of the instance migration capability is obtained according to the unit resource consumption cost information corresponding to the instance migration capability and the 60 cores of vCPU responsible for providing, the resource consumption cost information of the mixed operation is obtained according to the unit resource consumption cost information corresponding to the mixed operation and the 20 cores of vCPU responsible for providing, and the resource consumption cost information of the variable allocation capability is obtained according to the unit resource consumption cost information corresponding to the variable allocation capability and the 20 cores of vCPU responsible for providing. The sum of the three parts of resource consumption cost information is the resource consumption cost information of the resource solution of any candidate resource deployment scheme A.
[0082] The second resource arrangement unit 22, after obtaining the resource solution corresponding to any candidate resource deployment scheme A and the resource consumption cost information thereof, provides the resource solution corresponding to the candidate resource deployment scheme A and the resource consumption cost information thereof to the scheme selection unit 23. The scheme selection unit 23, after receiving the resource consumption cost information of the resource solution corresponding to each of the K candidate resource deployment schemes provided by the second resource arrangement unit 22, can select a target resource deployment scheme and the target resource solution corresponding thereto according to the resource consumption cost information of the resource solution corresponding to each of the K candidate resource deployment schemes. The detailed implementation of selecting the target resource deployment scheme and the target resource solution corresponding thereto can be referred to the description in the foregoing, which will not be described here.
[0083] After obtaining the target resource deployment scheme and the target resource solution corresponding thereto, the scheme selection unit 23 can submit the target resource deployment scheme and the target resource solution corresponding thereto to the execution delivery module 30. The execution delivery module 30 can execute a resource processing task in the available zone corresponding to the available zone information to be deployed in the target resource deployment scheme according to the target resource solution, to obtain a cloud product corresponding to the cloud product demand information.
[0084] In this embodiment, the execution delivery module 30 can manage various target resource solutions through a ready queue, and whenever a target resource solution is received, the target resource solution is added to the ready queue, and each resource solution in the ready queue is dispatched according to the priority of the resource solution, wherein the priority of the target resource solution is determined according to the resource scenario to which the cloud product demand information belongs. Further, when the target resource solution is dispatched, a resource processing task is executed in the available zone corresponding to the available zone information to be deployed in the target resource deployment scheme according to the target resource solution, to obtain a cloud product corresponding to the cloud product demand information.
[0085] In the embodiment, in order to prevent the problem that a certain resource solution in the ready queue cannot be processed due to being preempted for a scheduling opportunity for too low priority, the execution interaction module 30 adopts a dynamic priority scheme, that is, each resource solution has an original priority, which is determined according to the resource scene to which the cloud product demand information belongs, and the priority is dynamically adjusted as the waiting time for scheduling is prolonged, so that the resource solution with a longer waiting time can be scheduled. Based on this, the execution interaction module 30 is further configured to monitor the waiting time of each resource solution in the ready queue during scheduling of each resource solution in the ready queue, and when it is monitored that the waiting time of a first resource solution exceeds a corresponding waiting time threshold, the priority of the first resource solution is increased, the waiting time threshold is dynamically determined according to the priority of the first resource solution before adjustment, and changes with the dynamic change of the priority of the first resource solution. The higher the priority, the smaller the waiting time threshold. Assuming that the priority range of the resource solution is 1-99, the smaller the number, the higher the priority; assuming that the initial priority of a certain resource solution determined according to the resource scene is 60, the waiting time threshold corresponding to the priority 60 is 30 minutes, if the resource solution still cannot be scheduled after waiting for 30 minutes, the priority of the resource solution can be increased, for example, to 20, the waiting time threshold corresponding to the priority 20 is 15 minutes, the resource solution needs to be scheduled within 15 minutes in the near future, otherwise the priority of the resource solution will continue to be increased until the resource solution is scheduled. The resource solution with a priority of 1 will be scheduled first.
[0086] Further, in the embodiment, when the execution delivery module 30 schedules the target resource solution, considering that the target resource solution includes at least one resource supply capability, the at least one resource supply capability can be scheduled in sequence according to the priority of the at least one resource supply capability. Alternatively, the priority of the at least one resource supply capability can be determined according to the unit resource consumption cost information corresponding to the at least one resource supply capability, for example, the smaller the unit resource consumption cost information, the higher the priority of the corresponding resource supply capability. In this case, the execution delivery module 30 can preferentially schedule the resource supply capability with smaller unit resource consumption cost information, and control the scheduled resource supply capability to perform resource reservation on at least part of the resource information responsible for providing by the resource supply capability; when the resource reservation results of the at least one resource supply capability are all successful, the resources reserved by the at least one resource supply capability are assembled into a cloud product corresponding to the cloud product demand information.
[0087] Furthermore, during the sequential scheduling of various resource supply capabilities, if the scheduled resource supply capability fails to reserve resources, the execution delivery module 30 can calculate the additional resource amount based on the success rate of the failed resource supply capability and the success rate of the next resource supply capability. When scheduling the next resource supply capability, the module controls the next resource supply capability to reserve resources according to at least part of the resource information it is responsible for providing and the additional resource amount. For ease of description, this scheduling process can be referred to as deceleration scheduling.
[0088] Optionally, upon receiving cloud product demand information, the demand management module 10 can add scenario tags to the cloud product demand information. Different scenario tags correspond to different resource scenarios, allowing for pre-configuration of scheduling priorities, execution topologies, degradation strategies, delivery strategies, resource reservation strategies, retry strategies, orchestration strategies, approval strategies, and callback strategies for each resource scenario. For example, the delivery strategy can constrain the maximum number of deliveries to the target resource solution; for instance, if a delivery fails once, it can be delivered again. The resource reservation strategy constrains the resource reservation behavior of each resource supply capability in the target resource solution, such as limiting the maximum number of repeated resource reservations. The degradation strategy constrains the scheduling method of each resource supply capability in the target resource solution (see the reduction execution section in the following embodiments). The retry strategy refers to the strategy of repeatedly executing the target resource solution production steps until a target resource solution that meets the cloud product requirements is obtained when the produced target resource solution does not meet the cloud product requirements. The callback strategy refers to the strategy of allowing the execution status of the target resource solution to be viewed through a callback function after the target resource solution is delivered for execution. An orchestration strategy refers to a method for orchestrating resources; optionally, this orchestration strategy can produce... Figure 2a The combination of resource supply capacity and resource deployment schemes is shown.
[0089] To facilitate understanding, the processing procedures of the cloud product data processing system described above will be explained in detail below, using specific application scenarios.
[0090] like Figure 1d - Figure 1eAs shown, when the user or the operation and maintenance personnel has a cloud product demand, the user or the operation and maintenance personnel can trigger a demand operation of the cloud product including the standardized cloud product demand information and / or the non-standardized cloud product demand information to the cloud product data processing system. The demand entry unit receives the standardized cloud product demand information and / or the non-standardized cloud product demand information and transmits the standardized cloud product demand information and / or the non-standardized cloud product demand information to the demand conversion unit. The demand conversion unit converts the non-standardized cloud product demand information into the standardized cloud product demand information with explicit resource demand and transmits the standardized cloud product demand information to the demand analysis unit. The demand analysis unit determines XI kinds of resource information and Y1 kinds of available zone information according to the explicit resource demand corresponding to the standardized cloud product demand information. Further, the XI kinds of resource information and the Y1 kinds of available zone information are filtered to obtain X2 kinds of resource information and Y2 kinds of available zone information, and the X2 kinds of resource information and the Y2 kinds of available zone information are combined to obtain P kinds of candidate resource deployment schemes. Further, in the P kinds of resource candidate deployment schemes, there can be at least one resource supply capability that does not match the resource capability of the available zone. Based on this, the P kinds of candidate resource deployment schemes can be filtered based on the resource capability information of at least one Provider and / or available zone to obtain K kinds of candidate resource deployment schemes.
[0091] The generation process of the candidate resource deployment scheme is as shown in Figure 2a As shown, the resource information at least includes specification 1, specification 2, …, specification X, the available zone information at least includes available zone 1, available zone 2, …, available zone Y, each of the XI kinds of resource information can be matched with each of the Y kinds of available zone to obtain X*Y (P kinds) of candidate resource deployment schemes, and each of the candidate resource deployment schemes can be represented by “< specification X, available zone Y >”. Further, it is assumed that the memory required to be occupied by the cloud resource of specification 1 is greater than the memory that can be provided by the available zone 1, that is, “< specification 1, available zone 1 >” belongs to the resource deployment scheme with unmatched resources, and therefore at least one resource supply capability that does not match the resource capability of the available zone can be filtered to obtain the final K kinds of candidate resource deployment schemes.
[0092] Further, the cloud service provider provides N kinds of resource supply capabilities, and in the scenario embodiment, the resource supply capability is recorded as Provider, for example Figure 2a The resource suppliers Provider 1, Provider 2, …, Provider N in the K kinds of candidate resource deployment schemes can be combined with each other to obtain K*N solutions based on a single Provider.
[0093] The resource consumption cost information of the solution based on the Provider is calculated as follows:
[0094] Time cost schematic diagram:
[0095] As shown in Figure 2b , for any Provider, according to the scheduling processing start time T dis.star of any candidate resource deployment scheme, the resource processing duration h loss of any Provider, and the resource use start time T use.star in any candidate resource deployment scheme, the resource waiting duration h waste of any Provider is determined. The resource waiting duration h waste of any Provider can use, but is not limited to, the following formula:
[0096] h waste = T use.star -T dis.star -h loss
[0097] Since the target time information includes the resource processing duration h loss and the resource waiting duration h waste , the target time information can use, but is not limited to, the following formula:
[0098] h loss+ h waste
[0099] Resource cost schematic diagram:
[0100] According to the resource information to be deployed in any candidate resource deployment scheme, the effective resource information n block occupied by any Provider when providing the required resources for any candidate resource deployment scheme and the resource fragment information n chip generated are obtained. Since the target resource information includes the effective resource information and the resource fragment information, that is, the target resource information can use, but is not limited to, the following formula:
[0101] n block +n chip
[0102] According to the effective resource information n block , the resource fragment information n chip , the resource processing duration h loss , and the resource fragment generation duration h chip , the resource processing cost information C loss is generated. The resource processing cost information C loss includes the resource fragment loss C chip and the resource processing loss C block . Wherein, it can be assumed that the resource processing duration h loss and the resource fragment generation duration hchip The same.
[0103] Wherein, the resource fragmentation loss C chip May be used but not limited to the following formula:
[0104] C chip = n chip *h chip *w free
[0105] Wherein, the resource processing loss C block May be used but not limited to the following formula:
[0106] C block = n block *h loss *w free
[0107] Wherein, the resource processing cost information C loss May be used but not limited to the following formula:
[0108] C loss = C chip +C block
[0109] Optionally, some Provider exists certain additional cost, for the existence of additional cost Provider can multiply part of the cost factor e, e ∈ [1, + ∞], for example, the separate cost of relocation, the separate cost of procurement, the actual supply chain cost is higher, e is higher, the resulting final resource loss will also be higher.
[0110] Risk cost diagram:
[0111] According to the impact information of any Provider for any candidate resource deployment scheme to provide the required resources for other resource objects such as physical machines, virtual machines and / or other users, the risk probability P risk Is generated, wherein the risk probability is related to the risk occurrence probability p risk And the loss multiplier value caused when the risk occurs, the loss multiplier value can be 100 times, but not limited to this. The risk probability P risk May be used but not limited to the following formula:
[0112] P risk = 100 * p risk
[0113] Satisfaction rate cost diagram:
[0114] Based on the historical deployment data of the availability zones corresponding to the availability zones to be deployed in any candidate resource deployment scheme, generate the execution success rate p when any Provider provides the required resources for any candidate resource deployment scheme. sucess And based on the user's expected satisfaction rate p fill and execution success rate p sucess Calculate the percentage of additional resources P required to ensure satisfaction rate. extra The additional resources P required to ensure satisfaction rate extra The following formulas may be used, but are not limited to:
[0115] P extra =p fill / p sucess
[0116] Filtering conditions illustration:
[0117] This function retrieves the filter (Filter(rule)) corresponding to the resource requirements of any Provider for any candidate resource deployment scheme. Filter conditions can include, for example, the scheme's impact on sales rate, its impact on online turnover, whether the scheme supports hot migration, and whether the scheme has a low historical success rate in the system's overall dashboard. These filter conditions determine whether the scheme's cost evaluation is meaningful. The filter (Filter(rule)) can use, but is not limited to, the following formula:
[0118]
[0119] The filter condition Filter(rule) described above can be 1 to indicate that the filter condition is met, and 0 to indicate that the filter condition is not met. However, the above values are only illustrative and do not constitute a limitation on the embodiments of this application.
[0120] Target resource depletion cost information:
[0121] Based on the risk probability and the proportion of additional resources required to ensure satisfaction, the resource processing cost information is corrected to obtain the first intermediate cost information C″1 and the second intermediate cost information C″2.
[0122] The first intermediate state cost information C″1 can be expressed using, but is not limited to, the following formula:
[0123] C″1=C loss *P extra
[0124] The cost information C″2 of the second intermediate state can be expressed using, but is not limited to, the following formula:
[0125] C″2=C loss *P risk
[0126] According to the resource information to be deployed and the resource waiting time length in any candidate resource deployment scheme, resource waiting cost information C"3 is generated. The resource waiting cost information C"3 can be, but is not limited to, the following formula:
[0127] C"3=C free
[0128] Further, the first intermediate state cost information, the second intermediate state cost information and the resource waiting cost information are weighted and summed to obtain initial resource consumption cost information C"4; in the case where any Provider meets the filtering condition, the initial resource consumption cost information is taken as the target resource consumption cost information C"; in the case where any Provider does not meet the filtering condition, the preset resource consumption cost information is taken as the target resource consumption cost information.
[0129] Wherein, assuming that the weights of the first intermediate state cost information, the second intermediate state cost information and the resource waiting cost information initial resource consumption cost information are W1, W2, W3 respectively, the initial resource consumption cost information C"4 can be, but is not limited to, the following formula:
[0130] C"4=W1*C"1+W 2* C"2+W 3* C"3
[0131] Wherein, the target resource consumption cost information can be, but is not limited to, the following formula:
[0132] C"=C"4*Filter(rule)
[0133] That is, in the case where any Provider meets the filtering condition (for example, the value is 1), the initial resource consumption cost information is taken as the target resource consumption cost information; in the case where any Provider does not meet the filtering condition (for example, the value is 0), the preset resource consumption cost information is taken as the target resource consumption cost information.
[0134] Unit resource consumption cost information:
[0135] After obtaining the target resource cost information, according to the target resource consumption cost information and the resource information to be deployed in any candidate resource deployment scheme, mainly the resource amount n to be deployed, the unit resource consumption cost information Score of any Provider providing the required resources for any candidate resource deployment scheme is calculated. The unit resource consumption cost information Score can be, but is not limited to, the following formula:
[0136]
[0137] Wherein, Score∈(0, k], k represents a normalized numerical range, which can be determined according to application requirements, and is a constant; normalization(C") represents normalizing C".
[0138] Resource solution of each candidate resource deployment scheme:
[0139] According to the unit resource loss cost information, the resource solution corresponding to each of the K candidate resource deployment schemes and the resource loss cost information thereof can be obtained. Wherein, for the kth candidate resource deployment scheme, the unit loss information of the jth Provider, i.e. Provider j , is represented as Score j , the at least part of resource information provided by the Provider is n j , and the total score Value k of the resource solution of the kth candidate resource deployment scheme can be represented by, but not limited to, the following formula:
[0140]
[0141] Wherein, M is the number of Providers corresponding to the kth candidate resource deployment scheme.
[0142] According to the resource loss cost information of the resource solution corresponding to each of the K candidate resource deployment schemes, the resource solution with the minimum resource loss cost information (corresponding to the highest score) can be selected as the target resource solution Value final , which can be represented by, but not limited to, the following formula:
[0143] Value final = Max(Value k )
[0144] The resource loss cost information generated by several Providers is illustrated as follows:
[0145] Example 1: Taking the turnover inventory as an example, a certain candidate resource deployment scheme needs a total of 1000 vCPU, and starts to be scheduled after 7 days. The turnover inventory generates 1000 vCPU, and there is a 2% possibility of risk in the processing process. The total processing time is 1 minute, and the execution success rate is expected to be 99%. Then the loss C loss = W4*C chip +W5*C block , assuming that the influence of the post weight W1…W n = 1 is not considered, and the scheme does not break any filtering conditions, then:
[0146] C loss = 0
[0147] C free = 1000 * (7 * 24) * W free
[0148] C" = (168000 W free ) * Filter (rule)
[0149]
[0150] Example 2, taking SPOT capability as an example, a certain candidate resource deployment scheme needs a total of 1000 vCPU, starts scheduling after 7 days, SPOT capability produces 1000 vCPU, there is a 5% risk in the processing process, the total processing time is 1 minute, and the success rate of execution is expected to be 99%. Then the loss C loss = W4 * C chip + W5 * C block , assuming that the influence of the post weight W1 … W n = 1 is not considered, and the scheme does not break any filtering conditions, then:
[0151] C loss = 1000 * (1 / 60) * W free = 17W free
[0152] C free = 1000 * (7 * 24 - 1 / 60) * W free = 167983W free
[0153]
[0154] C" = 176500W free
[0155]
[0156] It should be noted that the confidence of any Provider can be calculated according to the actual resource consumption information of any candidate resource deployment scheme and the resource information to be deployed in any candidate resource deployment scheme. The weight information required for calculating the resource loss cost information corresponding to any Provider is adjusted according to the confidence.
[0157] After obtaining the target resource solution that can be delivered for execution, different scenarios may require different resource delivery methods and delivery processes. In the corresponding policy scenario, the specified execution topology method is declared, and the target resource solution can be submitted into the general topology process for execution according to the execution topology method corresponding to the target resource solution. For example Figure 2cas shown.
[0158] The execution process includes several stages:
[0159] • Provider execution, calling the Provider processing execution interface;
[0160] • Resource delivery, delivering the reserved resources according to the delivery mode configured by the scene;
[0161] • Custom callback, executing the custom processing completion callback according to the callback function configured by the scene, to facilitate the remaining system to perceive the resource processing situation;
[0162] • Global state update, target resource solution lifecycle maintenance and sorting.
[0163] Dynamic priority:
[0164] The resource solution corresponding to the target candidate resource deployment scheme is added to the ready queue to wait for scheduling. In this embodiment, each resource solution in the ready queue can be referred to as a task, and in the execution process, the waiting time of each task in the ready queue is monitored, and when the waiting time exceeds the waiting time threshold, the priority of the task is increased. The waiting time threshold is dynamically determined according to the priority of the task. Among them, the higher the priority, the smaller the waiting time threshold.
[0165] For example, assuming that the priority p ranges from 1 to 99. The priority 1 is the highest, and when the priority is equal to 1, the demand will directly trigger execution when it arrives; when the priority is equal to -1, the task is not actually scheduled. The rest of the priority level will determine how long the task will be executed after starting, and the maximum execution time is x minutes (min), and the value of x can be determined by the following formula, but is not limited to the following formula:
[0166] x = ceil(p / 10)*10k
[0167] That is, if the priority is 26 and k is a constant, the task will be scheduled at the latest 30k minutes. Therefore, the pre-evaluation scheme resources of the task with a priority greater than 1 will be preempted, and the actual execution scheme may not be consistent.
[0168]
[0169] It should be noted that, as Figure 2b shown, the demand time h need = h delay + h loss + h waste Finally, in order to ensure that tasks with low priority are not always suspended, according to the latest execution scene, h waste ≈ 0, then h need - hloss >h delay Therefore, if we consider the scenario where all tasks can be scheduled, although the final priority requirement is not met, in order to ensure that each task is executed at least once, the final scheduling time can be determined using, but is not limited to, the following formula: Min(h delay ,h need -avg(h loss It should also be noted that tasks exceeding the maximum number of retries will be set to -1 and cannot be automatically scheduled; they can only be scheduled manually.
[0170] like Figure 2d As shown, in actual execution, it can be stipulated that the priority of a task in the ready queue increases at a rate of 'a' per hour as its waiting time increases. For example, if a task's initial priority is 80, but it has not been scheduled after 1 hour, its priority can be increased to 20.
[0171] For tasks with the same maximum execution time of x min, the sorting will be based on the key information within the task to aggregate the requirements. For tasks with key information, the task with the smallest sum of scores among all providers will be prioritized to minimize cost loss. For tasks with the same priority and the same aggregated parameters, the First Come First Service (FCFS) algorithm will be used for processing.
[0172] Implement a downgrade mechanism:
[0173] If the execution node corresponding to the scheduled Provider fails, the additional resource amount n is calculated based on the success rate p1 of the failed Provider and the success rate p2 of the next Provider. buffer ; and when scheduling the next Provider, control the execution node corresponding to the next Provider to reserve resources according to at least part of the resource information and additional resource amount provided by the next Provider.
[0174] For a success rate of p1, the supply and demand of n providers can be supplemented with additional measures to prevent delivery failures caused by solution failures. For other providers with surplus resources, additional resources are provided to mitigate the impact of failures. The success rate of these additional providers is p2, and the amount of additional resources is n. buffer The following formulas can be used, but are not limited to:
[0175] n buffer =n(1-p1) / p2
[0176] The above process can be summarized as follows:Figure 2e As shown, the method comprises the following operations:
[0177] 1. First, the system has a corresponding demand management module, which needs to receive and manage cloud product demand information, including standardized cloud product demand information and some project-based non-standardized cloud product demand information.
[0178] 2. The non-standardized cloud product demand information is converted to obtain standardized cloud product demand information.
[0179] 3. The standardized cloud product demand information is subjected to resource arrangement and resource consumption cost information evaluation mentioned above to output corresponding resource solutions, and finally select an executable target resource solution.
[0180] 4. If the target resource solution does not meet the cloud product demand information, step 3 can be repeated until the cloud product demand information is met.
[0181] 5. After obtaining the target resource solution that meets the cloud product demand information, the target resource solution is sorted and executed according to the priority of the target resource solution.
[0182] 6. Before execution, the target resource solution can be evaluated again, and based on the new evaluation result, it is determined whether to finally execute the target resource solution.
[0183] 7. In the case of determining to execute the target resource solution, the actual execution link is entered, and finally the required cloud product is output.
[0184] The scheme provided by the embodiment of the application can not only quickly and automatically output resource solutions, but also improve the automatic production capability of cloud service providers to produce cloud products, optimize the use of underlying server resources of cloud service providers, so that the underlying server resources can play a greater efficiency and generate more profits.
[0185] In addition to the above system embodiment, the embodiment of the application also provides a cloud product data processing method, which can be applied to the above cloud product data processing system, but is not limited thereto. As shown, the method of the embodiment comprises: Figure 3a
[0186] 301a, obtain cloud product demand information, and parse the cloud product demand information into at least one candidate resource deployment scheme;
[0187] 302a, according to at least one resource supply capability provided by a cloud service provider, performing resource arrangement and resource consumption cost information estimation processing on the at least one candidate resource deployment scheme to obtain a target resource solution whose resource consumption cost information meets the requirements and its corresponding target resource deployment scheme.
[0188] 303a, performing a resource processing task in the available zone corresponding to the target resource deployment solution according to the target resource solution, to obtain a cloud product corresponding to the cloud product demand information.
[0189] In the following description of the present embodiment, at least one resource supply capability is denoted as N resource supply capabilities, and at least one candidate resource deployment solution is denoted as K candidate resource deployment solutions, where N and K are positive integers. In the present embodiment, the target resource solution includes at least one resource supply capability and at least part of the resource information provided by the resource supply capability.
[0190] In an optional embodiment, the cloud product demand information includes standardized cloud product demand information and / or non-standardized cloud product demand information. Accordingly, the above-mentioned parsing of the cloud product demand information into K candidate resource deployment solutions includes: converting the non-standardized cloud product demand information into standardized cloud product demand information, where the standardized cloud product demand information refers to cloud product demand information with clear resource requirements; and generating K candidate resource deployment solutions according to the clear resource requirements corresponding to the standardized cloud product demand information.
[0191] In an optional embodiment, the above-mentioned generation of K candidate resource deployment solutions according to the clear resource requirements corresponding to the standardized cloud product demand information includes: determining X1 resource information and Y1 available zone information according to the clear resource requirements corresponding to the standardized cloud product demand information; and generating K candidate resource deployment solutions according to the X1 resource information and the Y1 available zone information, where X1 and Y1 are positive integers.
[0192] In an optional embodiment, the above-mentioned generation of K candidate resource deployment solutions according to the X1 resource information and the Y1 available zone information includes: filtering the X1 resource information and the Y1 available zone information to obtain X2 resource information and Y2 available zone information, where X2 and Y2 are positive integers, and X2≤X1 and Y2≤Y1; combining the X2 resource information and the Y2 available zone information to obtain P candidate resource deployment solutions, where P is a positive integer, and P≥K; and filtering the P candidate resource deployment solutions based on M resource supply capabilities and / or resource capability information of available zones to obtain K candidate resource deployment solutions, where M is a positive integer, and M≤N.
[0193] In an optional embodiment, each candidate resource deployment scheme includes at least resource information to be deployed and available zone information to be deployed, and the above-mentioned estimation of resource arrangement and resource consumption cost information of the K candidate resource deployment schemes according to the N resource supply capabilities provided by the cloud service provider to obtain a target resource solution and its corresponding target resource deployment scheme whose resource consumption cost information meets the requirements, includes: for any candidate resource deployment scheme, according to the resource information to be deployed and the available zone information to be deployed in the any candidate resource deployment scheme, estimating the unit resource consumption cost information when the N resource supply capabilities respectively provide the required resources for the any candidate resource deployment scheme; according to the unit resource consumption cost information when the N resource supply capabilities respectively provide the required resources for the any candidate resource deployment scheme and the resource information to be deployed in the any candidate resource deployment scheme, generating the resource solution corresponding to the any candidate resource deployment scheme and its resource consumption cost information; according to the resource consumption cost information of the resource solution corresponding to each of the K candidate resource deployment schemes, selecting a target resource deployment scheme and its corresponding target resource solution whose resource consumption cost information meets the requirements.
[0194] In an optional embodiment, the above-mentioned estimation of the unit resource consumption cost information when the N resource supply capabilities respectively provide the required resources for the any candidate resource deployment scheme according to the resource information to be deployed and the available zone information to be deployed in the any candidate resource deployment scheme, includes: for any resource supply capability, obtaining target resource information and target time information consumed when the any resource supply capability provides the required resources for the any candidate resource deployment scheme; according to the target resource information and the target time information, generating target resource consumption cost information when the any resource supply capability provides the required resources for the any candidate resource deployment scheme; according to the target resource consumption cost information and the resource information to be deployed in the any candidate resource deployment scheme, calculating the unit resource consumption cost information when the any resource supply capability provides the required resources for the any candidate resource deployment scheme.
[0195] In an optional embodiment, the target resource information and the target time information consumed by the any one resource supply capability in providing required resources for the any one candidate resource deployment scheme include: determining a resource waiting time length of the any one resource supply capability according to a scheduling processing start time of the any one candidate resource deployment scheme, a resource processing time length of the any one resource supply capability, and a resource use start time in the any one candidate resource deployment scheme, wherein the target time information includes the resource processing time length and the resource waiting time length; and obtaining effective resource information and resource fragment information occupied by the any one resource supply capability in providing required resources for the any one candidate resource deployment scheme according to resource information to be deployed in the any one candidate resource deployment scheme, wherein the target resource information includes the effective resource information and the resource fragment information.
[0196] In an optional embodiment, the method further includes: obtaining at least one of a risk probability, an additional resource proportion for guaranteeing a satisfaction rate, and / or a filtering condition corresponding to the any one resource supply capability in providing required resources for the any one candidate resource deployment scheme. Accordingly, generating the target resource consumption cost information of the any one resource supply capability in providing required resources for the any one candidate resource deployment scheme according to the target resource information and the target time information includes: generating the target resource consumption cost information according to at least one of the risk probability, the additional resource proportion for guaranteeing the satisfaction rate, and / or the filtering condition, and the effective resource information, the resource fragment information, the resource processing time length, and the resource waiting time length.
[0197] In an optional embodiment, the risk probability corresponding to the any one resource supply capability in providing required resources for the any one candidate resource deployment scheme includes:
[0198] generating the risk probability according to influence information of the any one resource supply capability on other resource objects and / or other users in providing required resources for the any one candidate resource deployment scheme;
[0199] The first resource arrangement unit obtains the additional resource proportion for guaranteeing the satisfaction rate corresponding to the any one resource supply capability in providing required resources for the any one candidate resource deployment scheme, including:
[0200] generating an execution success rate of the any one resource supply capability in providing required resources for the any one candidate resource deployment scheme according to historical deployment data of an availability zone corresponding to availability zone information to be deployed in the any one candidate resource deployment scheme; and calculating the additional resource proportion for guaranteeing the satisfaction rate according to a user-expected satisfaction rate and the execution success rate.
[0201] In an optional embodiment, the method further comprises: generating resource processing cost information according to the effective resource information, the resource fragmentation information, and the resource processing time length; respectively modifying the resource processing cost information according to the risk probability and the additional resource proportion for guaranteeing the satisfaction rate, to obtain first intermediate state cost information and second intermediate state cost information; generating resource waiting cost information according to the resource information to be deployed in the any candidate resource deployment scheme and the resource waiting time length; and generating the target resource consumption cost information according to the first intermediate state cost information, the second intermediate state cost information, the resource waiting cost information, and the filtering condition.
[0202] In an optional embodiment, the method further comprises: performing weighted summation on the first intermediate state cost information, the second intermediate state cost information, and the resource waiting cost information, to obtain initial resource consumption cost information; in a case where the any resource supply capability satisfies the filtering condition, taking the initial resource consumption cost information as the target resource consumption cost information; and in a case where the any resource supply capability does not satisfy the filtering condition, taking preset resource consumption cost information as the target resource consumption cost information.
[0203] In an optional embodiment, the method further comprises: calculating a confidence degree of the any resource supply capability according to resource information actually consumed when the any resource supply capability provides required resources for the any candidate resource deployment scheme and resource information to be deployed in the any candidate resource deployment scheme; and adjusting weight information required for calculating the initial resource consumption cost information corresponding to the any resource supply capability according to the confidence degree.
[0204] In an optional embodiment, the method further includes: determining at least one resource supply capability and at least part of resource information provided by the at least one resource supply capability required to meet the resource information to be deployed in the any candidate resource deployment scheme as the resource solution corresponding to the any candidate resource deployment scheme according to the resource information to be deployed in the any candidate resource deployment scheme and the upper limit resource information provided by each of the N resource supply capabilities; and generating the resource consumption cost information of the resource solution corresponding to the any candidate resource deployment scheme according to the unit resource consumption cost information corresponding to the at least one resource supply capability and the at least part of resource information provided by the at least one resource supply capability.
[0205] In an optional embodiment, the method further includes: adding the target resource solution to a ready queue to wait for scheduling, and scheduling each resource solution in the ready queue according to the priority of the target resource solution, wherein the priority of the target resource solution is determined according to the resource scenario to which the cloud product demand information belongs; and when the target resource solution is scheduled, performing a resource processing task in an availability zone corresponding to the availability zone information to be deployed in the target resource deployment scheme according to the target resource solution to obtain the cloud product corresponding to the cloud product demand information.
[0206] In an optional embodiment, the method further includes: monitoring the waiting time of each resource solution in the ready queue, and increasing the priority of a first resource solution when it is monitored that the waiting time of the first resource solution exceeds a corresponding waiting time threshold; and the waiting time threshold is determined according to the priority of the first resource solution before adjustment.
[0207] In an optional embodiment, the method further comprises: in a case that the resource reservation performed by the dispatched resource supply capability fails, calculating an additional resource amount according to the execution success rate of the failed resource supply capability and the execution success rate of a next resource supply capability; and controlling the next resource supply capability to perform resource reservation according to at least part of the resource information responsible for being provided by the next resource supply capability and the additional resource amount when the next resource supply capability is dispatched.
[0208] In an optional embodiment, the method further comprises: in a case that the resource reservation performed by the dispatched resource supply capability fails, calculating an additional resource amount according to the execution success rate of the failed resource supply capability and the execution success rate of a next resource supply capability; and controlling the next resource supply capability to perform resource reservation according to at least part of the resource information responsible for being provided by the next resource supply capability and the additional resource amount when the next resource supply capability is dispatched.
[0209] Figure 3b Another flowchart of a cloud product data processing method is provided in the embodiments of the present application. As shown in FIG. 6, the method comprises: Figure 3b
[0210] 301b, obtaining a candidate resource deployment scheme and at least one resource supply capability, wherein the candidate resource deployment scheme at least comprises to-be-deployed resource information and to-be-deployed availability zone information;
[0211] 302b, estimating unit resource consumption cost information of the at least one resource supply capability when the at least one resource supply capability respectively provides required resources for any candidate resource deployment scheme according to the at least one resource supply capability;
[0212] 303b, generating a resource solution corresponding to the resource deployment scheme and resource consumption cost information of the resource solution according to the unit resource consumption cost information of the at least one resource supply capability and the to-be-deployed resource information.
[0213] In the following description of the present embodiment, the at least one resource supply capability can also be denoted as N resource supply capabilities. The candidate resource deployment scheme in the present embodiment can be any candidate resource deployment scheme in the above-described embodiments. The related explanations of the resource deployment scheme and the resource solution and the detailed implementation manners of the steps in the present embodiment can be referred to the foregoing embodiments, and will not be described herein again.
[0214] The detailed implementation methods and beneficial effects of each step in this embodiment have been described in detail in the foregoing embodiments, and will not be elaborated here.
[0215] It should be noted that some processes described in the above embodiments and accompanying drawings include multiple operations appearing in a specific order. However, it should be clearly understood that these operations may not be executed in the order they appear in this document, or they may be executed in parallel. The operation numbers, such as 301a, 302a, etc., are merely used to distinguish different operations and do not represent any execution order. Furthermore, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel. It should also be noted that the descriptions such as "first" and "second" in this document are used to distinguish different messages, devices, modules, etc., and do not represent a sequential order, nor do they limit "first" and "second" to different types.
[0216] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 4 As shown, the electronic device includes a memory 41 and a processor 42.
[0217] Memory 41 is used to store computer programs and can be configured to store various other data to support operation on the electronic device. Examples of this data include instructions for any application or method used to operate on the electronic device, contact data, phone book data, messages, pictures, videos, etc.
[0218] The processor 42, coupled to the memory 41, is used to execute the computer program in the memory 41 to implement the steps of the cloud product data processing method provided in the embodiments of this application. Detailed descriptions of the steps in the cloud product data processing method can be found in the foregoing embodiments and will not be repeated here.
[0219] Furthermore, such as Figure 4 As shown, the computing platform also includes other components such as a communication component 43, a display 44, a power supply component 45, and an audio component 46. Figure 4 The diagram only shows some components and does not mean that the electronic device includes only these components. Figure 4 The components shown. Additionally... Figure 4 The components within the dashed box are optional, not mandatory, and their specific requirements depend on the product form of the electronic device. The electronic device in this embodiment can be a terminal device such as a desktop computer, laptop computer, smartphone, or IoT device, or a server-side device such as a conventional server, cloud server, or server array. If the electronic device in this embodiment is a terminal device such as a desktop computer, laptop computer, or smartphone, it may include... Figure 4The components within the dashed-dotted line frame; if the electronic device of the embodiment is implemented as a server device such as a general server, a cloud server or a server array, the components within the dashed-dotted line frame can not be included Figure 4 The components within the dashed-dotted line frame.
[0220] Correspondingly, the embodiment of the present application also provides a computer readable storage medium storing a computer program, when the computer program is executed by a processor, the processor can implement each step in the above method embodiment.
[0221] The above-mentioned memory can be implemented by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.
[0222] The above-mentioned communication component is configured to facilitate wired or wireless communication between the device where the communication component is located and other devices. The device where the communication component is located can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G / LTE, 5G or other mobile communication network, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra wide band (UWB) technology, Blue Tooth (BT) technology and other technologies.
[0223] The display includes a screen, which can include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touch or a slide action, but also detect a duration and intensity of the touch or slide action.
[0224] The power component provides power to various components of the device in which the power component is located. The power component can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device in which the power component is located.
[0225] The audio component can be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC) that is configured to receive an external audio signal when the device in which the audio component is located is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in a memory or transmitted via the communication component. In some embodiments, the audio component also includes a speaker for outputting audio signals.
[0226] Those skilled in the art will understand that embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application can take the form of a computer program product embodied in one or more computer readable storage media (including, but not limited to, disk memory, Compact Disc Read-Only Memory (CD-ROM), optical memory, etc.) having computer usable program code embodied therein.
[0227] The present application is described with reference to the flowchart illustrations and / or block diagrams of the methods, apparatus (systems) and computer program products according to embodiments of the present application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, an embedded processor or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart illustrations and / or block diagrams block or blocks.
[0228] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart or flowsheets and / or block or blocks of the block diagrams.
[0229] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart or flowsheets and / or block or blocks of the block diagrams.
[0230] In one typical configuration, the computing device includes one or more processors (Central Processing Unit(s) (CPU(s)), input / output interfaces, network interfaces, and memory.
[0231] The memory can include non-persistent memory and / or volatile memory, such as random access memory (RAM) for example, and / or non-volatile memory, such as read-only memory (ROM), EPROM, and / or a flash memory, for example. The memory is an example of computer readable media.
[0232] Computer readable media includes permanent and non-permanent, moveable and non- moveable media that can be implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital video disc (DVR) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that is accessible to a computing device. According to the definition provided herein, computer readable media does not include transitory media, such as modulated data signals and carrier waves.
[0233] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart or flowsheets and / or block or blocks of the block diagrams.
[0229] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart or flowsheets and / or block or blocks of the block diagrams.
[0230] In one typical configuration, the computing device includes one or more processors (Central Processing Unit(s) (CPU(s)), input / output interfaces, network interfaces, and memory.
[0231] The memory can include non-persistent memory and / or volatile memory, such as random access memory (RAM) for example, and / or non-volatile memory, such as read-only memory (ROM), EPROM, and / or a flash memory, for example. The memory is an example of computer readable media.
[0232] Computer readable media includes permanent and non-permanent, moveable and non- moveable media that can be implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital video disc (DVR) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that is accessible to a computing device. According to the definition provided herein, computer readable media does not include transitory media, such as modulated data signals and carrier waves.
[0233] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart or flowsheets and / or block or blocks of the block diagrams.
[0229] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart or flowsheets and / or block or blocks of the block diagrams.
[0230] In one typical configuration, the computing device includes one or more processors (Central Processing Unit(s) (CPU(s)), input / output interfaces, network interfaces, and memory.
[0231] The memory can include non-persistent memory and / or volatile memory, such as random access memory (RAM) for example, and / or non-volatile memory, such as read-only memory (ROM), EPROM, and / or a flash memory, for example. The memory is an example of computer readable media.
[0232] Computer readable media includes permanent and non-permanent, moveable and non- moveable media that can be implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital video disc (DVR) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that is accessible to a computing device. According to the definition provided herein, computer readable media does not include transitory media, such as modulated data signals and carrier waves.
[0233]
[0234] It should also be noted that the terms "comprising," "including," or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises a... " does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.
[0235] The above embodiments of the present application are only used to illustrate the technical solutions of the present application and not intended to limit the present application. Although the present application is illustrated in detail, those skilled in the art should understand that the present application can make various modifications and changes without departing from the spirit and scope of the present application. Any modification, equivalent replacement, improvement, and the like made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims
1. A cloud product data processing system, characterized by, The method comprises the following steps: a demand management module is configured to obtain cloud product demand information, and parse the cloud product demand information into at least one candidate resource deployment scheme; a resource orchestration module is configured to obtain resource solution schemes corresponding to the at least one candidate resource deployment scheme and resource consumption cost information of the resource solution schemes by performing resource orchestration and resource consumption cost information estimation processing on the at least one candidate resource deployment scheme according to at least one resource supply capability provided by a cloud service provider, so as to obtain a target resource solution scheme and a target resource deployment scheme corresponding to the target resource solution scheme, wherein the resource supply capability is the capability of obtaining idle resources, and each resource supply capability in the resource solution scheme of the candidate resource deployment scheme is responsible for providing at least part of resource information to be deployed in the candidate resource deployment scheme; an execution delivery module is configured to perform a resource processing task in an available zone corresponding to the target resource deployment scheme according to the target resource solution scheme, so as to obtain a cloud product corresponding to the cloud product demand information.
2. The system of claim 1, wherein, The demand management module comprises: a demand entry unit is configured to receive standardized cloud product demand information and / or non-standardized cloud product demand information; a demand conversion unit is configured to convert the non-standardized cloud product demand information into standardized cloud product demand information, wherein the standardized cloud product demand information refers to cloud product demand information with clear resource demand; a demand analysis unit is configured to generate at least one candidate resource deployment scheme according to clear resource demand corresponding to the standardized cloud product demand information.
3. The system of claim 1 or 2, wherein, The candidate resource deployment scheme at least comprises to-be-deployed resource information and to-be-deployed available zone information, and the resource orchestration module is specifically configured to: a first resource orchestration unit is configured to estimate unit resource consumption cost information when at least one resource supply capability provides required resources for any candidate resource deployment scheme according to to-be-deployed resource information and to-be-deployed available zone information in the any candidate resource deployment scheme; a second resource orchestration unit is configured to generate resource solution schemes corresponding to any candidate resource deployment scheme and resource consumption cost information of the resource solution schemes according to unit resource consumption cost information when at least one resource supply capability provides required resources for the any candidate resource deployment scheme and to-be-deployed resource information in the any candidate resource deployment scheme; a scheme selection unit is configured to select a target resource deployment scheme and a target resource solution scheme corresponding to the target resource deployment scheme according to resource consumption cost information of resource solution schemes corresponding to the at least one candidate resource deployment scheme.
4. The system of claim 3, wherein, The first resource orchestration unit is specifically configured to: obtain target resource information and target time information consumed when any resource supply capability provides required resources for any candidate resource deployment scheme. According to the target resource information and the target time information, target resource consumption cost information is generated when the any one resource supply capability provides required resources for the any one candidate resource deployment scheme; According to the target resource consumption cost information and the resource information to be deployed in the any one candidate resource deployment scheme, unit resource consumption cost information is calculated when the any one resource supply capability provides required resources for the any one candidate resource deployment scheme.
5. The system of claim 3, wherein, The second resource arrangement unit is specifically configured to: According to the resource information to be deployed in the any one candidate resource deployment scheme and the upper limit resource information that can be provided by the at least one resource supply capability, at least one resource supply capability required to meet the resource information to be deployed in the any one candidate resource deployment scheme and at least part of the resource information provided by the at least one resource supply capability are determined as a resource solution corresponding to the any one candidate resource deployment scheme; According to the unit resource consumption cost information corresponding to the at least one resource supply capability and the at least part of the resource information provided by the at least one resource supply capability, resource consumption cost information of the resource solution corresponding to the any one candidate resource deployment scheme is generated.
6. A cloud product data processing method, characterized by, It comprises: The cloud product demand information is parsed into at least one candidate resource deployment scheme; According to the at least one resource supply capability provided by the cloud service provider, the at least one candidate resource deployment scheme is arranged and the resource consumption cost information is estimated to obtain the resource solution corresponding to the at least one candidate resource deployment scheme and the resource consumption cost information thereof, so as to obtain a target resource solution and a target resource deployment scheme corresponding to the target resource solution, the resource supply capability is the ability to obtain idle resources, and the resource solution of the candidate resource deployment scheme comprises at least one resource supply capability, each of which is responsible for providing at least part of the resource information to be deployed in the candidate resource deployment scheme; According to the target resource solution, a resource processing task is performed in the available area corresponding to the target resource deployment scheme to obtain a cloud product corresponding to the cloud product demand information.
7. The method of claim 6, wherein, The cloud product demand information comprises standardized cloud product demand information and / or non-standardized cloud product demand information; The cloud product demand information is parsed into at least one candidate resource deployment scheme, which comprises: The non-standardized cloud product demand information is converted into standardized cloud product demand information, and the standardized cloud product demand information refers to cloud product demand information with clear resource demand; According to the clear resource demand corresponding to the standardized cloud product demand information, at least one candidate resource deployment scheme is generated.
8. The method of claim 6, wherein, The candidate resource deployment scheme comprises at least resource information to be deployed and available area information to be deployed, and the at least one candidate resource deployment scheme is arranged and the resource consumption cost information is estimated according to the at least one resource supply capability provided by the cloud service provider, so as to obtain a target resource solution and a target resource deployment scheme corresponding to the target resource solution, which comprises: According to the resource information to be deployed and the available zone information to be deployed in any candidate resource deployment scheme, estimating unit resource consumption cost information when at least one resource supply capability provides required resources for the any candidate resource deployment scheme; According to the unit resource consumption cost information when at least one resource supply capability provides required resources for the any candidate resource deployment scheme and the resource information to be deployed in the any candidate resource deployment scheme, generating a resource solution corresponding to the any candidate resource deployment scheme and resource consumption cost information thereof; According to the resource consumption cost information of the resource solution corresponding to each of the at least one candidate resource deployment scheme, selecting a target resource deployment scheme and a target resource solution corresponding thereto whose resource consumption cost information meets requirements.
9. The method of claim 8, wherein, According to the resource information to be deployed and the available zone information to be deployed in any candidate resource deployment scheme, estimating unit resource consumption cost information when at least one resource supply capability provides required resources for the any candidate resource deployment scheme, including: For any resource supply capability, obtaining target resource information and target time information consumed when the any resource supply capability provides required resources for the any candidate resource deployment scheme; According to the target resource information and target time information, generating target resource consumption cost information when the any resource supply capability provides required resources for the any candidate resource deployment scheme; According to the target resource consumption cost information and the resource information to be deployed in the any candidate resource deployment scheme, calculating unit resource consumption cost information when the any resource supply capability provides required resources for the any candidate resource deployment scheme.
10. The method of claim 9, wherein, Obtaining target resource information and target time information consumed when the any resource supply capability provides required resources for the any candidate resource deployment scheme, including: According to a scheduling processing start time of the any candidate resource deployment scheme, a resource processing duration of the any resource supply capability, and a resource use start time in the any candidate resource deployment scheme, determining a resource waiting duration of the any resource supply capability, and the target time information includes the resource processing duration and the resource waiting duration; According to the resource information to be deployed in the any candidate resource deployment scheme, obtaining effective resource information occupied and resource fragment information generated when the any resource supply capability provides required resources for the any candidate resource deployment scheme, and the target resource information includes the effective resource information and the resource fragment information.
11. The method of claim 10, wherein, Further comprising: Obtaining at least one of a corresponding risk probability, an additional resource proportion for guaranteeing a satisfaction rate, and / or a filtering condition when the any resource supply capability provides required resources for the any candidate resource deployment scheme; Correspondingly, according to the target resource information and target time information, generating target resource consumption cost information when the any resource supply capability provides required resources for the any candidate resource deployment scheme, including: According to the risk probability, the additional resource proportion for guaranteeing the satisfaction rate, and / or the filtering condition, and the effective resource information, the resource fragmentation information, the resource processing time length, and the resource waiting time length, the target resource loss cost information is generated.
12. The method of claim 11, wherein, According to the risk probability, the additional resource proportion for guaranteeing the satisfaction rate, and the filtering condition, and the effective resource information, the resource fragmentation information, the resource processing time length, and the resource waiting time length, the target resource loss cost information is generated, including: According to the effective resource information, the resource fragmentation information, and the resource processing time length, resource processing cost information is generated. According to the risk probability and the additional resource proportion for guaranteeing the satisfaction rate, the resource processing cost information is respectively modified to obtain first intermediate state cost information and second intermediate state cost information. According to the resource information to be deployed in the any candidate resource deployment scheme and the resource waiting time length, resource waiting cost information is generated. According to the first intermediate state cost information, the second intermediate state cost information, the resource waiting cost information, and the filtering condition, the target resource loss cost information is generated.
13. The method of claim 12, wherein, According to the first intermediate state cost information, the second intermediate state cost information, the resource waiting cost information, and the filtering condition, the target resource loss cost information is generated, including: The first intermediate state cost information, the second intermediate state cost information, and the resource waiting cost information are weighted and summed to obtain initial resource loss cost information. In the case that the any resource supply capability meets the filtering condition, the initial resource loss cost information is taken as the target resource loss cost information. In the case that the any resource supply capability does not meet the filtering condition, preset resource loss cost information is taken as the target resource loss cost information.
14. The method according to any one of claims 8-13, characterized in that, According to the unit resource loss cost information when at least one resource supply capability respectively provides required resources for the any candidate resource deployment scheme and the resource information to be deployed in the any candidate resource deployment scheme, the resource solution corresponding to the any candidate resource deployment scheme and the resource loss cost information thereof are generated, including: According to the resource information to be deployed in the any candidate resource deployment scheme and the upper limit resource information that can be respectively provided by the at least one resource supply capability, at least one resource supply capability required to meet the resource information to be deployed in the any candidate resource deployment scheme and at least part of the resource information responsible for providing thereof are determined as the resource solution corresponding to the any candidate resource deployment scheme; According to the unit resource loss cost information corresponding to the at least one resource supply capability and the at least part of the resource information responsible for providing thereof, the resource loss cost information of the resource solution corresponding to the any candidate resource deployment scheme is generated.
15. The method according to any one of claims 6-13, characterized in that, According to the resource loss cost information of the resource solution corresponding to the at least one candidate resource deployment scheme, a target resource deployment scheme and the target resource solution corresponding thereto whose resource loss cost information meets the requirement are selected, including: add the target resource solution to a ready queue to wait for scheduling, and schedule each resource solution in the ready queue according to a priority of the target resource solution, the priority of the target resource solution being determined according to a resource scenario to which the cloud product demand information belongs; when the target resource solution is scheduled, perform a resource processing task in an available zone corresponding to the to-be-deployed available zone information in the target resource deployment solution according to the target resource solution, to obtain a cloud product corresponding to the cloud product demand information.
16. The method of claim 15, wherein, Further comprising at least one of the following operations: monitor a waiting time length of each resource solution in the ready queue, and when a first resource solution whose waiting time length exceeds a corresponding waiting time length threshold is monitored, increase a priority of the first resource solution; the waiting time length threshold is determined according to a priority of the first resource solution before adjustment; when resource reservation fails in a resource supply capability to which the target resource solution is scheduled, calculate an additional resource amount according to an execution success rate of the resource supply capability that fails to execute and an execution success rate of a next resource supply capability; when the next resource supply capability is scheduled, control the next resource supply capability to perform resource reservation according to at least part of resource information that the next resource supply capability is responsible for providing and the additional resource amount.
17. A cloud product data processing method, characterized by, comprise: obtain a candidate resource deployment solution and at least one resource supply capability, the candidate resource deployment solution comprising at least to-be-deployed resource information and to-be-deployed available zone information, and the resource supply capability being a capability of obtaining idle resources; estimate unit resource consumption cost information of the at least one resource supply capability when the at least one resource supply capability respectively provides required resources for any candidate resource deployment solution according to the at least one resource supply capability; generate resource solution and resource consumption cost information of the resource deployment solution corresponding to the at least one resource supply capability according to the unit resource consumption cost information corresponding to the at least one resource supply capability and the to-be-deployed resource information, the resource solution of the candidate resource deployment solution comprising the at least one resource supply capability, and each resource supply capability in the at least one resource supply capability being responsible for providing at least part of the to-be-deployed resource information in the candidate resource deployment solution.
18. An electronic device, comprising: comprise: a memory and a processor; the memory is configured to store a computer program, and the processor is coupled to the memory and configured to execute the computer program to perform the steps in the method of any one of claims 6-17.
19. A computer readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, the processor is enabled to perform the steps in the method of any one of claims 6-17.
Citation Information
Patent Citations
Resource allocation method and device and resource allocation system
CN108337109A
Cloud product architecture management method and device, electronic equipment and storage medium
CN116302654A