Resource scheduling method and system based on cloud computing
By building a resource prediction model and distributed scheduling architecture in cloud computing, analyzing task priorities and dependencies, the single point of failure problem of cloud computing resource scheduling is solved, and efficient and stable resource allocation and scheduling effects are achieved.
Patent Information
- Application Number
- CN202411303524.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-19
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-09-19
AI Technical Summary
There is a single point of failure risk in cloud computing resource scheduling, resulting in poor resource scheduling results and it is difficult to achieve efficient and stable resource allocation.
Adopt cloud computing-based resource prediction model and distributed scheduling architecture, build resource prediction model by obtaining resource usage requirements and state, analyzing task priorities and dependencies, building resource scheduling strategies, and through distributed scheduling architecture and redundant nodes The communication protocol stack implements resource scheduling.
It improves the timeliness and efficiency of resource allocation, reduces resource waste, enhances the security and stability of resource scheduling, and achieves efficient resource scheduling effects.
Smart Images

Figure CN118819870B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of resource management, and in particular to a method and system for implementing resource scheduling based on cloud computing. Background Art
[0002] Resource scheduling refers to the process of effectively allocating and managing computing resources in a computing environment according to predetermined strategies and algorithms. These computing resources include but are not limited to processor (CPU) time, memory, storage space, network bandwidth, etc. The goal of resource scheduling is to optimize resource utilization, improve system performance, reduce operating costs, and ensure that each task and service can meet the established service quality requirements.
[0003] At present, resource scheduling in cloud computing mainly refers to scheduling by collecting user needs and resource status and using resource scheduling algorithms. This method usually adopts centralized resource scheduling, which may lead to single point failures. Once problems occur in the scheduling system, it may affect the stability of the entire cloud computing environment, thereby resulting in poor resource scheduling effects in cloud computing. Summary of the invention
[0004] The present invention provides a method and system for implementing resource scheduling based on cloud computing, the main purpose of which is to improve the scheduling effect of implementing resource scheduling based on cloud computing.
[0005] To achieve the above object, the present invention provides a method for resource scheduling based on cloud computing, comprising:
[0006] Obtain resource usage requirements of resource users for resources to be scheduled, collect resource usage data of the resources to be scheduled, and construct a resource prediction model for the resources to be scheduled based on the resource usage data;
[0007] Acquire the resource status of the resource to be scheduled, predict the resource to-be-used status of the resource to be scheduled using the resource prediction model based on the resource status, and analyze the to-be-scheduled tasks of the resource to be scheduled based on the resource to-be-scheduled status;
[0008] Analyze the resource constraints of the resources to be scheduled, analyze the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements, and construct a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies;
[0009] Constructing a distributed scheduling architecture for the resources to be scheduled, and establishing redundant task nodes corresponding to the task nodes in the distributed scheduling architecture;
[0010] Construct a communication protocol stack of the task node and the redundant task node, distribute the resource scheduling strategy to the task node, obtain a resource scheduling task node, and perform resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol.
[0011] Optionally, constructing a resource prediction model for the resources to be scheduled based on the resource usage data includes:
[0012] Preprocessing the resource usage data to obtain preprocessed usage data;
[0013] Extracting data sequence features of the preprocessing usage data;
[0014] Performing feature conversion on the data sequence features to obtain conversion features;
[0015] Determining the model type of the resource to be scheduled;
[0016] A resource prediction model for the resources to be scheduled is constructed based on the conversion characteristics, the preprocessed usage data, and the model type.
[0017] Optionally, extracting data sequence features of the preprocessing usage data includes:
[0018] Serializing the preprocessed usage data to obtain sequence usage data;
[0019] Calculating data weights of the sequence usage data;
[0020] Analyzing local trends of the sequence usage data based on the data weights;
[0021] Based on the local trend, data sequence features of the sequence usage data are extracted.
[0022] Optionally, the calculating the data weight of the sequence usage data includes:
[0023] Selecting a bandwidth parameter for the sequence usage data;
[0024] Based on the bandwidth parameter, the data weight of the sequence usage data is calculated using the following formula:
[0025]
[0026] in, Indicates The sequence uses data and The data weights of the data used by each sequence, Indicates The sequence uses data, Indicates The sequence uses data, Indicates the bandwidth parameter.
[0027] Optionally, analyzing the to-be-scheduled tasks of the to-be-scheduled resources based on the to-be-used status of the resources includes:
[0028] Calculating a state difference of the resource to be scheduled based on the resource to be used state and a resource state corresponding to the resource to be scheduled;
[0029] Analyze the resource impact weight of the state difference on the resource usage demand corresponding to the resource to be scheduled;
[0030] Determining a strategy for eliminating the impact of the status difference based on the resource impact weight;
[0031] Based on the impact elimination strategy, the tasks to be scheduled of the resources to be scheduled are constructed.
[0032] Optionally, analyzing the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements includes:
[0033] Based on the resource usage requirement, identifying the priority factor of the task to be scheduled;
[0034] Analyze the impact relationship between the priority factor and the priority of the task to be scheduled;
[0035] Based on the priority influence relationship, calculating the task priority of the task to be scheduled;
[0036] Constructing a task dependency graph of the task to be scheduled;
[0037] Based on the task dependency graph, the task dependency relationships of the tasks to be scheduled are analyzed.
[0038] Optionally, the calculating the task priority of the task to be scheduled based on the priority influence relationship includes:
[0039] Based on the priority influence relationship, analyzing the priority factor weights of the priority factors corresponding to the tasks to be scheduled;
[0040] identifying a priority factor state value of the priority factor;
[0041] Based on the priority factor weight and the priority factor state value, the task priority of the task to be scheduled is calculated using the following formula:
[0042]
[0043] in, Indicates the task priority of the task to be scheduled. Indicates the task to be scheduled. The priority factor weights of the priority factors, Indicates the task to be scheduled. The priority factor status value of the priority factor, represents the adjustment factor, Indicates the number of priority factors corresponding to the tasks to be scheduled.
[0044] Optionally, the constructing a distributed scheduling architecture for the resources to be scheduled includes:
[0045] Analyzing the distributed demand of the resources to be scheduled;
[0046] Based on the distributed demand, determining the distributed components of the resources to be scheduled;
[0047] Constructing a distributed scheduling algorithm for the resources to be scheduled;
[0048] Based on the distributed components and the distributed scheduling algorithm, a distributed scheduling architecture for the resources to be scheduled is established.
[0049] Optionally, the constructing of the communication protocol stack of the task node and the redundant task node includes:
[0050] Defining communication requirements between the task node and the redundant task node;
[0051] Based on the communication requirements, determining the communication protocol of the task node and the redundant task node;
[0052] Designing a communication protocol architecture for the communication protocol;
[0053] Based on the communication protocol architecture, a communication protocol stack of the task node and the redundant task node is constructed.
[0054] In order to solve the above problems, the present invention also provides a resource scheduling system based on cloud computing, the system comprising:
[0055] A resource prediction model building module, used to obtain resource user's resource usage requirements for resources to be scheduled, collect resource usage data of the resources to be scheduled, and build a resource prediction model for the resources to be scheduled based on the resource usage data;
[0056] A to-be-scheduled task construction module is used to obtain the resource status of the to-be-scheduled resource, predict the resource to-be-scheduled state of the to-be-scheduled resource using the resource prediction model based on the resource status, and analyze the to-be-scheduled tasks of the to-be-scheduled resource based on the resource to-be-scheduled state;
[0057] A resource scheduling strategy building module, used to analyze the resource constraints of the resources to be scheduled, analyze the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements, and build a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies;
[0058] A distributed scheduling architecture building module, used to build a distributed scheduling architecture for the resources to be scheduled, and to establish redundant task nodes corresponding to the task nodes of the distributed scheduling architecture;
[0059] A resource scheduling module is used to construct a communication protocol stack for the task node and the redundant task node, distribute the resource scheduling strategy to the task node, obtain a resource scheduling task node, and perform resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol.
[0060] According to the embodiment of the present invention, based on the resource usage data, a resource prediction model of the resources to be scheduled is constructed to realize resource usage prediction, thereby improving the timeliness of resource allocation; according to the embodiment of the present invention, based on the resource status, the resource prediction model is used to predict the resource to be used status of the resources to be scheduled, thereby identifying the future usage of the resources to be scheduled, thereby improving the timeliness of resource allocation; according to the embodiment of the present invention, based on the resource usage demand, the task priority and task dependency of the tasks to be scheduled are analyzed to provide a basis for resource scheduling; further, according to the embodiment of the present invention, based on the resource constraints, the task priority and the task dependency, a resource scheduling strategy of the resources to be scheduled is constructed to improve the efficiency of task processing and reduce resource waste. Furthermore, according to the embodiment of the present invention, a distributed scheduling architecture of the resources to be scheduled is constructed to realize distributed processing of scheduling tasks, thereby improving the security of resource scheduling. Finally, according to the embodiment of the present invention, a communication protocol stack of the task node and the redundant task node is constructed to realize mutual communication of nodes, thereby improving the processing efficiency of tasks, and based on the resource scheduling task node, the redundant task node and the communication protocol, the resource scheduling of the resources to be scheduled is executed to realize efficient and stable scheduling of the resources to be scheduled. Therefore, the method and system for implementing resource scheduling based on cloud computing proposed in the present invention can improve the scheduling effect of implementing resource scheduling based on cloud computing. BRIEF DESCRIPTION OF THE DRAWINGS
[0061] Figure 1 A schematic diagram of a process for implementing a resource scheduling method based on cloud computing provided by an embodiment of the present invention;
[0062] Figure 2 A functional module diagram of a resource scheduling system based on cloud computing provided by an embodiment of the present invention;
[0063] Figure 3 A schematic diagram of the structure of an electronic device for implementing a resource scheduling system based on cloud computing provided by an embodiment of the present invention;
[0064] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0065] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0066] The embodiment of the present application provides a method for implementing resource scheduling based on cloud computing. The execution subject of the method for implementing resource scheduling based on cloud computing includes but is not limited to at least one of the electronic devices such as a server, a terminal, etc. that can be configured to execute the method provided by the embodiment of the present application. In other words, the method for implementing resource scheduling based on cloud computing can be executed by software or hardware installed on a terminal device or a server device, and the software can be a blockchain platform. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc. The server can be an independent server, or it can be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.
[0067] Reference Figure 1 FIG. 1 is a flow chart of a method for implementing resource scheduling based on cloud computing provided by an embodiment of the present invention. In this embodiment, the method for implementing resource scheduling based on cloud computing includes:
[0068] S1. Obtain resource usage requirements of resource users for resources to be scheduled, collect resource usage data of the resources to be scheduled, and construct a resource prediction model for the resources to be scheduled based on the resource usage data.
[0069] In an embodiment of the present invention, the resource usage demand refers to the demand of the resource user during the resource usage process, such as response time, availability, data security and other requirements, and the resource usage data refers to the record of resource usage in the past period of time in the cloud computing environment, including: CPU usage, memory usage, storage usage, network usage, virtual machine / container usage, application performance indicators, resource demand peak, resource allocation records and other data.
[0070] Optionally, in the embodiment of the present invention, based on the resource usage data, a resource prediction model of the resource to be scheduled is constructed to achieve resource usage prediction, thereby improving the timeliness of resource allocation. The resource prediction model refers to a model used to predict future resource usage.
[0071] Optionally, as an embodiment of the present invention, constructing the resource prediction model of the resources to be scheduled based on the resource usage data includes: preprocessing the resource usage data to obtain preprocessed usage data; extracting data series features of the preprocessed usage data; performing feature conversion on the data series features to obtain conversion features; determining the model type of the resources to be scheduled; and constructing the resource prediction model of the resources to be scheduled based on the conversion features, the preprocessed usage data and the model type.
[0072] Among them, the pre-processed usage data refers to the data set after the resource usage data has been cleaned, normalized, and missing value processed; the data series feature refers to the characteristic attribute of the pre-processed usage data that changes over time; the conversion feature refers to the feature after the data feature is converted, such as using logarithmic transformation to process the uneven distribution of data; the model type refers to the type of usage prediction model for the resources to be scheduled, such as linear regression, time series analysis, machine learning algorithm, etc.
[0073] Furthermore, in an optional embodiment of the present invention, the extracting of data sequence features of the pre-processed usage data includes: serializing the pre-processed usage data to obtain sequence usage data; calculating data weights of the sequence usage data; based on the data weights, analyzing local trends of the sequence usage data; and based on the local trends, extracting data sequence features of the sequence usage data.
[0074] Among them, the sequence usage data refers to the data set after the pre-processed usage data is arranged according to time, the data weight refers to the weight coefficient used for weighted regression, which determines the contribution of each data point to the regression result, and the local trend refers to the trend or direction shown by the data within a specific interval of the sequence.
[0075] Further, in an optional embodiment of the present invention, the calculating the data weight of the sequence usage data includes: selecting a bandwidth parameter of the sequence usage data; and calculating the data weight of the sequence usage data based on the bandwidth parameter using the following formula:
[0076]
[0077] in, Indicates The sequence uses data and The data weights of the data used by each sequence, Indicates The sequence uses data, Indicates The sequence uses data, Indicates the bandwidth parameter.
[0078] The bandwidth parameter refers to a "neighborhood" or "window" of the bandwidth parameter, which affects the smoothness and adaptability of the model.
[0079] S2. Obtain the resource status of the resource to be scheduled, and based on the resource status, use the resource prediction model to predict the resource to-be-scheduled state of the resource to be scheduled, and based on the resource to-be-scheduled state, analyze the to-be-scheduled tasks of the resource to be scheduled.
[0080] In the embodiment of the present invention, the resource status refers to the status of all physical and virtual resources, including CPU usage, memory usage, storage capacity, network bandwidth and other status.
[0081] Optionally, the embodiment of the present invention predicts the resource usage status of the resource to be scheduled based on the resource status using the resource prediction model to identify the future usage of the resource to be scheduled, thereby improving the timeliness of resource allocation. The resource usage status refers to the predicted state of future resource usage, such as the predicted CPU usage rate, memory usage, etc.
[0082] Furthermore, the embodiment of the present invention analyzes the to-be-scheduled tasks of the to-be-scheduled resources based on the to-be-scheduled status of the resources to be scheduled, and can clarify the scheduling tasks, providing a data basis for the subsequent scheduling strategy formulation. The to-be-scheduled tasks refer to tasks that require resource scheduling.
[0083] As an embodiment of the present invention, the analysis of the to-be-scheduled tasks of the to-be-scheduled resources based on the to-be-used status of the resources includes: calculating the state difference of the to-be-scheduled resources based on the to-be-used status of the resources and the resource status corresponding to the to-be-scheduled resources; analyzing the resource impact weight of the state difference on the resource usage demand corresponding to the to-be-scheduled resources; determining a strategy for eliminating the impact of the state difference based on the resource impact weight; and constructing the to-be-scheduled tasks of the to-be-scheduled resources based on the impact elimination strategy.
[0084] Among them, the state difference refers to the difference between the resource to be used state and the resource state corresponding to the to-be-scheduled resource. For example, the CPU utilization rate of the resource state is 50%, and the CPU utilization rate of the resource to be used state is 80%. The state difference is the 30% difference in CPU utilization rate. The resource impact weight refers to the degree of influence of the state difference on the resource usage demand. The impact elimination strategy refers to the strategy of how to reduce the influence of the state difference on the resource usage demand. For example, the state difference of CPU occupancy rate can be improved by clearing unnecessary usage programs.
[0085] S3. Analyze the resource constraints of the resources to be scheduled, analyze the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements, and construct a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies.
[0086] In the embodiment of the present invention, the resource constraint condition refers to the resource constraint condition that needs to be considered when designing a resource scheduling strategy. For example, some tasks may require a specific type or a specific amount of resources to execute; ensure that the designed strategy can meet these constraints to avoid resource conflicts and resource waste.
[0087] Optionally, the embodiment of the present invention analyzes the task priority and task dependency of the task to be scheduled based on the resource usage demand to provide a basis for resource scheduling. The task priority refers to the task priority of the task to be scheduled, and the task dependency refers to the relationship of resource competition or mutual influence between the tasks to be scheduled.
[0088] Optionally, as an embodiment of the present invention, analyzing the task priority and task dependency of the task to be scheduled based on the resource usage requirement includes: identifying the priority factor of the task to be scheduled based on the resource usage requirement; analyzing the influence relationship between the priority factor and the priority of the task to be scheduled; calculating the task priority of the task to be scheduled based on the priority influence relationship; constructing a task dependency graph for the task to be scheduled; and analyzing the task dependency of the task to be scheduled based on the task dependency graph.
[0089] Among them, the priority factor refers to the factors that affect the tasks to be scheduled, such as resource utilization, response time, task importance and urgency, task historical performance and other factors; the priority influence relationship refers to the influence relationship between the priority factor and the priority of the task to be scheduled; the task dependency graph refers to a graphical representation method for displaying the dependency relationship between tasks.
[0090] Further, in an optional embodiment of the present invention, the calculation of the task priority of the task to be scheduled based on the priority influence relationship includes: analyzing the priority factor weight of the priority factor corresponding to the task to be scheduled based on the priority influence relationship; identifying the priority factor state value of the priority factor; and calculating the task priority of the task to be scheduled based on the priority factor weight and the priority factor state value using the following formula:
[0091]
[0092] in, Indicates the task priority of the task to be scheduled. Indicates the task to be scheduled. The priority factor weights of the priority factors, Indicates the task to be scheduled. The priority factor status value of the priority factor, represents the adjustment factor, Indicates the number of priority factors corresponding to the tasks to be scheduled.
[0093] The priority factor weight refers to the degree of influence of the priority factor on the task priority, and the adjustment coefficient refers to a value dynamically adjusted according to the system status and other factors.
[0094] Furthermore, the embodiment of the present invention constructs a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies, which can improve the efficiency of task processing and reduce resource waste. The resource scheduling strategy refers to a strategy for scheduling resources.
[0095] Furthermore, as an embodiment of the present invention, the resource scheduling strategy for constructing the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies is mainly achieved by determining the task scheduling order and start time of the tasks to be scheduled corresponding to the resources to be scheduled.
[0096] S4. Construct a distributed scheduling architecture for the resources to be scheduled, and establish redundant task nodes corresponding to the task nodes in the distributed scheduling architecture.
[0097] The embodiment of the present invention can realize distributed processing of scheduling tasks by constructing the distributed scheduling architecture of the resources to be scheduled, thereby improving the security of resource scheduling. Wherein, the distributed scheduling architecture refers to an architecture for distributed processing of resource scheduling.
[0098] As an embodiment of the present invention, the construction of the distributed scheduling architecture of the resources to be scheduled includes: analyzing the distributed requirements of the resources to be scheduled; determining the distributed components of the resources to be scheduled based on the distributed requirements; constructing a distributed scheduling algorithm for the resources to be scheduled; and establishing the distributed scheduling architecture of the resources to be scheduled based on the distributed components and the distributed scheduling algorithm.
[0099] Among them, the distributed requirements refer to the system goals, such as resource utilization, scheduling performance, reliability, scalability, etc. The distributed components refer to the components that implement distributed processing of resource scheduling, such as scheduling centers, task execution nodes, and communication mechanisms. The distributed scheduling algorithms refer to the scheduling algorithms used by the architecture, such as task priority processing algorithms.
[0100] In the embodiment of the present invention, the redundant task node refers to a standby node that performs receiving work when a corresponding task node of the distributed scheduling architecture fails.
[0101] S5. Build a communication protocol stack for the task node and the redundant task node, distribute the resource scheduling strategy to the task node, obtain a resource scheduling task node, and perform resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol.
[0102] The embodiment of the present invention can realize the mutual communication of nodes by constructing the communication protocol stack of the task node and the redundant task node, thereby improving the processing efficiency of tasks. Wherein, the communication protocol stack refers to the protocol stack that realizes the mutual communication of nodes.
[0103] As an embodiment of the present invention, the construction of the communication protocol stack of the task node and the redundant task node includes: defining the communication requirements of the task node and the redundant task node; based on the communication requirements, determining the communication protocol of the task node and the redundant task node; designing the communication protocol architecture of the communication protocol; based on the communication protocol architecture, constructing the communication protocol stack of the task node and the redundant task node.
[0104] Among them, the communication requirements refer to the requirements that need to be met by communication, such as transmission speed, data integrity, security, etc. The communication protocols include TCP / IP, UDP, WebSocket and other protocols. The communication protocol architecture refers to the architecture of the communication protocol, including communication endpoints, communication channels, communication processes, etc.
[0105] In detail, the construction of the communication protocol stack of the task node and the redundant task node based on the communication protocol architecture can be achieved through operations such as protocol parsing, protocol encapsulation, and protocol transmission.
[0106] Optionally, in an embodiment of the present invention, the resource scheduling task node refers to a node that has been assigned a resource scheduling task.
[0107] Finally, the embodiment of the present invention performs resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol, which can achieve efficient and stable scheduling of the resources to be scheduled.
[0108] According to the embodiment of the present invention, based on the resource usage data, a resource prediction model of the resources to be scheduled is constructed to realize resource usage prediction, thereby improving the timeliness of resource allocation; according to the embodiment of the present invention, based on the resource status, the resource prediction model is used to predict the resource to be used status of the resources to be scheduled, thereby identifying the future usage of the resources to be scheduled, thereby improving the timeliness of resource allocation; according to the embodiment of the present invention, based on the resource usage demand, the task priority and task dependency of the tasks to be scheduled are analyzed to provide a basis for resource scheduling; further, according to the embodiment of the present invention, based on the resource constraints, the task priority and the task dependency, a resource scheduling strategy of the resources to be scheduled is constructed to improve the efficiency of task processing and reduce resource waste. Furthermore, according to the embodiment of the present invention, a distributed scheduling architecture of the resources to be scheduled is constructed to realize distributed processing of scheduling tasks, thereby improving the security of resource scheduling. Finally, according to the embodiment of the present invention, a communication protocol stack of the task node and the redundant task node is constructed to realize mutual communication of nodes, thereby improving the processing efficiency of tasks, and based on the resource scheduling task node, the redundant task node and the communication protocol, the resource scheduling of the resources to be scheduled is executed to realize efficient and stable scheduling of the resources to be scheduled. Therefore, the resource scheduling method based on cloud computing proposed in the present invention can improve the scheduling effect of resource scheduling based on cloud computing.
[0109] like Figure 2 , which is a functional module diagram of a resource scheduling system based on cloud computing provided by an embodiment of the present invention.
[0110] The resource scheduling system 200 based on cloud computing of the present invention can be installed in an electronic device. According to the functions implemented, the resource scheduling system 200 based on cloud computing can include a resource prediction model construction module 201, a task to be scheduled construction module 202, a resource scheduling strategy construction module 203, a distributed scheduling architecture construction module 204 and a resource scheduling module 205. The module of the present invention can also be called a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, which are stored in the memory of the electronic device.
[0111] In this embodiment, the functions of each module / unit are as follows:
[0112] The resource prediction model building module 201 is used to obtain resource user's resource usage requirements for the resources to be scheduled, collect resource usage data of the resources to be scheduled, and build a resource prediction model for the resources to be scheduled based on the resource usage data;
[0113] The to-be-scheduled task construction module 202 is used to obtain the resource status of the to-be-scheduled resource, predict the resource to-be-scheduled state of the to-be-scheduled resource using the resource prediction model based on the resource status, and analyze the to-be-scheduled tasks of the to-be-scheduled resource based on the resource to-be-scheduled state;
[0114] The resource scheduling strategy building module 203 is used to analyze the resource constraints of the resources to be scheduled, analyze the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements, and build a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies;
[0115] The distributed scheduling architecture building module 204 is used to build the distributed scheduling architecture of the resources to be scheduled, and establish redundant task nodes corresponding to the task nodes of the distributed scheduling architecture;
[0116] The resource scheduling module 205 is used to construct the communication protocol stack of the task node and the redundant task node, distribute the resource scheduling strategy to the task node, obtain the resource scheduling task node, and perform resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol.
[0117] In detail, each module described in the cloud computing-based resource scheduling system 200 described in the embodiment of the present invention adopts the same technical means as the cloud computing-based resource scheduling method described in the accompanying drawings when used, and can produce the same technical effects, which will not be repeated here.
[0118] An embodiment of the present invention provides an electronic device for implementing a resource scheduling method based on cloud computing.
[0119] See also Figure 3 As shown, the electronic device may include a processor 30, a memory 31, a communication bus 32 and a communication interface 33, and may also include a computer program stored in the memory 31 and executable on the processor 30, such as a resource scheduling method program based on cloud computing.
[0120] In some embodiments, the processor may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips. The processor is the control core (Control Unit) of the electronic device, and uses various interfaces and lines to connect various components of the entire electronic device, and executes various functions of the electronic device and processes data by running or executing programs or modules stored in the memory (for example, executing a resource scheduling program based on cloud computing, etc.), and calling data stored in the memory.
[0121] The memory includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a mobile hard disk, a multimedia card, a card-type memory (for example, an SD or DX memory, etc.), a magnetic memory, a disk, an optical disk, etc. In some embodiments, the memory may be an internal storage unit of an electronic device, such as a mobile hard disk of the electronic device. In other embodiments, the memory may also be an external storage device of an electronic device, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Further, the memory may also include both an internal storage unit of the electronic device and an external storage device. The memory may not only be used to store application software and various types of data installed in the electronic device, such as the code for implementing a resource scheduling program based on cloud computing, but may also be used to temporarily store data that has been output or is to be output.
[0122] The communication bus may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is configured to realize connection and communication between the memory and at least one processor, etc.
[0123] The communication interface is used for communication between the above-mentioned electronic device and other devices, including a network interface and a user interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is generally used to establish a communication connection between the electronic device and other electronic devices. The user interface may be a display (Display), an input unit (such as a keyboard (Keyboard)), and optionally, the user interface may also be a standard wired interface, a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, and an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, etc. Among them, the display may also be appropriately referred to as a display screen or a display unit, which is used to display information processed in the electronic device and to display a visual user interface.
[0124] For example, although not shown, the electronic device may also include a power source (such as a battery) for supplying power to various components. Preferably, the power source may be logically connected to the at least one processor through a power management system, so that the power management system can realize functions such as charging management, discharging management, and power consumption management. The power source may also include any components such as one or more DC or AC power sources, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators. The electronic device may also include a variety of sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.
[0125] It should be understood that the embodiment is for illustration only and the scope of the patent application is not limited to this structure.
[0126] The resource scheduling program based on cloud computing stored in the memory of the electronic device is a combination of multiple instructions, and when running in the processor, it can achieve:
[0127] Obtain resource usage requirements of resource users for resources to be scheduled, collect resource usage data of the resources to be scheduled, and construct a resource prediction model for the resources to be scheduled based on the resource usage data;
[0128] Acquire the resource status of the resource to be scheduled, predict the resource to-be-used status of the resource to be scheduled using the resource prediction model based on the resource status, and analyze the to-be-scheduled tasks of the resource to be scheduled based on the resource to-be-scheduled status;
[0129] Analyze the resource constraints of the resources to be scheduled, analyze the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements, and construct a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies;
[0130] Constructing a distributed scheduling architecture for the resources to be scheduled, and establishing redundant task nodes corresponding to the task nodes in the distributed scheduling architecture;
[0131] Construct a communication protocol stack of the task node and the redundant task node, distribute the resource scheduling strategy to the task node, obtain a resource scheduling task node, and perform resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol.
[0132] Specifically, the specific implementation method of the processor for the above instructions can refer to the description of the relevant steps in the corresponding embodiment of the accompanying drawings, which will not be repeated here.
[0133] Furthermore, if the module / unit integrated in the electronic device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. The computer-readable storage medium can be volatile or non-volatile. For example, the computer-readable medium can include: any entity or system that can carry the computer program code, a recording medium, a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, and a read-only memory (ROM).
[0134] The present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor of an electronic device, the computer program can implement:
[0135] Obtain resource usage requirements of resource users for resources to be scheduled, collect resource usage data of the resources to be scheduled, and construct a resource prediction model for the resources to be scheduled based on the resource usage data;
[0136] Acquire the resource status of the resource to be scheduled, predict the resource to-be-used status of the resource to be scheduled using the resource prediction model based on the resource status, and analyze the to-be-scheduled tasks of the resource to be scheduled based on the resource to-be-scheduled status;
[0137] Analyze the resource constraints of the resources to be scheduled, analyze the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements, and construct a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies;
[0138] Constructing a distributed scheduling architecture for the resources to be scheduled, and establishing redundant task nodes corresponding to the task nodes in the distributed scheduling architecture;
[0139] Construct a communication protocol stack of the task node and the redundant task node, distribute the resource scheduling strategy to the task node, obtain a resource scheduling task node, and perform resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol.
[0140] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation.
[0141] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0142] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional modules.
[0143] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.
[0144] Therefore, no matter from which point of view, the embodiments should be regarded as illustrative and non-restrictive, and the scope of the present invention is limited by the appended claims rather than the above description, so it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention. Any attached figure mark in the claims should not be regarded as limiting the claims involved.
[0145] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.
[0146] In addition, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or systems stated in a system claim can also be implemented by one unit or system through software or hardware. The words first, second, etc. are used to indicate names, and do not indicate any particular order.
[0147] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.
Claims
1. A resource scheduling method based on cloud computing, It is characterized in that The method comprises: Obtain resource usage requirements of resource users for resources to be scheduled, collect resource usage data of the resources to be scheduled, preprocess the resource usage data to obtain preprocessed usage data, extract data sequence features of the preprocessed usage data, perform feature conversion on the data sequence features to obtain conversion features, determine the model type of the resources to be scheduled, and construct a resource prediction model for the resources to be scheduled based on the conversion features, the preprocessed usage data and the model type; Acquire the resource status of the resource to be scheduled, and based on the resource status, use the resource prediction model to predict the resource to-be-scheduled state of the resource to be scheduled, calculate the state difference of the resource to be scheduled based on the resource to-be-scheduled state and the resource state corresponding to the resource to be scheduled, analyze the resource impact weight of the state difference on the resource usage demand corresponding to the resource to be scheduled, determine the impact elimination strategy of the state difference based on the resource impact weight, and construct the to-be-scheduled task of the resource to be scheduled based on the impact elimination strategy, wherein the resource to-be-scheduled state can identify the future usage of the resource to be scheduled, and analyze the to-be-scheduled task of the resource to be scheduled based on the resource to-be-scheduled state; Analyze the resource constraints of the resources to be scheduled, analyze the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements, and construct a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies; Constructing a distributed scheduling architecture for the resources to be scheduled, and establishing redundant task nodes corresponding to the task nodes in the distributed scheduling architecture; Construct a communication protocol stack of the task node and the redundant task node, distribute the resource scheduling strategy to the task node, obtain a resource scheduling task node, and perform resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol.
2. The method for implementing resource scheduling based on cloud computing as claimed in claim 1, It is characterized in that The extracting of data sequence features of the preprocessing usage data comprises: Serializing the preprocessed usage data to obtain sequence usage data; Calculating data weights of the sequence usage data; Analyzing local trends of the sequence usage data based on the data weights; Based on the local trend, data sequence features of the sequence usage data are extracted.
3. The method for implementing resource scheduling based on cloud computing as claimed in claim 2, It is characterized in that The calculating the data weight of the sequence usage data includes: Selecting a bandwidth parameter for the sequence usage data; Based on the bandwidth parameter, the data weight of the sequence usage data is calculated using the following formula: in, Indicates The sequence uses data and The data weights of the data used by each sequence, Indicates The sequence uses data, Indicates The sequence uses data, Indicates the bandwidth parameter.
4. The method for implementing resource scheduling based on cloud computing as claimed in claim 3, It is characterized in that The analyzing the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements includes: Based on the resource usage requirement, identifying the priority factor of the task to be scheduled; Analyze the impact relationship between the priority factor and the priority of the task to be scheduled; Based on the priority influence relationship, calculating the task priority of the task to be scheduled; Constructing a task dependency graph of the task to be scheduled; Based on the task dependency graph, the task dependency relationships of the tasks to be scheduled are analyzed.
5. The method for implementing resource scheduling based on cloud computing as claimed in claim 4, It is characterized in that The calculating the task priority of the task to be scheduled based on the priority influence relationship includes: Based on the priority influence relationship, analyzing the priority factor weights of the priority factors corresponding to the tasks to be scheduled; identifying a priority factor state value of the priority factor; Based on the priority factor weight and the priority factor state value, the task priority of the task to be scheduled is calculated using the following formula: in, Indicates the task priority of the task to be scheduled. Indicates the task to be scheduled. The priority factor weights of the priority factors, Indicates the task to be scheduled. The priority factor status value of the priority factor, represents the adjustment factor, Indicates the number of priority factors corresponding to the tasks to be scheduled.
6. The method for implementing resource scheduling based on cloud computing as claimed in claim 5, It is characterized in that The constructing of the distributed scheduling architecture of the resources to be scheduled includes: Analyzing the distributed demand of the resources to be scheduled; Based on the distributed demand, determining the distributed components of the resources to be scheduled; Constructing a distributed scheduling algorithm for the resources to be scheduled; Based on the distributed components and the distributed scheduling algorithm, a distributed scheduling architecture for the resources to be scheduled is established.
7. The method for implementing resource scheduling based on cloud computing as claimed in claim 6, It is characterized in that The communication protocol stack of the task node and the redundant task node is constructed, including: Defining communication requirements of the task node and the redundant task node; Based on the communication requirements, determining the communication protocol of the task node and the redundant task node; Designing a communication protocol architecture for the communication protocol; Based on the communication protocol architecture, a communication protocol stack of the task node and the redundant task node is constructed.
8. A resource scheduling system based on cloud computing, It is characterized in that The system is used to execute the resource scheduling method based on cloud computing according to any one of claims 1 to 7, and comprises: A resource prediction model building module, used to obtain resource user's resource usage requirements for resources to be scheduled, collect resource usage data of the resources to be scheduled, and build a resource prediction model for the resources to be scheduled based on the resource usage data; A to-be-scheduled task construction module is used to obtain the resource status of the to-be-scheduled resource, predict the resource to-be-scheduled state of the to-be-scheduled resource using the resource prediction model based on the resource status, and analyze the to-be-scheduled tasks of the to-be-scheduled resource based on the resource to-be-scheduled state; A resource scheduling strategy building module, used to analyze the resource constraints of the resources to be scheduled, analyze the task priorities and task dependencies of the tasks to be scheduled based on the resource usage requirements, and build a resource scheduling strategy for the resources to be scheduled based on the resource constraints, the task priorities and the task dependencies; A distributed scheduling architecture building module, used to build a distributed scheduling architecture for the resources to be scheduled, and to establish redundant task nodes corresponding to the task nodes of the distributed scheduling architecture; A resource scheduling module is used to construct a communication protocol stack for the task node and the redundant task node, distribute the resource scheduling strategy to the task node, obtain a resource scheduling task node, and perform resource scheduling of the resources to be scheduled based on the resource scheduling task node, the redundant task node and the communication protocol.
Citation Information
Patent Citations
Kubernetes cluster resource hybrid scheduling method based on neural network and distributed cache
CN113806018A
Cloud platform resource dynamic scheduling method based on deep learning
CN113806094A
Cited By
Cloud computing resource scheduling method and system based on artificial intelligence
CN120602494A
