Cloud computing power dynamic allocation system and method based on cloud server
By establishing a mapping table between task data and computing power and creating a prediction model, combining containerized technology to dynamically allocate computing power resources, the problem of unbalanced computing power distribution in the existing technology is solved, and efficient and accurate computing power distribution is achieved.
Patent Information
- Application Number
- CN202411865738.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-18
- Publication Date
- 2025-08-15
- Estimated Expiration
- 2044-12-18
AI Technical Summary
In the existing computing power allocation methods, the random allocation method cannot guarantee the fairness and efficiency of task or data allocation, which can easily lead to excessive loading of some computing nodes, and the polling allocation method cannot dynamically allocate based on the actual load conditions of the node, resulting in the node's computing power not being fully utilized.
Establish a mapping table between task data and computing power, create a task prediction model and computing power prediction model, virtually divide computing power into blocks of different sizes through containerization technology, and dynamically allocate based on the mapping table and prediction model, and adjust the allocation of computing power resource pools in real time.
The dynamic allocation of computing power is realized, the efficiency of computing power distribution is improved, and every type of task can be processed efficiently, reducing data processing delays, and saving computing power distribution time.
Smart Images

Figure CN119336511B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of cloud computing power allocation, and in particular relates to a cloud computing power dynamic allocation system and method based on a cloud server. Background Art
[0002] With the unprecedented development of artificial intelligence (AI), a vast number of intelligent devices and applications are significantly influencing and promoting the progress of the economy, society, and human civilization. Computing power is both the foundation of AI and one of the most important drivers of its rapid development. As one of the three essential elements of AI development, efficient computing power plays a catalytic role in data processing, algorithm optimization, and high-precision, fast interaction. The rapid and vigorous development of computing and connectivity technologies has made the interconnectedness of everything in the intelligent world an irreversible trend.
[0003] With the development of artificial intelligence, a large number of artificial intelligence device terminals and artificial intelligence applications will generate a large amount of data every moment. It is necessary to allocate corresponding computing power to process the data generated at these moments, which will bring about the problem of computing power allocation.
[0004] In the existing technology, there are currently two methods for allocating computing power: random allocation and round-robin allocation. The random allocation method has a simple allocation process, but the scale of distributed systems to which it can be applied is relatively small. Currently, the use of random allocation in increasingly large-scale distributed systems cannot guarantee the fairness and efficiency of task or data allocation, which can easily lead to some computing nodes being overloaded and some computing nodes being underloaded. The round-robin allocation method allocates task data to different computing nodes in a fixed order, which can achieve a more even distribution of computing power and avoid node overload. However, the round-robin allocation method cannot dynamically allocate data based on the actual load of the node, resulting in the computing power of the node not being fully utilized.
[0005] Therefore, with the development of artificial intelligence, the scale of distributed systems is getting larger and larger. How to improve the existing computing power allocation method to avoid the random allocation method that cannot guarantee the fairness and efficiency of task or data allocation, which may easily lead to some computing nodes being overloaded and some computing nodes being underloaded, or the polling allocation method cannot be dynamically allocated according to the actual load of the node, resulting in the computing power of the node not being fully utilized. Summary of the Invention
[0006] The purpose of the present invention is to provide a cloud computing power dynamic allocation system and method based on cloud servers, so as to improve the existing computing power allocation method and avoid the situation where the random allocation method cannot guarantee the fairness and efficiency of task or data allocation, which may easily lead to some computing nodes being overloaded and some computing nodes being underloaded or the polling allocation method being unable to dynamically allocate according to the actual load conditions of the nodes, resulting in the computing power of the nodes not being fully utilized.
[0007] In order to solve the above technical problems, the technical solutions adopted by the present invention are as follows:
[0008] In a first aspect, a method for dynamically allocating cloud computing power based on a cloud server is provided, comprising the following steps:
[0009] S1: Establish a mapping table between task data and computing power. The mapping table establishes a matching relationship between the type of task data and the type of computing power, and a matching relationship between the amount of task data and the size of computing power.
[0010] S2: Create a task prediction model, obtain historical task data within a specified period of each terminal device, construct a historical task data set after preprocessing, and input it into the task prediction model for training, and determine whether the prediction ability of the task prediction model meets the preset indicators. If so, execute step S3; if not, adjust the parameters of the task prediction model until the task prediction ability meets the preset indicators;
[0011] S3: Create a computing power prediction model, obtain computing power data of a specified period from the cloud server, construct a historical computing power dataset after preprocessing, and input the dataset into the computing power prediction model for training. Then determine whether the prediction capability of the computing power prediction model meets the preset indicators. If so, execute step S4. If not, adjust the parameters of the computing power prediction model until the computing power prediction capability meets the preset indicators.
[0012] S4: predicting the task data of each terminal device at a specified time using the task prediction model, and outputting the task prediction results of each smart terminal; predicting the computing power data of the cloud server using the computing power prediction model, and outputting the computing power prediction results;
[0013] S5: Based on the computing power prediction results, the computing power prediction results are divided into different computing power resource pools using containerization technology, and the computing power is virtually divided into computing power blocks of different sizes in the different computing power resource pools;
[0014] S6: extracting the task prediction results of each smart terminal, calling the mapping table, and matching the corresponding resource pool for each smart terminal's task based on the mapping table, and pre-allocating the specified computing power blocks in the corresponding resource pool to the tasks of each smart terminal;
[0015] S7: Collect the real-time task data of each smart terminal, compare the real-time task data with the corresponding task prediction results, extract the real-time task data of the smart terminal whose difference between the task prediction result and the real-time task data is not within a preset error range, and redistribute the real-time task data based on the extracted real-time task data of the smart terminal.
[0016] Preferably, the specific process of step S1 is as follows:
[0017] S11: Divide the task data of each intelligent terminal into different task types according to the processing time complexity;
[0018] S12: Divide the computing power into corresponding computing power types based on different task types;
[0019] S13: Match the corresponding computing power to the specified task volume of each task type;
[0020] S14: Construct a general mapping table of task types and computing power types, and create a sub-mapping table of the specified task amount and the corresponding computing power for each task type under the general mapping table.
[0021] Preferably, in step S11, different task types are divided into constant-order tasks, logarithmic-order tasks and exponential-order tasks according to the processing time complexity, and in step S12, the computing power types matching different task types include constant-order computing power, logarithmic-order computing power and exponential-order computing power.
[0022] Preferably, the task prediction model in step S2 and the computing power prediction model in step S3 are both long short-term memory network models.
[0023] The task prediction model and computing power prediction model both include an input gate, a forget gate, a memory cell, and an output gate;
[0024] The input gate is used to input a historical task data set, and extract the specified task data from the input historical task data to be updated into the memory cell state;
[0025] The forget gate is used to determine whether the specified task data in the input historical task data is forgotten;
[0026] The memory cells are used to record time series information of task data;
[0027] The output gate is used to control the output of the specified task data in the memory cell state to the hidden state.
[0028] Preferably, the input gate uses a nonlinear action function of the first neuron to determine the task information to be updated to the memory cell state. The first nonlinear action function generates a value from 0 to 1, indicating the proportion of the task data updated to the cell state. The specific formula is:
[0029] I t = s 1 ( W i *[ h t−1 , x t ]+ b i );
[0030] in, I t represents the input gate, s 1 is the first nonlinear action function, W i is the weight matrix of the input gate, h t−1 is the hidden state at the previous time step, x t is the input of the current time step, b i is the bias term of the input gate;
[0031] The forget gate uses the nonlinear action function of the second neuron to determine the forgotten task information. The second nonlinear action function generates a value between 0 and 1, indicating the proportion of forgotten task data. The specific formula is:
[0032] F t = s 2 ( ( W f *[ h t−1 , x t ]+ b f );
[0033] in, F t represents the forget gate, s 2 is the second nonlinear action function, W f is the weight matrix of the forget gate, h t−1 is the hidden state at the previous time step, x t is the input of the current time step, b f is the bias term of the forget gate;
[0034] The output gate uses the nonlinear action function of the third neuron to determine the output task information. The third nonlinear action function generates a value between 0 and 1, indicating the output ratio of the task data. The specific formula is:
[0035] O t = s 3 ( ( W o *[ h t−1 , x t ]+ b o );
[0036] in, O t represents the forget gate, s 3 is the second nonlinear action function, W o is the weight matrix of the forget gate, h t−1 is the hidden state at the previous time step, x t is the input of the current time step, b o is the bias term of the output gate.
[0037] Preferably, the specific process in step S5 is as follows:
[0038] S51: Identify the type of the predicted computing power and add a computing power type identifier, and allocate it to different computing power resource pools according to the computing power type identifier based on containerization technology. The computing power resource pools match the computing power types, including a constant-order computing power resource pool, a logarithmic-order computing power resource pool, and an exponential-order computing power resource pool.
[0039] S52: Virtually divide the computing power in the constant-order computing power resource pool, the logarithmic-order computing power resource pool, and the exponential-order computing power resource pool into computing power blocks of different sizes.
[0040] Preferably, the specific process in step S6 is as follows:
[0041] S61: extracting task prediction results of each smart terminal and performing type and size identification on the predicted task data;
[0042] S62: calling the general mapping table, and extracting a matching computing resource pool type according to the general mapping table based on the task type of each smart terminal;
[0043] S63: calling the sub-mapping table and allocating computing power blocks of the corresponding computing power resource pool according to the task data size of each smart terminal according to the sub-mapping table;
[0044] When the corresponding computing power resource pool in step S63 cannot match the computing power block of the corresponding size, the computing power blocks in the corresponding computing power resource pool are combined according to the size of the task data, and then the combined computing power blocks are allocated.
[0045] Preferably, the process of reallocating the real-time task data of the smart terminal whose difference between the task prediction result and the real-time task data is not within the preset error range based on the extracted real-time task data of the smart terminal in step S7 is the process of steps S62-S63.
[0046] In a second aspect, a cloud computing power dynamic allocation system based on a cloud server is provided, which is used to implement any one of the cloud computing power dynamic allocation methods based on a cloud server, including a mapping table generation module, a model creation module, a task prediction model, a computing power prediction model, a computing power resource pool, a computing power virtual segmentation module, a data acquisition module, a data comparison module, and a computing power allocation module; the model creation module is connected to the task prediction model and the computing power prediction model, the computing power resource pool is connected to the computing power virtual segmentation module, the computing power prediction model is connected to the computing power resource pool, the task prediction model is connected to the data acquisition module, and the computing power resource pool is connected to the computing power allocation module;
[0047] The mapping table generation module is used to generate a mapping table between task data and computing power, wherein the mapping table establishes a matching relationship between the type of task data and the type of computing power, and a matching relationship between the amount of task data and the size of computing power;
[0048] The model creation module is used to create a task prediction model and a computing power prediction model;
[0049] The task prediction model is used to predict the task data of each terminal device at a specified time and output the task prediction result of each intelligent terminal;
[0050] The computing power prediction model is used to predict the computing power data of the cloud server through the computing power prediction model and output the computing power prediction result;
[0051] The computing power resource pool is used to accommodate different types of computing power;
[0052] The computing power virtual division module is used to virtually divide the computing power of the computing power resource pool;
[0053] The data acquisition module is used to collect real-time task data of each intelligent terminal;
[0054] The data comparison module is used to compare the real-time task data with the corresponding task prediction results, and extract the real-time task data of the smart terminal where the difference between the task prediction result and the real-time task data is not within a preset error range;
[0055] The computing power allocation module is used to call the mapping table and match the corresponding resource pool for the task of each smart terminal based on the mapping table, pre-allocate the specified computing power blocks in the corresponding resource pool to the tasks of each smart terminal, and redistribute them based on the extracted real-time task data of the smart terminal.
[0056] The beneficial effects of the present invention include:
[0057] The cloud computing power dynamic allocation system and method based on the cloud server provided by the present invention establishes a mapping table between task data and computing power; creates and trains a task prediction model; creates and trains a computing power prediction model; predicts the task data of each terminal device through the task prediction model, and outputs the task prediction result of each smart terminal; predicts the computing power data of the cloud server through the computing power prediction model, and outputs the computing power prediction result; divides the computing power prediction result into different computing power resource pools, and virtually divides the computing power into computing power blocks of different sizes; extracts the task prediction result of each smart terminal, and calls the mapping table to match the corresponding resource pool for the task of each smart terminal, and pre-allocates the specified computing power block to the task of each smart terminal; collects the real-time task data of each smart terminal, and redistributes the computing power of the real-time task data of the smart terminal that is not within the preset error range, thereby realizing dynamic allocation of computing power and improving the efficiency of computing power allocation.
[0058] First, by establishing a mapping table between task data and computing power, the mapping table establishes a matching relationship between task data type and computing power type, as well as a matching relationship between task data volume and computing power size. This eliminates the need to use various algorithms to calculate which computing power is allocated to which task data when allocating computing power. Instead, computing power is allocated directly by looking up the mapping table, significantly saving computing power allocation time and improving computing power allocation efficiency.
[0059] Secondly, by creating a task prediction model and a computing power prediction model, the task data of each smart terminal at a specified time point can be predicted, as well as the computing power of each cloud server at a specified time point. Based on the predicted task data and the predicted computing power, computing power is pre-allocated. When real-time data is subsequently allocated, if the predicted tasks are the same, they are directly allocated according to the pre-allocation results. If the predicted task data of a smart terminal exceeds the error range, it is allocated separately, which can further save computing power allocation time and improve computing power allocation efficiency.
[0060] Again, the task prediction model and computing power prediction model set input gates, forget gates, memory cells and output gates. The input gate uses the nonlinear action function of the first neuron to determine the task information to be updated to the memory cell state, the forget gate uses the nonlinear action function of the second neuron to determine the forgotten task information, and the output gate uses the nonlinear action function of the third neuron to determine the output task information, thereby realizing accurate prediction of the task data of the smart terminal and the computing power of the cloud server, and providing an accurate data basis for the subsequent pre-allocation of computing power.
[0061] Furthermore, by using containerization technology to divide the computing power prediction results into different computing power resource pools based on the computing power prediction results, and virtually dividing the computing power into computing power blocks of different sizes in different computing power resource pools, and when a computing power block of the corresponding size cannot be matched in the corresponding computing power resource pool, the computing power blocks in the corresponding computing power resource pool are combined according to the size of the task data, and then the combined computing power blocks are allocated. This can achieve a one-time allocation of computing power, reduce the number of times data is redistributed, further save computing power allocation time, and improve computing power allocation efficiency.
[0062] Finally, by identifying the type of predicted computing power and adding a computing power type identifier, and based on containerization technology, allocating it to different computing power resource pools according to the computing power type identifier, the computing power resource pool matches the computing power type, including constant-order computing power resource pool, logarithmic-order computing power resource pool and exponential-order computing power resource pool, so that different task data can be allocated to appropriate computing power for processing, ensuring that each type of task can be processed efficiently and reducing data processing delay. BRIEF DESCRIPTION OF THE DRAWINGS
[0063] Figure 1 Schematic diagram of the flow of the cloud computing power dynamic allocation method based on cloud servers of the present invention.
[0064] Figure 2 Schematic diagram of the architecture of the cloud computing power dynamic allocation system based on cloud servers of the present invention.
[0065] Figure 3 A schematic diagram of the process of computing power allocation in the present invention. DETAILED DESCRIPTION
[0066] The following is combined with Figure 1~Figure 3 The present invention is described in further detail:
[0067] Example 1
[0068] See attached Figure 1 As shown, the cloud computing power dynamic allocation method based on the cloud server includes the following steps:
[0069] S1: Establish a mapping table between task data and computing power. The mapping table establishes a matching relationship between the type of task data and the type of computing power, as well as a matching relationship between the amount of task data and the size of computing power. By establishing a mapping table between task data and computing power, the mapping table establishes a matching relationship between the type of task data and the type of computing power, as well as a matching relationship between the amount of task data and the size of computing power. This eliminates the need to use various algorithms to calculate which computing power is allocated to which task data when allocating computing power. Instead, computing power allocation is performed directly by searching the mapping table, significantly saving computing power allocation time and improving computing power allocation efficiency.
[0070] S2: Create a task prediction model, obtain historical task data within a specified period of each terminal device, construct a historical task data set after preprocessing, and input it into the task prediction model for training, and determine whether the prediction ability of the task prediction model meets the preset indicators. If so, execute step S3; if not, adjust the parameters of the task prediction model until the task prediction ability meets the preset indicators.
[0071] S3: Create a computing power prediction model, obtain the computing power data of the specified period of the cloud server, and construct a historical computing power data set after preprocessing, and input it into the computing power prediction model for training, and determine whether the prediction ability of the computing power prediction model meets the preset indicators. If so, execute step S4. If not, adjust the parameters of the computing power prediction model until the computing power prediction ability meets the preset indicators. By creating a task prediction model and a computing power prediction model, the task data of each smart terminal at a specified time point is predicted, and the computing power of each cloud server at a specified time point is predicted. Based on the predicted task data and the predicted computing power, the computing power is pre-allocated. When real-time data is subsequently allocated, if the predicted tasks are the same, they are directly allocated according to the pre-allocation results. If the predicted task data of a smart terminal exceeds the error range, it is allocated separately, which can further save computing power allocation time and improve computing power allocation efficiency.
[0072] S4: predicting the task data of each terminal device at a specified time using the task prediction model, and outputting the task prediction results of each smart terminal; predicting the computing power data of the cloud server using the computing power prediction model, and outputting the computing power prediction results;
[0073] S5: Based on the computing power prediction results, the computing power prediction results are divided into different computing power resource pools using containerization technology, and the computing power is virtually divided into computing power blocks of different sizes in the different computing power resource pools;
[0074] S6: extracting the task prediction results of each smart terminal, calling the mapping table, and matching the corresponding resource pool for each smart terminal's task based on the mapping table, and pre-allocating the specified computing power blocks in the corresponding resource pool to the tasks of each smart terminal;
[0075] S7: Collect the real-time task data of each smart terminal, compare the real-time task data with the corresponding task prediction results, extract the real-time task data of the smart terminal whose difference between the task prediction result and the real-time task data is not within a preset error range, and redistribute the real-time task data based on the extracted real-time task data of the smart terminal.
[0076] In this embodiment, the specific process of step S1 is as follows:
[0077] S11: Divide the task data of each intelligent terminal into different task types according to the processing time complexity;
[0078] S12: Divide the computing power into corresponding computing power types based on different task types;
[0079] S13: Match the corresponding computing power to the specified task volume of each task type;
[0080] S14: Construct a general mapping table of task types and computing power types, and create a sub-mapping table of the specified task amount and the corresponding computing power for each task type under the general mapping table.
[0081] In step S11, different task types are divided into constant-order tasks, logarithmic-order tasks and exponential-order tasks according to the processing time complexity. In step S12, the computing power types matching different task types include constant-order computing power, logarithmic-order computing power and exponential-order computing power.
[0082] Example 2
[0083] Based on Example 1, the task prediction model in step S2 and the computing power prediction model in step S3 are both long-short-term memory (LSTM) network models. Both the task prediction model and the computing power prediction model include an input gate, a forget gate, memory cells, and an output gate. The input gate is used to input a historical task dataset and extract specified task data from the input historical task data to update the memory cell state. The forget gate is used to determine whether specified task data from the input historical task data has been forgotten. The memory cells are used to record the time series information of the task data. The output gate is used to control the output of the specified task data in the memory cell state to the hidden state. The memory cell state is the core of the LSTM network model, recording the sequence information and transmitting it to the next moment. The update of the cell state depends on the results of the input gate and the forget gate. The ability to selectively remember or forget past information solves the vanishing or exploding gradient problem encountered by traditional RNNs when processing long sequences. This allows the LSTM network model to better capture long-term dependencies when processing sequential data, enabling accurate prediction of time-series-based task data and computing power data.
[0084] In this embodiment, the input gate uses the nonlinear action function of the first neuron to determine the task information to be updated to the memory cell state. The first nonlinear action function generates a value between 0 and 1, indicating the proportion of the task data that is updated to the cell state. The specific formula is:
[0085] I t = s 1 ( W i *[ h t−1 , x t ]+ b i );
[0086] in, I t represents the input gate, s 1 is the first nonlinear action function, W i is the weight matrix of the input gate, h t−1 is the hidden state at the previous time step, x t is the input of the current time step, b i is the bias term of the input gate;
[0087] The forget gate uses the nonlinear action function of the second neuron to determine the forgotten task information. The second nonlinear action function generates a value between 0 and 1, indicating the proportion of forgotten task data. The specific formula is:
[0088] F t = s 2 ( ( W f *[ h t−1 , x t ]+ b f );
[0089] in, F t represents the forget gate, s 2 is the second nonlinear action function, W f is the weight matrix of the forget gate, h t−1 is the hidden state at the previous time step, x t is the input of the current time step, b f is the bias term of the forget gate;
[0090] The output gate uses the nonlinear action function of the third neuron to determine the output task information. The third nonlinear action function generates a value between 0 and 1, indicating the output ratio of the task data. The specific formula is:
[0091] O t = s 3 ( ( W o *[ h t−1 , x t ]+ b o );
[0092] in, O t represents the forget gate, s 3 is the second nonlinear action function, W o is the weight matrix of the forget gate, h t−1 is the hidden state at the previous time step, xt is the input of the current time step, b o is the bias term of the output gate.
[0093] The input gate, forget gate, memory cell and output gate are set through the task prediction model and computing power prediction model. The input gate uses the nonlinear action function of the first neuron to determine the task information to be updated to the memory cell state, the forget gate uses the nonlinear action function of the second neuron to determine the forgotten task information, and the output gate uses the nonlinear action function of the third neuron to determine the output task information. This achieves accurate prediction of the task data of the smart terminal and the computing power of the cloud server, providing an accurate data basis for the subsequent computing power pre-allocation.
[0094] Example 3
[0095] Based on Example 1 or Example 2, the specific process in step S5 is as follows:
[0096] S51: Identify the type of the predicted computing power and add a computing power type identifier, and allocate it to different computing power resource pools according to the computing power type identifier based on containerization technology. The computing power resource pools match the computing power types, including a constant-order computing power resource pool, a logarithmic-order computing power resource pool, and an exponential-order computing power resource pool.
[0097] S52: Virtually divide the computing power in the constant-order computing power resource pool, the logarithmic-order computing power resource pool, and the exponential-order computing power resource pool into computing power blocks of different sizes.
[0098] Based on the computing power prediction results, the containerization technology is used to divide the computing power prediction results into different computing power resource pools. The computing power in different computing power resource pools is virtually divided into computing power blocks of different sizes. When a computing power block of the corresponding size cannot be matched in the corresponding computing power resource pool, the computing power blocks in the corresponding computing power resource pool are combined according to the size of the task data and then allocated. This can achieve a one-time allocation of computing power, reduce the number of times data is redistributed, further save computing power allocation time, and improve computing power allocation efficiency.
[0099] In this embodiment, see Figure 3 , the specific process in step S6 is as follows:
[0100] S61: extracting task prediction results of each smart terminal and performing type and size identification on the predicted task data;
[0101] S62: calling the general mapping table, and extracting a matching computing resource pool type according to the general mapping table based on the task type of each smart terminal;
[0102] S63: calling the sub-mapping table and allocating computing power blocks of the corresponding computing power resource pool according to the task data size of each smart terminal according to the sub-mapping table;
[0103] When the corresponding computing power resource pool in step S63 cannot match the computing power block of the corresponding size, the computing power blocks in the corresponding computing power resource pool are combined according to the size of the task data, and then the combined computing power blocks are allocated. Through the mapping table between task data and computing power, the mapping table establishes the matching relationship between the type of task data and the type of computing power, and the matching relationship between the amount of task data and the size of computing power. This eliminates the need to use various algorithms to calculate which computing power is allocated to which task data when allocating computing power. Instead, the mapping table is directly searched for computing power allocation, greatly saving computing power allocation time and improving computing power allocation efficiency.
[0104] The process of reallocating the real-time task data of the smart terminal whose difference between the task prediction result and the real-time task data is not within the preset error range based on the extracted real-time task data of the smart terminal in step S7 is the process of steps S62-S63.
[0105] By identifying the type of predicted computing power and adding a computing power type identifier, and based on containerization technology, allocating it to different computing power resource pools according to the computing power type identifier, the computing power resource pool matches the computing power type, including constant-order computing power resource pool, logarithmic-order computing power resource pool and exponential-order computing power resource pool, so that different task data can be allocated to appropriate computing power for processing, ensuring that each type of task can be processed efficiently and reducing data processing delay.
[0106] See also Figure 2 , a cloud computing power dynamic allocation system based on a cloud server is used to implement any one of the cloud computing power dynamic allocation methods based on a cloud server, including a mapping table generation module, a model creation module, a task prediction model, a computing power prediction model, a computing power resource pool, a computing power virtual segmentation module, a data acquisition module, a data comparison module, and a computing power allocation module; the model creation module is connected to the task prediction model and the computing power prediction model, the computing power resource pool is connected to the computing power virtual segmentation module, the computing power prediction model is connected to the computing power resource pool, the task prediction model is connected to the data acquisition module, and the computing power resource pool is connected to the computing power allocation module.
[0107] The mapping table generation module is used to generate a mapping table between task data and computing power, and the mapping table establishes a matching relationship between the type of task data and the type of computing power, and a matching relationship between the amount of task data and the size of computing power; the model creation module is used to create a task prediction model and a computing power prediction model; the task prediction model is used to predict the task data of each terminal device at a specified time, and output the task prediction results of each smart terminal; the computing power prediction model is used to predict the computing power data of the cloud server through the computing power prediction model, and output the computing power prediction results; the computing power resource pool is used to accommodate different types of computing power; the computing power virtual The quasi-segmentation module is used to virtually divide the computing power of the computing power resource pool; the data collection module is used to collect real-time task data of each intelligent terminal; the data comparison module is used to compare the real-time task data with the corresponding task prediction results, and extract the real-time task data of the intelligent terminal whose difference between the task prediction result and the real-time task data is not within a preset error range; the computing power allocation module is used to call the mapping table and match the corresponding resource pool for the task of each intelligent terminal based on the mapping table, pre-allocate the specified computing power block in the corresponding resource pool to the task of each intelligent terminal, and redistribute it based on the extracted real-time task data of the intelligent terminal.
[0108] In summary, the cloud computing power dynamic allocation system and method based on cloud servers provided by the present invention establishes a mapping table between task data and computing power. The mapping table establishes a matching relationship between the type of task data and the type of computing power, as well as a matching relationship between the amount of task data and the size of computing power. This makes it unnecessary to use various algorithms to calculate which computing power is allocated to which task data when allocating computing power. Instead, the computing power is allocated by directly searching the mapping table, which greatly saves computing power allocation time and improves computing power allocation efficiency. By creating a task prediction model and a computing power prediction model, the task data of each smart terminal at a specified time point is predicted, and the computing power of each cloud server at a specified time point is predicted. Based on the predicted task data and the predicted computing power, computing power is pre-allocated. When real-time data is subsequently allocated, if the predicted tasks are the same, they are directly allocated according to the pre-allocation results. If the predicted task data of a smart terminal exceeds the error range, it is allocated separately, which can further save computing power allocation time and improve computing power allocation efficiency.
[0109] The task prediction model and computing power prediction model are configured with an input gate, a forget gate, a memory cell, and an output gate. The input gate uses the nonlinear action function of the first neuron to determine the task information to be updated to the memory cell state, the forget gate uses the nonlinear action function of the second neuron to determine the task information to be forgotten, and the output gate uses the nonlinear action function of the third neuron to determine the output task information. This achieves accurate prediction of the task data of the smart terminal and the computing power of the cloud server, providing an accurate data basis for subsequent pre-allocation of computing power. Based on the computing power prediction results, the computing power prediction results are divided into different computing power resource pools through containerization technology, and the computing power is virtually divided into computing power blocks of different sizes in different computing power resource pools. When a computing power block of the corresponding size cannot be matched in the corresponding computing power resource pool, the computing power blocks in the corresponding computing power resource pool are combined according to the size of the task data, and then the combined computing power blocks are allocated. This can achieve a one-time allocation of computing power, reduce the number of times data is redistributed, further save computing power allocation time, and improve computing power allocation efficiency. By identifying the type of predicted computing power and adding a computing power type identifier, and based on containerization technology, allocating it to different computing power resource pools according to the computing power type identifier, the computing power resource pool matches the computing power type, including constant-order computing power resource pool, logarithmic-order computing power resource pool and exponential-order computing power resource pool, so that different task data can be allocated to appropriate computing power for processing, ensuring that each type of task can be processed efficiently and reducing data processing delay.
Claims
1. A cloud computing power dynamic allocation method based on cloud servers, characterized in that: The following steps are involved: S1: Establish a mapping table between task data and computing power. The mapping table establishes a matching relationship between the type of task data and the type of computing power, and a matching relationship between the amount of task data and the size of computing power. S2: Create a task prediction model, obtain historical task data within a specified period of each terminal device, construct a historical task data set after preprocessing, and input it into the task prediction model for training, and determine whether the prediction ability of the task prediction model meets the preset indicators. If so, execute step S3; if not, adjust the parameters of the task prediction model until the task prediction ability meets the preset indicators; S3: Create a computing power prediction model, obtain computing power data of a specified period from the cloud server, construct a historical computing power dataset after preprocessing, and input the dataset into the computing power prediction model for training. Then determine whether the prediction capability of the computing power prediction model meets the preset indicators. If so, execute step S4. If not, adjust the parameters of the computing power prediction model until the computing power prediction capability meets the preset indicators. S4: predicting the task data of each terminal device at a specified time using the task prediction model, and outputting the task prediction results of each smart terminal; predicting the computing power data of the cloud server using the computing power prediction model, and outputting the computing power prediction results; S5: Based on the computing power prediction results, the computing power prediction results are divided into different computing power resource pools using containerization technology, and the computing power is virtually divided into computing power blocks of different sizes in the different computing power resource pools; S6: extracting the task prediction results of each smart terminal, calling the mapping table, and matching the corresponding resource pool for each smart terminal's task based on the mapping table, and pre-allocating the specified computing power blocks in the corresponding resource pool to the tasks of each smart terminal; S7: collecting real-time task data of each smart terminal and comparing the real-time task data with the corresponding task prediction result. If the difference between the task prediction result and the real-time task data is not within a preset error range, reallocation is performed based on the extracted real-time task data of the smart terminal; Among them, the task prediction model in step S2 and the computing power prediction model in step S3 are both long short-term memory network models. The task prediction model and computing power prediction model both include an input gate, a forget gate, a memory cell, and an output gate; The input gate is used to input a historical task data set, and extract the specified task data from the input historical task data to be updated into the memory cell state; The forget gate is used to determine whether the specified task data in the input historical task data is forgotten; The memory cells are used to record time series information of task data; The output gate is used to control the output of the specified task data in the memory cell state to the hidden state; The input gate uses the nonlinear action function of the first neuron to determine the task information to be updated to the memory cell state. The nonlinear action function of the first neuron generates a value between 0 and 1, indicating the proportion of the task data that is updated to the cell state. The specific formula is: It=σ1(Wi*[ht−1,xt]+bi); Where It represents the input gate, σ1 is the nonlinear action function of the first neuron, Wi is the weight matrix of the input gate, ht−1 is the hidden state of the previous time step, xt is the input of the current time step, and bi is the bias term of the input gate; The forget gate uses the nonlinear action function of the second neuron to determine the forgotten task information. The nonlinear action function of the second neuron generates a value between 0 and 1, which represents the proportion of forgotten task data. The specific formula is: Ft=σ2( (Wf*[ht−1,xt]+bf); Where Ft represents the forget gate, σ2 is the nonlinear action function of the second neuron, Wf is the weight matrix of the forget gate, ht−1 is the hidden state of the previous time step, xt is the input of the current time step, and bf is the bias term of the forget gate; The output gate uses the nonlinear action function of the third neuron to determine the output task information. The nonlinear action function of the third neuron generates a value between 0 and 1, which represents the output ratio of the task data. The specific formula is: Ot=σ3( (Wo*[ht−1,xt]+bo); Where Ot represents the forget gate, σ3 is the nonlinear action function of the third neuron, Wo is the weight matrix of the forget gate, ht−1 is the hidden state of the previous time step, xt is the input of the current time step, and bo is the bias term of the output gate.
2. The cloud computing power dynamic allocation method based on cloud servers according to claim 1 is characterized in that: The specific process of step S1 is as follows: S11: Divide the task data of each intelligent terminal into different task types according to the processing time complexity; S12: Divide the computing power into corresponding computing power types based on different task types; S13: Match the corresponding computing power to the specified task volume of each task type; S14: Construct a general mapping table of task types and computing power types, and create a sub-mapping table of the specified task amount and the corresponding computing power for each task type under the general mapping table.
3. The cloud computing power dynamic allocation method based on cloud servers according to claim 2 is characterized in that: In step S11, different task types are divided into constant-order tasks, logarithmic-order tasks and exponential-order tasks according to the processing time complexity. In step S12, the computing power types matching different task types include constant-order computing power, logarithmic-order computing power and exponential-order computing power.
4. The cloud computing power dynamic allocation method based on cloud servers according to claim 1 is characterized in that: The specific process in step S5 is as follows: S51: Identify the type of the predicted computing power and add a computing power type identifier, and allocate it to different computing power resource pools according to the computing power type identifier based on containerization technology. The computing power resource pools match the computing power types, including a constant-order computing power resource pool, a logarithmic-order computing power resource pool, and an exponential-order computing power resource pool. S52: Virtually divide the computing power in the constant-order computing power resource pool, the logarithmic-order computing power resource pool, and the exponential-order computing power resource pool into computing power blocks of different sizes.
5. The cloud computing power dynamic allocation method based on cloud servers according to claim 2 is characterized in that: The specific process in step S6 is as follows: S61: extracting task prediction results of each smart terminal and performing type and size identification on the predicted task data; S62: calling the general mapping table, and extracting a matching computing resource pool type according to the general mapping table based on the task type of each smart terminal; S63: calling the sub-mapping table and allocating computing power blocks of the corresponding computing power resource pool according to the task data size of each smart terminal according to the sub-mapping table; When the corresponding computing power resource pool in step S63 cannot match the computing power block of the corresponding size, the computing power blocks in the corresponding computing power resource pool are combined according to the size of the task data, and then the combined computing power blocks are allocated.
6. The cloud computing power dynamic allocation method based on cloud servers according to claim 1 is characterized in that: The process of reallocating the real-time task data of the smart terminal whose difference between the task prediction result and the real-time task data is not within the preset error range based on the extracted real-time task data of the smart terminal in step S7 is the process of steps S62-S63.
7. A cloud computing power dynamic allocation system based on a cloud server, used to implement the cloud computing power dynamic allocation method based on a cloud server according to any one of claims 1 to 6, characterized in that: It includes a mapping table generation module, a model creation module, a task prediction model, a computing power prediction model, a computing power resource pool, a computing power virtual segmentation module, a data acquisition module, a data comparison module, and a computing power allocation module; the model creation module is connected to the task prediction model and the computing power prediction model, the computing power resource pool is connected to the computing power virtual segmentation module, the computing power prediction model is connected to the computing power resource pool, the task prediction model is connected to the data acquisition module, and the computing power resource pool is connected to the computing power allocation module; The mapping table generation module is used to generate a mapping table between task data and computing power, wherein the mapping table establishes a matching relationship between the type of task data and the type of computing power, and a matching relationship between the amount of task data and the size of computing power; The model creation module is used to create a task prediction model and a computing power prediction model; The task prediction model is used to predict the task data of each terminal device at a specified time and output the task prediction result of each intelligent terminal; The computing power prediction model is used to predict the computing power data of the cloud server through the computing power prediction model and output the computing power prediction result; The computing power resource pool is used to accommodate different types of computing power; The computing power virtual division module is used to virtually divide the computing power of the computing power resource pool; The data acquisition module is used to collect real-time task data of each intelligent terminal; The data comparison module is used to compare the real-time task data with the corresponding task prediction results, and extract the real-time task data of the smart terminal where the difference between the task prediction result and the real-time task data is not within a preset error range; The computing power allocation module is used to call the mapping table and match the corresponding resource pool for the task of each smart terminal based on the mapping table, pre-allocate the specified computing power blocks in the corresponding resource pool to the tasks of each smart terminal, and redistribute them based on the extracted real-time task data of the smart terminal.
Citation Information
Patent Citations
Calculation power network calling method and device, equipment and storage medium
CN115361280A
Calculation power network flow prediction method based on wavelet decomposition and improved LSTM
CN118714028A