An edge computing method and device for multi-task parallel execution assisted by an unmanned aerial vehicle

Abstract

The present invention provides an edge computing method and device for multi-task parallel execution assisted by drones, which relates to the technical field of mobile edge computing. The method includes: with the optimization goal of minimizing the total service duration of drones, optimizing the content caching and offloading mode of a single drone is constructed as a Markov decision process, using the deep Q-network algorithm to classify mobile devices, optimizing the offloading mode of each mobile device's computing task, and obtaining an optimal allocation scheme under given conditions. For the optimization goal of maximizing the sum of the transmission rates between drones and mobile devices, based on game theory, modeling the drone channel allocation as a stochastic game model, and through the regret value minimization algorithm, obtaining a channel allocation result that satisfies the relevant equilibrium strategy. This method effectively reduces network costs and improves the service experience of users. The present invention is an edge computing method based on drone assistance that achieves high execution efficiency and low network costs for multi-task parallel execution.

Description

Technical Field

[0001] The present invention relates to the technical field of mobile edge computing, and particularly to an edge computing method and device for multi-task parallel execution assisted by an unmanned aerial vehicle. Background Art

[0002] With the rapid development of mobile networks and edge intelligence, various new applications such as augmented reality, virtual reality, and image recognition have emerged continuously. These applications have characteristics of being computationally intensive or latency-sensitive, which pose a severe challenge to mobile devices (MDs) with limited computing capabilities. Mobile Edge Computing (MEC), as an extension of the traditional cloud data processing architecture, is an important solution to solve this problem. By deploying servers with storage and computing capabilities at the edge of the mobile network, MEC can transfer data and computing functions from the centralized cloud to the network edge. Utilizing MEC can provide real-time and efficient computing services for the complex and diverse tasks of MDs, significantly improving the user's service experience.

[0003] In traditional methods, infrastructure-dependent MEC improves the execution efficiency of complex computing tasks, but there are still significant challenges in providing generally reliable computing services for MDs. With the explosive growth in the number of MDs, static MEC servers are difficult to support the real-time and efficient large-scale service requirements. Traditional static MEC servers are usually deployed restrictedly according to experience and budget, which may lead to unbalanced network loads and thus reduce the quality of service. Due to the characteristics of high mobility and easy deployment, unmanned aerial vehicles have become one of the important forms of assisting edge computing, and they can provide flexible and efficient computing services for MDs on demand in complex scenarios.

[0004] Regarding the resource optimization in the unmanned aerial vehicle-assisted mobile edge computing network, many research works have provided valuable methods from multiple perspectives, such as: research methods for trajectory control and task offloading, optimization research on communication resources, joint optimization research on computing and communication, optimization research on content caching resources, etc. This has laid a foundation for subsequent research. Some key points that are crucial for improving the service quality of mobile devices and reducing network costs still need to be explored.

[0005] In the processing of most target tasks, either they are processed one by one, or only partially occupy computing and communication resources for execution. The sequential execution method leads to low resource utilization efficiency, and the resource sharing method may lead to unhealthy resource competition. The existing technology has insufficient research on the joint optimization of content caching, computing offloading, and communication resources. For complex joint optimization problems, there is a lack of effective processing methods, and it is difficult to consider the mutual relationships between multiple optimization dimensions simultaneously.

[0006] In the prior art, there is a lack of an edge computing method based on drone assistance that can achieve high execution efficiency for multi-task parallelism and low network cost. Summary of the Invention

[0007] To solve the technical problems existing in the prior art, such as the low resource utilization efficiency and the long total service time of drones caused by unhealthy resource competition, and the high network computing cost caused by the insufficient exploration of the joint optimization of content caching, computing offloading, and communication resources, the embodiments of the present invention provide an edge computing method and device for multi-task parallel execution assisted by drones. The technical solutions are as follows:

[0008] On the one hand, an edge computing method for multi-task parallel execution assisted by drones is provided. This method is implemented by an edge computing device and includes:

[0009] Obtain the first computing task set of multiple mobile devices within the service range of the drone, the environmental status set of the drone, the available channels of the drone, the action space of the drone, and the basic parameters of the drone;

[0010] Based on the first computing task set, the drone performs cache optimization to obtain the optimized content cache of the drone;

[0011] According to the optimized content cache set and the first computing task set, screen the multiple mobile devices to obtain the first type of mobile device set and the second type of mobile device set;

[0012] Taking the minimization of the total drone service duration as the optimization goal, construct a Markov decision process according to the optimized content cache, the first computing task set, and the preset drone action strategy;

[0013] Based on the Markov decision process and the deep Q-network algorithm, screen the second type of mobile device set according to the first computing task set to obtain the third type of mobile device set and the fourth type of mobile device set;

[0014] Taking the maximization of the drone transmission rate sum as the optimization goal, construct a stochastic game model according to the drone environmental status set and the action space;

[0015] Based on the stochastic game model, perform iterative optimization on the allocation of the available channels according to the action space through the regret value minimization algorithm to obtain the optimal channel allocation;

[0016] Based on the first type of mobile device set, the third type of mobile device set, and the fourth type of mobile device set, perform calculations according to the basic parameters of the drone, the first computing task set, and the optimal channel allocation to obtain the minimum total drone service duration.

[0017] On the other hand, an edge computing device for drone-assisted multi-task parallel execution is provided. This device is applied to the edge computing method for drone-assisted multi-task parallel execution, and the device includes:

[0018] A drone information acquisition module, configured to acquire a first set of computing tasks of multiple mobile devices within the service range of the drone, an environmental state set of the drone, available channels of the drone, an action space of the drone, and basic drone parameters;

[0019] A content cache optimization module, configured to perform cache optimization on the drone based on the first set of computing tasks to obtain an optimized content cache of the drone;

[0020] A first device classification module, configured to screen the multiple mobile devices according to the optimized content cache set and the first set of computing tasks to obtain a first set of mobile devices and a second set of mobile devices;

[0021] A Markov decision process construction module, configured to construct a Markov decision process with the goal of minimizing the total service duration of the drone according to the optimized content cache, the first set of computing tasks, and a preset drone action strategy;

[0022] A second device classification module, configured to screen the second set of mobile devices according to the first set of computing tasks based on the Markov decision process and the deep Q-network algorithm to obtain a third set of mobile devices and a fourth set of mobile devices;

[0023] A game model construction module, configured to construct a stochastic game model with the goal of maximizing the sum of drone transmission rates according to the drone environmental state set and the action space;

[0024] An optimal channel allocation module, configured to iteratively optimize the allocation of the available channels based on the stochastic game model and according to the action space through a regret value minimization algorithm to obtain an optimal channel allocation;

[0025] A total service duration calculation module, configured to calculate based on the first set of mobile devices, the third set of mobile devices, and the fourth set of mobile devices according to the basic drone parameters, the first set of computing tasks, and the optimal channel allocation to obtain the minimum total service duration of the drone.

[0026] On the other hand, an edge computing device is provided. The edge computing device includes: a processor; a memory, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by the processor, any one of the methods in the above-mentioned edge computing method for drone-assisted multi-task parallel execution is implemented.

[0027] On the other hand, a computer-readable storage medium is provided, in which at least one instruction is stored, and the at least one instruction is loaded and executed by a processor to implement any one of the above-mentioned edge computing methods for multi-task parallel execution assisted by an unmanned aerial vehicle.

[0028] The beneficial effects brought by the technical solutions provided in the embodiments of the present invention at least include:

[0029] The present invention proposes an edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle. With the optimization goal of minimizing the total service duration of the unmanned aerial vehicle, the content caching and offloading mode optimization of a single unmanned aerial vehicle is constructed as a Markov decision process. The deep Q-network algorithm is used to classify mobile devices, and at the same time, the offloading mode of each mobile device's computing task is optimized to obtain an optimal allocation scheme under given conditions. For the optimization goal of maximizing the sum of the transmission rates between the unmanned aerial vehicle and the mobile devices, based on game theory, the unmanned aerial vehicle channel allocation is modeled as a stochastic game model, and through the regret value minimization algorithm, a channel allocation result that satisfies the relevant equilibrium strategy is obtained. This method effectively reduces the network cost and improves the user's service experience. The present invention is an edge computing method based on unmanned aerial vehicle assistance that achieves high execution efficiency and low network cost for multi-task parallel execution. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0031] Figure 1 It is a flowchart of an edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle provided by an embodiment of the present invention;

[0032] Figure 2 It is a schematic diagram of three possible task completion sequences under multi-task parallel processing provided by an embodiment of the present invention;

[0033] Figure 3 It is a comparison chart of the average service duration of each unmanned aerial vehicle under different optimization algorithms provided by an embodiment of the present invention;

[0034] Figure 4 It is a block diagram of an edge computing device for multi-task parallel execution assisted by an unmanned aerial vehicle provided by an embodiment of the present invention;

[0035] Figure 5 It is a schematic structural diagram of an edge computing device provided by an embodiment of the present invention. Detailed implementation manners

[0036] The technical solutions in the present invention will be described below with reference to the accompanying drawings.

[0037] In the embodiments of the present invention, words such as "exemplarily" and "for example" are used to represent examples, illustrations or explanations. Any embodiment or design solution described as an "example" in the present invention should not be construed as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of the word "example" is intended to present concepts in a specific manner. In addition, in the embodiments of the present invention, the meaning expressed by "and / or" can be both, or either one of the two can be selected.

[0038] In the embodiments of the present invention, "image" and "picture" can sometimes be used interchangeably. It should be noted that when their differences are not emphasized, the meanings they express are the same. "(of)", "corresponding", and "corresponding" can sometimes be used interchangeably. It should be noted that when their differences are not emphasized, the meanings they express are the same.

[0039] In the embodiments of the present invention, sometimes subscripts such as W1 may be written in a non-subscript form such as W1. When their differences are not emphasized, the meanings they express are the same.

[0040] To make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will be described in detail with reference to the accompanying drawings and specific embodiments.

[0041] The embodiments of the present invention provide an edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle. This method can be implemented by an edge computing device, and the edge computing device can be a terminal or a server. As Figure 1 shown in the flowchart of the edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle, the processing flow of this method can include the following steps:

[0042] S1. Obtain the first computing task set of multiple mobile devices within the service range of the unmanned aerial vehicle, the environmental state set of the unmanned aerial vehicle, the available channels of the unmanned aerial vehicle, the action space of the unmanned aerial vehicle, and the basic parameters of the unmanned aerial vehicle.

[0043] In a feasible implementation manner, the basic parameters of the unmanned aerial vehicle include the operation cycle of the CPU of the unmanned aerial vehicle and the computing frequency of the unmanned aerial vehicle. The first computing task set is the set of computing tasks of all unmanned aerial vehicles.

[0044] S2. Based on the first computing task set, the unmanned aerial vehicle performs cache optimization to obtain the optimized content cache of the unmanned aerial vehicle.

[0045] Optionally, based on the first set of computing tasks, the UAV performs cache optimization to obtain the optimized content cache of the UAV, including:

[0046] Ascendingly sort the first set of computing tasks according to the content quantity of each task in the first set of computing tasks to obtain the sorted set of computing tasks;

[0047] Based on the sorted set of computing tasks, the UAV performs content caching to obtain the optimized content cache set of the UAV.

[0048] In a feasible implementation, according to the content required by the mobile device computing tasks, sort them in ascending order of quantity, and the UAV preferentially caches the content with small quantities. Based on this, the UAV has completed the optimization of content caching and only needs to consider the optimization of the offloading mode of the associated mobile device computing tasks.

[0049] S3. According to the optimized content cache set and the first set of computing tasks, screen multiple mobile devices to obtain the first type of mobile device set and the second type of mobile device set.

[0050] Optionally, according to the optimized content cache set and the first set of computing tasks, screen multiple mobile devices to obtain the first type of mobile device set and the second type of mobile device set, including:

[0051] Obtain the uploaded data set of the mobile device according to the optimized content cache set;

[0052] Obtain the data set to be calculated of the mobile device according to the first set of computing tasks;

[0053] Use the data set to be calculated to verify the uploaded data set to obtain the verification result;

[0054] Among multiple mobile devices, select the mobile devices with consistent verification results to obtain the first type of mobile device set;

[0055] Among multiple mobile devices, select the mobile devices with inconsistent verification results to obtain the second type of mobile device set.

[0056] In a feasible implementation, in the present invention, the data set to be calculated required for the edge computing task execution of the mobile device is verified with the uploaded data set cached at the UAV side.

[0057] If the content of the data set to be calculated is consistent with the content of the uploaded data set, the mobile device corresponding to the data set belongs to the first type of mobile device, and all the first type of mobile devices are screened out and aggregated into the first type of mobile device set 。

[0058] Conversely, if the content of the dataset to be calculated is inconsistent with the content of the uploaded dataset, the mobile device corresponding to the dataset belongs to the second type of mobile device, and all the second type of mobile devices are screened out and aggregated into a set of the second type of mobile devices 。

[0059] S4. With the goal of minimizing the total service duration of the drones, a Markov decision process is constructed according to the optimized content caching, the first set of computing tasks, and the preset drone action strategy

[0060] In a feasible implementation manner, in the transmission network of the present invention, each drone (labeled as ) and mobile devices randomly distributed within the signal coverage area of the drone, and the set of mobile devices is , the state of the entire Markov decision process is represented as the following formula (1):

[0061] (1);

[0062] where represents the computing task generated by the mobile device , represents the storage capacity of the drone .

[0063] The action of the drone in the Markov decision process is represented as the following formula (2):

[0064] (2);

[0065] where represents the content caching vector of the drone , represents that the drone stores the rd content, represents all the content; represents the offloading mode vector of the tasks of the mobile devices belonging to the set , where represents the set of mobile devices whose required content for task execution is not fully cached on the drone side

[0066] Thus, the scale of the action space A of the drone action is as follows in formula (3):

[0067] (3);

[0068] where represents belonging to the set The quantity of content required for tasks of all mobile devices, indicating the mobile device content required for the submitted tasks, indicating the drone cached content.

[0069] Based on the optimization of content caching, the scale of the action space is simplified to the following formula (4):

[0070] (4);

[0071] S5. Based on the Markov decision process and the deep Q-network algorithm, according to the first set of computing tasks, screen the second set of mobile devices to obtain the third set of mobile devices and the fourth set of mobile devices.

[0072] Optionally, based on the Markov decision process and the deep Q-network algorithm, according to the first set of computing tasks, screen the second set of mobile devices to obtain the third set of mobile devices and the fourth set of mobile devices, including:

[0073] In the first set of computing tasks, select the tasks corresponding to the second set of mobile devices to obtain the second set of computing tasks;

[0074] Based on the Markov decision process, according to the second set of computing tasks, use the deep Q-network algorithm to perform offloading mode selection to obtain the second offloading mode set;

[0075] In the second set of mobile devices, select the mobile devices whose offloading mode in the offloading mode set is offloading to the remote base station to obtain the third set of mobile devices;

[0076] In the second set of mobile devices, select the mobile devices whose offloading mode in the offloading mode set is not offloading to the remote base station to obtain the fourth set of mobile devices.

[0077] In a feasible implementation manner, based on the Markov decision process, use the deep Q-network algorithm to perform offloading mode selection for the second type of mobile devices. Among them, the offloading mode is offloading to the remote base station for the third type of mobile devices, belonging to the third set of mobile devices ; the offloading mode is not offloading to the remote base station for the fourth type of mobile devices, belonging to the fourth set of mobile devices .

[0078] Optionally, based on the Markov decision process, according to the second set of computing tasks, the deep Q-network algorithm performs offloading mode selection to obtain the second offloading mode set, including:

[0079] According to the second set of computing tasks, the ε-greedy strategy is used to select the offloading mode, and the first offloading mode set is obtained;

[0080] Based on the Markov decision process, calculations are performed according to the offloading mode set to obtain the immediate reward set;

[0081] Based on the immediate reward set, the preset action value function, and the preset loss function, the evaluation neural network parameters of the deep Q-network algorithm are optimized using stochastic gradient descent to obtain the optimized evaluation neural network parameters;

[0082] According to the optimized evaluation neural network parameters, the target neural network parameters of the deep Q-network algorithm are updated to obtain the updated target neural network parameters;

[0083] Using the updated target neural network parameters, the preset offloading mode selection strategy is optimized to obtain the optimal selection strategy;

[0084] According to the second set of computing tasks, the optimal selection strategy is used to select the offloading mode, and the second offloading mode set is obtained.

[0085] In a feasible implementation, the reward in the Markov decision process is expressed as the following formula (5):

[0086] (5);

[0087] Where is the duration of the UAV task processing. In state , the UAV selects an appropriate action according to the policy , thereby obtaining a reward , and the environment is updated to a new state. The interaction between the UAV and the environment is represented by , where represents the new state after obtaining the reward in state through the action .

[0088] To evaluate the preset offloading mode selection strategy , the action value function is used as follows in formula (6):

[0089] (6);

[0090] Where is the discount factor, represents the number of interactions, represents the time step in the future reward calculation.

[0091] According to the optimal policy the optimal action-value function can be obtained . Among them, it can be expressed as the following formulas (7) and (8):

[0092] (7);

[0093] (8);

[0094] Among them, is the policy space.

[0095] Use the deep Q-network algorithm to optimize the offloading mode of the mobile device's computing tasks, and initialize the random environment of the entire network; according to the optimized content caching result, classify the mobile devices associated with the drone, and for the set select the offloading mode of the computing tasks of the mobile devices in it according to the ε-greedy policy.

[0096] Calculate the immediate reward obtained by adopting this offloading action, and the environment transfers to a new state; store the historical record in the experience buffer ; if the experience buffer is full, randomly sample a small batch from the experience buffer ; calculate the target Q value; calculate the gradient of the evaluation neural network parameter and use stochastic gradient descent to update to minimize the loss function; periodically update the target neural network parameter ; repeat the above steps until the preset number of iterations is reached.

[0097] The record stored in the experience buffer is ; among them, represents the environmental state at the th iteration, represents the action adopted by the drone at the th iteration, represents the immediate reward obtained by adopting the action in the state , represents a new state entered after adopting the action in the state .

[0098] The calculation formula of the target Q value is as follows (9):

[0099] (9);

[0100] Among them, Represents the optimal Q-value of the next state.

[0101] The loss function is as shown in Equation (10) below:

[0102] (10);

[0103] Where, Represents sampling a series of historical records from the experience buffer to calculate the expectation.

[0104] Evaluate the gradient of the neural network parameters as shown in Equation (11) below:

[0105] (11);

[0106] Where, Represents the gradient of the action-value function with respect to the parameter .

[0107] The update strategy for the target neural network parameters is .

[0108] S6. With maximizing the UAV transmission rate sum as the optimization goal, construct a stochastic game model based on the UAV environmental state set and the action space.

[0109] In a feasible implementation, the overall structure of the stochastic game model is represented as as shown in Equation (12) below:

[0110] (12);

[0111] Where, the stochastic game agent set is the UAV set .

[0112] In a multi-UAV system, there is no information exchange between different UAVs. Therefore, each UAV only has local information about the environmental state as shown in Equation (13) below:

[0113] (13);

[0114] Where, Represents the position of the UAV itself, Represents the optimized UAV content caching decision, Represents the optimized UAV computing task offloading mode decision, and respectively represent the mobile devices associated with the UAV The position and computing tasks.

[0115] All the local information of the UAVs regarding the environmental state constitutes the environmental state as shown in the following formula (14):

[0116] (14);

[0117] S7. Based on the stochastic game model, according to the action space, iteratively optimize the allocation of available channels through the regret value minimization algorithm to obtain the optimal channel allocation.

[0118] Optionally, based on the stochastic game model, according to the action space, iteratively optimize the allocation of available channels through the regret value minimization algorithm to obtain the optimal channel allocation, including:

[0119] Based on the stochastic game model, calculate according to the actions in the action space to obtain the action values of the game action space;

[0120] According to the action values, conduct a game through the stochastic game model to obtain the historical cumulative regret;

[0121] Iteratively optimize the historical cumulative regret through the regret value minimization algorithm to obtain the minimum historical cumulative regret;

[0122] Calculate the channel policy update rule according to the minimum historical cumulative regret;

[0123] According to the channel policy update rule, optimize the preset channel allocation policy to obtain the optimal allocation policy;

[0124] Use the optimal allocation policy to allocate the available channels to obtain the optimal channel allocation.

[0125] In a feasible implementation, each UAV will select an action from its action space , and the action selections of all UAVs constitute the action set of the game ;

[0126] Among them, is as shown in the following formula (15):

[0127] (15);

[0128] represents the set of utility functions of the game ; represents the utility function of UAV as shown in the following formula (16):

[0129] (16);

[0130] Among them, is the set of channels available to the UAV, represents the UAV 's selection status of the channel , represents selecting the channel , represents not selecting the channel , represents when the channel is selected, the transmission rate between the UAV and the mobile device .

[0131] In this game framework, is the channel selection strategy of the UAV , which is a probability distribution defined on the action space , expressed as the following formula (17):

[0132] (17);

[0133] Among them, represents the probability that the UAV selects the action .

[0134] The UAV interacts with the environment to update the strategy and finally reaches the correlated equilibrium, which is a set of strategies in the joint action space , and for any UAV (labeled ), the process is as follows in formula (18):

[0135] (18);

[0136] Among them, represents the probability of taking the action combination , represents the action selection combination of other UAVs except the UAV , represents any other action of the UAV in its action space except .

[0137] The channel selection of the UAV is iteratively updated through the regret value minimization algorithm, and obtaining the correlated equilibrium solution of the stochastic game model includes:

[0138] To characterize the local observation attributes of the UAV, the counterfactual advantage of the UAV's actions is introduced, which is jointly determined by the action value and the observation value. The UAV takes an action The action value obtained is expressed as as shown in Equation (19) below:

[0139] (19);

[0140] The observation value of the environmental state is defined as the expectation of all action values in the action space as shown in Equation (20) below: (20);

[0141] (20);

[0142] Correspondingly, the counterfactual advantage of the UAV when not taking an action in the environmental state is expressed as shown in Equation (21) below:

[0143] (21);

[0144] To fully utilize past experience to learn the optimal strategy, a series of games need to be carried out, and the historical cumulative regret of the UAV always taking an action is calculated as shown in Equation (22) below:

[0145] (22);

[0146] where represents the current iteration number, and the summation starts from the first iteration.

[0147] In each iteration, the channel selection strategy of the UAV is updated, and the update rule is as shown in Equation (23) below:

[0148] (23);

[0149] where represents the maximum value between the selection and 0, and the sum of the non - negative regret values of all available actions.

[0150] S8. Based on the first type of mobile device set, the third type of mobile device set, and the fourth type of mobile device set, calculate according to the basic parameters of the unmanned aerial vehicle, the first set of computing tasks, and the optimal channel allocation to obtain the minimum total service duration of the unmanned aerial vehicle.

[0151] Optionally, based on the first type of mobile device set, the third type of mobile device set, and the fourth type of mobile device set, calculate according to the basic parameters of the unmanned aerial vehicle, the first set of computing tasks, and the optimal channel allocation to obtain the minimum total service duration of the unmanned aerial vehicle, including:

[0152] Based on the first type of mobile device set, calculate the service duration of the unmanned aerial vehicle according to the first set of computing tasks, the optimal channel allocation, and the basic parameters of the unmanned aerial vehicle to obtain the service duration of the first type of unmanned aerial vehicle;

[0153] Based on the third type of mobile device set, calculate the service duration of the unmanned aerial vehicle according to the first set of computing tasks, the optimal channel allocation, and the basic parameters of the unmanned aerial vehicle to obtain the service duration of the second type of unmanned aerial vehicle;

[0154] Based on the fourth type of mobile device set, calculate the service duration of the unmanned aerial vehicle according to the first set of computing tasks, the optimal channel allocation, and the basic parameters of the unmanned aerial vehicle to obtain the service duration of the third type of unmanned aerial vehicle;

[0155] Calculate according to the service duration of the first type of unmanned aerial vehicle, the service duration of the second type of unmanned aerial vehicle, and the service duration of the third type of unmanned aerial vehicle to obtain the minimum total service duration of the unmanned aerial vehicle.

[0156] In a feasible implementation manner, for the mobile devices belonging to the set since the unmanned aerial vehicle caches the content they need, after receiving the task request from the mobile device the unmanned aerial vehicle will perform edge computing and return the calculation result. The computing delay and the transmission delay are respectively expressed as the following formulas (24) and (25):

[0157] (24);

[0158] (25);

[0159] Among them, represents the CPU operation cycles required to complete the task, represents the computing frequency of the unmanned aerial vehicle , represents the data size of the calculation result, represents the selected channel when the unmanned aerial vehicle and the mobile device The transmission rate between

[0160] For mobile devices belonging to the set since the UAV only caches part of the content required for its computing tasks, the UAV needs to first fetch the missing content from the remote base station. The transmission delay for receiving this content is expressed as Equation (26):

[0161] (26);

[0162] where represents the content to be fetched, represents the UAV and the channel transmission rate between the remote base station.

[0163] The UAV performs edge computing, and the computing delay is expressed as Equation (27):

[0164] (27);

[0165] After the calculation is completed, the result is transmitted back to the mobile device, and the transmission delay is expressed as Equation (28):

[0166] (28);

[0167] For mobile devices belonging to the set the UAV will directly offload the computing task to the remote base station. After the base station completes the execution, the calculation result will be transmitted to the UAV and the UAV will then return the result to the mobile device. The delays of these three steps, namely the remote computing delay , the base station transmission delay , and the UAV transmission delay , are expressed as Equation (29):

[0168] (29);

[0169] where is the computing frequency of the remote base station.

[0170] The computing tasks of mobile devices in the set will be completed before the computing tasks of mobile devices in the set , and the set The completion order of the computing tasks of the mobile devices in [the set] is uncertain, and it may be completed before or after the tasks of the mobile devices in the set. Therefore, there are three different task completion orders, as shown in the following formula (30):

[0171] (30);

[0172] Under different task completion orders, the service duration of the UAV is different. To distinguish these three cases, three service durations are used here, as shown in formula (31):

[0173] (31);

[0174] To accurately describe the service duration of the UAV server in different cases, symbols representing the start of execution of certain steps are introduced. Specifically: for the mobile devices in the set , and respectively represent the times when edge computing and result transmission start to execute. For the mobile devices in the set , and respectively represent the times when content reception, edge computing, and result transmission start to execute. In addition, for the mobile devices in the set , and respectively represent the times when remote computing, result reception, and result transmission start to execute.

[0175] Figure 2 Examples of these three orders are shown. It can be seen that in different cases, the start execution times of the same processing step are different.

[0176] In the first case, the tasks of the mobile devices in the set are completed last, so the total service duration of the UAV depends on the task result transmission delay of the mobile devices in the set ,as shown in formula (32):

[0177] (32);

[0178] In this task completion order, the start execution times of the above processing steps are represented as shown in formula (33):

[0179] (33);

[0180] In the second case, the total service duration of the UAV depends on the set The task result transmission delay of the mobile devices, i.e., Equation (34):

[0181] (34);

[0182] Under this task completion order, the start execution time of the above processing steps is expressed as Equation (35):

[0183] (35);

[0184] The third case is similar to the second case. The total service duration of the UAV depends on the task result transmission delay of the mobile devices in the set i.e., Equation (36):

[0185] (36);

[0186] Under this task completion order, the start execution time of the above processing steps is expressed as Equation (37):

[0187] (37);

[0188] In a feasible implementation, the parallel execution mode proposed by the present invention allows the calculation, reception, and transmission of different tasks to be carried out simultaneously, greatly reducing the service delay. In the scenario where mobile devices are densely configured, i.e., when the number of mobile devices is large and the number of UAVs is small, the gap between the two schemes of parallel execution and serial execution is more significant. In the case where mobile devices are relatively sparsely configured, the average delay of each UAV is reduced by 12.6% during parallel execution. In the case where mobile devices are densely configured, this advantage is extended to 21.6%.

[0189] To evaluate the system performance of content caching, the proposed joint optimization mode of caching, computing, and communication is compared with the scheme of not caching any content in the UAV server.

[0190] Under the same parameter configuration, when content is actively cached in the UAV server, the average service duration of each UAV will be reduced. This is because when the UAV server does not cache content, the UAV needs to obtain all the content required by the mobile devices belonging to the sets and or offload more tasks of its associated mobile devices to the ground base station, which will result in an increase in the service duration compared with the scheme of the present invention. In addition, for a certain number of UAVs, as the number of mobile devices increases, the gap between the two schemes will widen; while for a certain number of mobile devices, the fewer the number of UAVs, the more significant the performance advantage will be.

[0191] To study the efficiency of hybrid computing, a hybrid computing scheme of drones and ground base stations was compared with two benchmark schemes, which include: (i) complete offloading to the ground base station, that is, all tasks of the mobile device are executed by the ground base station, and the drone only acts as a relay to return the calculation results; (ii) complete computing on the drone, that is, all tasks of the mobile device are processed by its associated drone without offloading.

[0192] In terms of reducing the task completion latency, the hybrid computing mode of drones and ground base stations outperforms these two benchmark schemes. In addition, for these two benchmark offloading schemes, the performance of complete computing on the drone is inferior to that of complete offloading to the ground base station. Especially when the number of mobile devices increases, this indicates that in scenarios with high task traffic, computing resources rather than communication resources are the main factors affecting the network service duration.

[0193] As Figure 3 For the comparison chart of the average service duration of each drone under different optimization algorithms, the total service duration of the drones in the present invention is significantly reduced.

[0194] The present invention proposes an edge computing method for multi-task parallel execution assisted by drones. With the optimization goal of minimizing the total service duration of drones, the content caching and offloading mode optimization of a single drone is constructed as a Markov decision process. The deep Q-network algorithm is used to classify mobile devices, and at the same time, the offloading mode of the computing tasks of each mobile device is optimized to obtain the optimal allocation scheme under given conditions. For the optimization goal of maximizing the sum of the transmission rates between drones and mobile devices, based on game theory, the drone channel allocation is modeled as a stochastic game model, and through the regret value minimization algorithm, the channel allocation result satisfying the relevant equilibrium strategy is obtained. This method effectively reduces the network cost and improves the user service experience. The present invention is an edge computing method based on drone assistance with high execution efficiency and low network cost for multi-task parallel execution.

[0195] Figure 4 It is a block diagram of an edge computing device for multi-task parallel execution assisted by drones shown according to an exemplary embodiment. This device is used for the edge computing method of multi-task parallel execution assisted by drones. Referring to Figure 4 this, the device includes a drone information acquisition module 410, a content caching optimization module 420, a first device classification module 430, a Markov decision process construction module 440, a second device classification module 450, a game model construction module 460, an optimal channel allocation module 470, and a total service duration calculation module 480. Among them:

[0196] The UAV information acquisition module 410 is used to acquire the first set of computing tasks of multiple mobile devices within the service range of the UAV, the set of environmental states of the UAV, the available channels of the UAV, the action space of the UAV, and the basic parameters of the UAV;

[0197] The content cache optimization module 420 is used to optimize the cache of the UAV based on the first set of computing tasks to obtain the optimized content cache of the UAV;

[0198] The first device classification module 430 is used to screen multiple mobile devices according to the optimized content cache set and the first set of computing tasks to obtain the first set of mobile devices and the second set of mobile devices;

[0199] The Markov decision process construction module 440 is used to construct a Markov decision process with the goal of minimizing the total service duration of the UAV according to the optimized content cache, the first set of computing tasks, and the preset UAV action strategy;

[0200] The second device classification module 450 is used to screen the second set of mobile devices based on the Markov decision process and the deep Q-network algorithm according to the first set of computing tasks to obtain the third set of mobile devices and the fourth set of mobile devices;

[0201] The game model construction module 460 is used to construct a stochastic game model with the goal of maximizing the sum of UAV transmission rates according to the set of UAV environmental states and the action space;

[0202] The optimal channel allocation module 470 is used to iteratively optimize the allocation of available channels based on the stochastic game model and the action space through the regret value minimization algorithm to obtain the optimal channel allocation;

[0203] The total service duration calculation module 480 is used to calculate the minimum total service duration of the UAV based on the first set of mobile devices, the third set of mobile devices, and the fourth set of mobile devices according to the basic parameters of the UAV, the first set of computing tasks, and the optimal channel allocation.

[0204] Optionally, the content cache optimization module 420 is further used for:

[0205] Sort the first set of computing tasks in ascending order according to the content quantity of each task in the first set of computing tasks to obtain the sorted set of computing tasks;

[0206] According to the sorted set of computing tasks, the UAV performs content caching to obtain the optimized content cache set of the UAV.

[0207] Optionally, the first device classification module 430 is further used for:

[0208] Obtain the uploaded data set of the mobile device according to the optimized content cache set;

[0209] Obtain the data set to be calculated of the mobile device according to the first calculation task set;

[0210] Use the data set to be calculated to verify the uploaded data set and obtain the verification result;

[0211] Among multiple mobile devices, select the mobile devices with consistent verification results to obtain the first type of mobile device set;

[0212] Among multiple mobile devices, select the mobile devices with inconsistent verification results to obtain the second type of mobile device set.

[0213] Optionally, the second device classification module 450 is further used for:

[0214] In the first calculation task set, select the tasks corresponding to the second type of mobile device set to obtain the second calculation task set;

[0215] Based on the Markov decision process, according to the second calculation task set, use the deep Q-network algorithm to select the offloading mode and obtain the second offloading mode set;

[0216] Among the second type of mobile device set, select the mobile devices whose offloading mode in the offloading mode set is offloading to the remote base station to obtain the third type of mobile device set;

[0217] Among the second type of mobile device set, select the mobile devices whose offloading mode in the offloading mode set is not offloading to the remote base station to obtain the fourth type of mobile device set.

[0218] Optionally, the second device classification module 450 is further used for:

[0219] According to the second calculation task set, use the ε-greedy strategy to select the offloading mode and obtain the first offloading mode set;

[0220] Based on the Markov decision process, perform calculations according to the offloading mode set to obtain the immediate reward set;

[0221] Based on the immediate reward set, the preset action value function, and the preset loss function, use stochastic gradient descent to optimize the evaluation neural network parameters of the deep Q-network algorithm to obtain the optimized evaluation neural network parameters;

[0222] According to the optimized evaluation neural network parameters, update the target neural network parameters of the deep Q-network algorithm to obtain the updated target neural network parameters;

[0223] Optimize the preset offloading mode selection strategy using the updated target neural network parameters to obtain the optimal selection strategy;

[0224] According to the second set of computing tasks, use the optimal selection strategy to select the offloading mode to obtain the second offloading mode set.

[0225] Optionally, the optimal channel allocation module 470 is further configured to:

[0226] Based on the stochastic game model, calculate according to the actions in the action space to obtain the action values in the game action space;

[0227] According to the action values, conduct a game through the stochastic game model to obtain the historical cumulative regret;

[0228] Iteratively optimize the historical cumulative regret through the regret value minimization algorithm to obtain the minimum historical cumulative regret;

[0229] Calculate the channel strategy update rule according to the minimum historical cumulative regret;

[0230] Optimize the preset channel allocation strategy according to the channel strategy update rule to obtain the optimal allocation strategy;

[0231] Allocate the available channels using the optimal allocation strategy to obtain the optimal channel allocation.

[0232] Optionally, the total service duration calculation module 480 is further configured to:

[0233] Based on the first type of mobile device set, calculate the UAV service duration according to the first set of computing tasks, the optimal channel allocation, and the UAV basic parameters to obtain the first type of UAV service duration;

[0234] Based on the third type of mobile device set, calculate the UAV service duration according to the first set of computing tasks, the optimal channel allocation, and the UAV basic parameters to obtain the second type of UAV service duration;

[0235] Based on the fourth type of mobile device set, calculate the UAV service duration according to the first set of computing tasks, the optimal channel allocation, and the UAV basic parameters to obtain the third type of UAV service duration;

[0236] Calculate based on the first type of UAV service duration, the second type of UAV service duration, and the third type of UAV service duration to obtain the minimum total UAV service duration.

[0237] The present invention proposes an edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle (UAV). With the optimization goal of minimizing the total service duration of the UAV, the optimization of the content caching and offloading mode of a single UAV is constructed as a Markov decision process. The deep Q-network algorithm is used to classify mobile devices, and at the same time, the offloading mode of each mobile device's computing task is optimized to obtain an optimal allocation scheme under given conditions. For the optimization goal of maximizing the sum of the transmission rates between the UAV and mobile devices, based on game theory, the UAV channel allocation is modeled as a stochastic game model, and through the regret value minimization algorithm, a channel allocation result that satisfies the correlated equilibrium strategy is obtained. This method effectively reduces the network cost and improves the service experience of users. The present invention is an edge computing method based on UAV assistance that achieves high execution efficiency and low network cost for multi-task parallel execution.

[0238] Figure 5 FIG. 4 is a schematic structural diagram of an edge computing device provided by an embodiment of the present invention. As Figure 5 shown, the edge computing device may include the above-mentioned Figure 4 edge computing device for multi-task parallel execution assisted by a UAV shown in FIG. Optionally, the edge computing device 510 may include a first processor 2001.

[0239] Optionally, the edge computing device 510 may further include a memory 2002 and a transceiver 2003.

[0240] Among them, the first processor 2001, the memory 2002, and the transceiver 2003 may be connected through a communication bus.

[0241] Next, specific introductions to the various components of the edge computing device 510 will be given in conjunction with Figure 5 FIG.

[0242] Among them, the first processor 2001 is the control center of the edge computing device 510, which may be a single processor or a collective term for multiple processing elements. For example, the first processor 2001 is one or more central processing units (CPUs), or may be an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention, such as: one or more digital signal processors (DSPs), or one or more field programmable gate arrays (FPGAs).

[0243] Optionally, the first processor 2001 can perform various functions of the edge computing device 510 by running or executing software programs stored in the memory 2002 and invoking data stored in the memory 2002.

[0244] In a specific implementation, as an embodiment, the first processor 2001 may include one or more CPUs, such as Figure 5 the CPU0 and CPU1 shown in

[0245] In a specific implementation, as an embodiment, the edge computing device 510 may also include multiple processors, such as Figure 5 the first processor 2001 and the second processor 2004 shown in

[0246] Each of these processors may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). The processor here may refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).

[0247] Among them, the memory 2002 is used to store software programs for implementing the solution of the present invention and is controlled by the first processor 2001 for execution. The specific implementation method can refer to the above method embodiments and will not be elaborated here.

[0247] Optionally, the memory 2002 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM), or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 2002 may be integrated with the first processor 2001 or exist independently and be coupled to the first processor 2001 through an interface circuit ( Figure 5 not shown in

[0248] The transceiver 2003 is used to communicate with network devices or with terminal devices.

[0249] Optionally, the transceiver 2003 may include a receiver and a transmitter ( Figure 5 not shown separately). Among them, the receiver is used to implement the receiving function, and the transmitter is used to implement the transmitting function.

[0250] Optionally, the transceiver 2003 may be integrated with the first processor 2001, or may exist independently, and is coupled to the first processor 2001 through an interface circuit ( Figure 5 not shown) of the edge computing device 510. The embodiments of the present invention do not make specific limitations on this.

[0251] It should be noted that Figure 5 the structure of the edge computing device 510 shown in

[0252] does not constitute a limitation on the router. The actual knowledge structure recognition device may include more or fewer components than shown in the figure, or combine some components, or have different component arrangements.

[0253] It should be understood that the first processor 2001 in the embodiments of the present invention may be a central processing unit (CPU), and this processor may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or this processor may also be any conventional processor, etc.

[0254] It should also be understood that the memory in the embodiments of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0255] The above embodiments can be implemented in whole or in part by software, hardware (such as circuits), firmware, or any combination thereof. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wired (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that the computer can access or a data storage device such as a server or data center that contains one or more collections of available media. The available media can be magnetic media (such as floppy disks, hard disks, magnetic tapes), optical media (such as DVDs), or semiconductor media. The semiconductor media can be a solid-state drive.

[0256] It should be understood that the term "and / or" in this document is merely a description of the association relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. Here, A and B can be singular or plural. In addition, the character " / " in this document generally represents an "or" relationship between the associated objects before and after, but it may also represent an "and / or" relationship, which can be specifically understood with reference to the context.

[0257] In the present invention, "at least one" means one or more, and "a plurality" means two or more. "At least one of the following" or its similar expressions refer to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, a - b, a - c, b - c, or a - b - c, where a, b, and c can be single or multiple.

[0258] It should be understood that in various embodiments of the present invention, the sequence numbers of the above processes do not imply the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.

[0259] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0260] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the above-described devices, apparatuses, and units can refer to the corresponding processes in the foregoing method embodiments, and will not be described herein again.

[0261] In several embodiments provided by the present invention, it should be understood that the disclosed devices, apparatuses, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of the devices or units can be in electrical, mechanical, or other forms.

[0262] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place, or can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0263] In addition, the functional units in various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.

[0264] When the above-mentioned functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs.

[0265] As described above, the above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of changes or substitutions, which should all be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. An edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle, characterized in that The method includes: Obtaining a first set of computing tasks of multiple mobile devices within the service range of the UAV, an environmental status set of the UAV, available channels of the UAV, an action space of the UAV, and basic UAV parameters; Based on the first set of computing tasks, the UAV performs cache optimization to obtain an optimized content cache set of the UAV; According to the optimized content cache set and the first set of computing tasks, screening the multiple mobile devices to obtain a first type of mobile device set and a second type of mobile device set; Among them, the screening of the multiple mobile devices according to the optimized content cache set and the first set of computing tasks to obtain a first type of mobile device set and a second type of mobile device set includes: Obtaining an uploaded data set of the mobile device according to the optimized content cache set; Obtaining a data set to be calculated of the mobile device according to the first set of computing tasks; Using the data set to be calculated to verify the uploaded data set to obtain a verification result; Among the multiple mobile devices, selecting the mobile devices with consistent verification results to obtain a first type of mobile device set; Among the multiple mobile devices, selecting the mobile devices with inconsistent verification results to obtain a second type of mobile device set; Taking minimizing the total service duration of the UAV as the optimization goal, constructing a Markov decision process according to the optimized content cache set, the first set of computing tasks, and a preset UAV action strategy; Based on the Markov decision process and the deep Q-network algorithm, screening the second type of mobile device set according to the first set of computing tasks to obtain a third type of mobile device set and a fourth type of mobile device set; Among them, the screening of the second type of mobile device set according to the first set of computing tasks based on the Markov decision process and the deep Q-network algorithm to obtain a third type of mobile device set and a fourth type of mobile device set includes: Selecting the tasks corresponding to the second type of mobile device set in the first set of computing tasks to obtain a second set of computing tasks; Based on the Markov decision process, according to the second set of computing tasks, using the deep Q-network algorithm to select an offloading mode to obtain a second offloading mode set; Among the second type of mobile device set, selecting the mobile devices with the offloading mode of offloading to the remote base station in the second offloading mode set to obtain a third type of mobile device set; Among the second type of mobile device set, selecting the mobile devices with the offloading mode not being offloading to the remote base station in the second offloading mode set to obtain a fourth type of mobile device set; Taking maximizing the UAV transmission rate sum as the optimization goal, constructing a stochastic game model according to the environmental status set of the UAV and the action space; Based on the stochastic game model, according to the action space, iteratively optimizing the allocation of the available channels through the regret value minimization algorithm to obtain an optimal channel allocation; Based on the first type of mobile device set, the third type of mobile device set, and the fourth type of mobile device set, calculate according to the drone basic parameters, the first calculation task set, and the optimal channel allocation to obtain the minimum total drone service duration; Among them, the calculation based on the first type of mobile device set, the third type of mobile device set, and the fourth type of mobile device set according to the drone basic parameters, the first calculation task set, and the optimal channel allocation to obtain the minimum total drone service duration includes: Based on the first type of mobile device set, calculate the drone service duration according to the first calculation task set, the optimal channel allocation, and the drone basic parameters to obtain the first type of drone service duration; Based on the third type of mobile device set, calculate the drone service duration according to the first calculation task set, the optimal channel allocation, and the drone basic parameters to obtain the second type of drone service duration; Based on the fourth type of mobile device set, calculate the drone service duration according to the first calculation task set, the optimal channel allocation, and the drone basic parameters to obtain the third type of drone service duration; Calculate according to the first type of drone service duration, the second type of drone service duration, and the third type of drone service duration to obtain the minimum total drone service duration.

2. The edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle according to claim 1, wherein The optimization of the drone's content cache based on the first calculation task set to obtain the optimized content cache set of the drone includes: According to the number of contents of each task in the first calculation task set, sort the first calculation task set in ascending order to obtain the sorted calculation task set; According to the sorted calculation task set, the drone performs content caching to obtain the optimized content cache set of the drone.

3. The edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle according to claim 1, wherein The selection of the offloading mode by the deep Q-network algorithm based on the Markov decision process according to the second calculation task set to obtain the second offloading mode set includes: According to the second calculation task set, use the ε-greedy strategy to select the offloading mode to obtain the first offloading mode set; Based on the Markov decision process, calculate according to the first offloading mode set to obtain the immediate reward set; Based on the immediate reward set, the preset action value function, and the preset loss function, use stochastic gradient descent to optimize the evaluation neural network parameters of the deep Q-network algorithm to obtain the optimized evaluation neural network parameters; According to the optimized evaluation neural network parameters, update the target neural network parameters of the deep Q-network algorithm to obtain the updated target neural network parameters; Use the updated target neural network parameters to optimize the preset offloading mode selection strategy to obtain the optimal selection strategy; According to the second calculation task set, use the optimal selection strategy to select the offloading mode to obtain the second offloading mode set.

4. The edge computing method for multi-task parallel execution assisted by an unmanned aerial vehicle according to claim 1, wherein The iterative optimization of the allocation of the available channels by the regret value minimization algorithm based on the stochastic game model according to the action space to obtain the optimal channel allocation includes: Based on the stochastic game model, calculate according to the actions in the action space to obtain the action values in the game action space; According to the action values, conduct a game through the stochastic game model to obtain the historical cumulative regret; Iteratively optimize the historical cumulative regret through the regret value minimization algorithm to obtain the minimum historical cumulative regret; Calculate the channel strategy update rule according to the minimum historical cumulative regret; Optimize the preset channel allocation strategy according to the channel strategy update rule to obtain the optimal allocation strategy; Use the optimal allocation strategy to allocate the available channels to obtain the optimal channel allocation.

5. An edge computing device for drone-assisted multi-task parallel execution, which is used to implement the edge computing method for drone-assisted multi-task parallel execution as described in any one of claims 1-4, characterized in that, The device includes: A UAV information acquisition module, configured to acquire a first set of computing tasks of multiple mobile devices within the service range of the UAV, an environmental state set of the UAV, available channels of the UAV, an action space of the UAV, and UAV basic parameters; A content caching optimization module, configured to perform caching optimization on the UAV based on the first set of computing tasks to obtain an optimized content caching set of the UAV; A first device classification module, configured to screen the multiple mobile devices according to the optimized content caching set and the first set of computing tasks to obtain a first set of mobile devices and a second set of mobile devices; A Markov decision process construction module, configured to construct a Markov decision process with minimizing the total service duration of the UAV as the optimization goal according to the optimized content caching set, the first set of computing tasks, and a preset UAV action strategy; A second device classification module, configured to screen the second set of mobile devices based on the Markov decision process and the deep Q-network algorithm according to the first set of computing tasks to obtain a third set of mobile devices and a fourth set of mobile devices; A game model construction module, configured to construct a stochastic game model with maximizing the sum of UAV transmission rates as the optimization goal according to the environmental state set of the UAV and the action space; An optimal channel allocation module, configured to iteratively optimize the allocation of the available channels based on the stochastic game model and according to the action space through the regret value minimization algorithm to obtain the optimal channel allocation; A total service duration calculation module, configured to calculate based on the first set of mobile devices, the third set of mobile devices, and the fourth set of mobile devices according to the UAV basic parameters, the first set of computing tasks, and the optimal channel allocation to obtain the minimum total service duration of the UAV.

6. An edge computing device, characterized in that, The edge computing device includes: A processor; A memory, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by the processor, the method described in any one of claims 1 to 4 is implemented.

7. A computer-readable storage medium, characterized in that, Program code is stored in the computer-readable storage medium, and the program code can be called by the processor to execute the method described in any one of claims 1 to 4.

Images