Unmanned aerial vehicle auxiliary resource allocation method based on deep reinforcement learning

A technology of reinforcement learning and resource allocation, applied in the field of resource allocation optimization, can solve the problems of computing task time delay and high energy consumption

Pending Publication Date: 2020-11-10
GUANGDONG UNIV OF TECH
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a UAV auxiliary resource allocation method based on deep reinforcement learning in order to overcome th

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle auxiliary resource allocation method based on deep reinforcement learning
  • Unmanned aerial vehicle auxiliary resource allocation method based on deep reinforcement learning
  • Unmanned aerial vehicle auxiliary resource allocation method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0080] like figure 1 As shown, a UAV-assisted resource allocation method based on deep reinforcement learning includes the following steps:

[0081] S1: Construct a deep reinforcement learning model, obtain a neural network, and initialize neural network parameters;

[0082] S2: Obtain the computing task information generated by the smart device and integrate it into the system state S t ;

[0083] Among them, t represents the decision time slot;

[0084] S3: Input system state S t Train the neural network to get the system action A t ;

[0085] S4: Action A according to the system t Calculate the corresponding total cost C total ;

[0086] S5: According to the total cost C total Train the neural network to obtain system actions that minimize overhead;

[0087] S6: Complete the training of the neural network, and allocate resources according to the obtained system actions that minimize the total overhead.

[0088] In the implementation process, the deep reinforcemen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an unmanned aerial vehicle auxiliary resource allocation method based on deep reinforcement learning, and the method comprises the following steps: S1, constructing a deep reinforcement learning model, obtaining a neural network, and initializing neural network parameters; s2, obtaining calculation task information generated by the intelligent device and integrating the calculation task information into a system state St; s3, inputting a system state St to train the neural network to obtain a system action At; s4, calculating to obtain the corresponding total overhead Ctotal according to the system action At; s5, training a neural network according to the total overhead Ctotal to obtain a system action for minimizing the total overhead; s6, completing the training ofthe neural network, and carrying out the resource distribution according to the obtained system action enabling the total overhead to be minimized. The invention provides an unmanned aerial vehicle auxiliary resource allocation method based on deep reinforcement learning, and solves the problems of relatively high calculation task time delay and energy consumption of existing industrial Internetof Things intelligent equipment.

Description

technical field [0001] The present invention relates to the technical field of resource allocation optimization, and more specifically, to a UAV-assisted resource allocation method based on deep reinforcement learning. Background technique [0002] Industry is an important field of IoT applications. Various smart devices with environmental awareness, computing models based on ubiquitous technology, and mobile communications are continuously integrated into all aspects of industrial production, which can greatly improve manufacturing efficiency, improve product quality, and reduce Product cost and resource consumption accelerate the transformation of traditional industries to intelligence. [0003] Wireless smart device networks have been widely used in many fields such as field or industry. In these scenarios, smart devices are often limited in terms of battery power due to their small form factor and strict production cost constraints. Relying on traditional energy supply,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q10/06G06N3/04G06K9/62
CPCG06Q10/0631G06Q10/06312G06N3/045G06F18/214
Inventor 郑镐蒋丽陈彬薛龙男
Owner GUANGDONG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products