Unlock instant, AI-driven research and patent intelligence for your innovation.

Multi-UAV and user cooperative communication optimization method based on mappo algorithm

A technology of multiple drones and optimization methods, applied in general control systems, instruments, adaptive control, etc., to achieve the effect of simple steps and reasonable design

Active Publication Date: 2022-02-01
ROCKET FORCE UNIV OF ENG
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The optimization target is limited to UAV or ground access control, and has not been researched from multiple UAVs and multiple user levels

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-UAV and user cooperative communication optimization method based on mappo algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0090] Such as figure 1 Shown is a multi-unmanned aerial vehicle and user collaborative communication optimization method based on the MAPPO algorithm, comprising the following steps:

[0091] Step 1. Establishment of UAV network model and user network model:

[0092] Step 101, set the parameter of the UAV Actor network to φ, and the parameter of the UAV Critic network to ω 1 , the parameter of the user Actor network is θ, and the parameter of the user Critic network is ω 2 ;

[0093] Step 102, setting the initial value of the parameter φ of the UAV Actor network to φ(0), and the parameter ω of the UAV Critic network 1 The initial value of ω 1 (0), the initial value of the parameter θ of the user Actor network is θ(0), and the parameter ω of the user Critic network 2 The initial value of ω 2 (0); where, φ(0), ω 1 (0), θ(0), and ω 2 (0) Satisfy the orthogonal initialization of the neural network;

[0094] Step 2, UAV and user scene setting:

[0095] Step 201, establis...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-UAV and user cooperative communication optimization method based on the MAPPO algorithm, comprising the following steps: 1. Establishment of a UAV network model and a user network model; 2. Setting up UAV and user scenarios; 3. Acquisition of the observation state of the UAV and the user; 4. Acquisition of the global state of the UAV and the user; 5. Acquisition of the rewards of the UAV and the user; 6. Storage of experience tuples; 7. MAPPO algorithm iteratively optimizes the network Parameters of the model; 8. Multi-UAV and multi-user cooperative communication optimization prediction. The invention realizes the optimization of UAV flight azimuth, power, and bandwidth allocation through the optimization of UAV and user network model parameters, and effectively adapts to the observation status of multiple UAVs and multi-users to predict and output reasonable collaborative communication optimization Strategy to maximize communication system throughput and meet the fairness of resource allocation under multi-dimensional decision-making actions.

Description

technical field [0001] The invention belongs to the technical field of unmanned aerial vehicle and user communication, and in particular relates to a multi-unmanned aerial vehicle and user cooperative communication optimization method based on the MAPPO algorithm. Background technique [0002] In the current 5G mobile communication, with the rapid development of various emerging industries, the terrestrial backbone network is under huge data transmission pressure. At the same time, limited by geographical conditions, many remote areas are still in a state of lack of wireless coverage. These unprecedented demands for high-quality wireless communication services pose serious challenges to the current traditional ground communication networks. For this reason, in the future 6G and beyond wireless communication, UAV (Unmanned Aerial Vehicle, UAV) as an air access node to assist ground communication has become a promising solution. [0003] As a flying base station, UAVs have s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G05B13/04
CPCG05B13/042
Inventor 赵建伟吴官翰贾维敏张峰干姜楠王连锋谭力宁金伟金国栋沈涛张聪何芳
Owner ROCKET FORCE UNIV OF ENG