The invention belongs to the technical field of
wireless communication, and discloses a marginal air-ground network optimization method and
system based on hierarchical deep
reinforcement learning (joint optimization method and
system), and the optimization of the marginal air-ground network is realized through joint optimization of a
service placement strategy, UAV
trajectory planning,
access control,
bandwidth allocation and transmission power. And efficient equipment connection and
data processing services are provided for
disaster area rescue, urban intelligent monitoring and other scenes. According to the method, a dual-time-scale optimization strategy is adopted: on a coarse-grained frame-level time scale, a high-level agent adopts a deep Q network (DQN) proxy, and a placement strategy of service in an MEC
server is decided according to a UAV task request to ensure that
resource constraints are met; on the fine-grained time slot level time scale, a low-layer agent adopts an improved depth deterministic policy gradient (IDDPG) for proxy, the UAV trajectory, TDMA-based
access control,
bandwidth allocation proportion and transmission power are optimized, and the real-time task requirement is met. Through the layered framework, the
system can improve the task success rate, the energy efficiency and the
resource scheduling fairness in a dynamic environment, and efficient and stable air-ground integrated
network service is realized.