Multi-UAV Trajectory Control for AoI and Energy Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wireless network infrastructure, including base stations, faces challenges in meeting the stringent requirements of 5G applications such as enhanced mobile broadband, ultra-reliable, and low-latency communications due to limitations in capacity, coverage, and energy efficiency, especially when using unmanned aerial vehicles (UAVs) as aerial base stations.
Innovation Solution
A multiple UAV navigation optimization method using a deep Q-network to maximize energy efficiency and age of information (AoI) in an edge computing environment, where a ground base station calculates and sets conditions for UAV trajectory paths to ensure efficient energy use and data up-to-dateness by employing Q-learning and deep reinforcement learning techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple UAVs are deployed as aerial base stations to expand coverage and capacity, then network coverage and service capacity are improved, but energy consumption increases due to the limited battery capacity of each UAV
Solution Approach 1:
The patent implements dynamic trajectory optimization for UAVs using deep Q-network reinforcement learning. The system continuously adjusts UAV flight paths in real-time based on changing network conditions, user distribution, and energy states. This dynamic adaptation allows UAVs to maximize coverage area while minimizing energy consumption by avoiding redundant movements and optimizing patrol routes according to actual network demands rather than following fixed predetermined paths.
Solution Approach 2:
The system dynamically changes multiple parameters including UAV trajectory coordinates, flight speed, altitude, and communication power transmission levels. By adjusting these parameters in real-time based on network conditions and energy constraints, the system optimizes the balance between coverage area and energy consumption. The deep Q-network learns optimal parameter combinations to maximize network utility while staying within battery capacity limits.
2Speed
If UAVs move quickly to cover trajectory points to improve response time, then service speed is improved, but energy consumption increases and flight duration decreases
Solution Approach 1:
The patent implements dynamic speed adjustment as part of the overall trajectory optimization. The deep Q-network determines optimal flight speeds at different segments of the trajectory based on urgency of service requirements, distance to next target point, current energy level, and time constraints. This dynamic speed control allows UAVs to accelerate when time-critical services are needed and reduce speed during routine patrol segments, optimizing the balance between response time and energy consumption.
3Area of stationary object
If UAVs perform autonomous search and navigation to cover more areas, then network coverage is improved, but the complexity of autonomous control increases
Solution Approach 1:
The patent introduces a ground base station as an intermediary that assists the UAVs in autonomous navigation. The ground station provides reference information, trajectory suggestions, and coordination to multiple UAVs, reducing the computational burden on individual UAVs. This distributed architecture where the ground station handles complex coordination tasks while UAVs execute localized navigation simplifies the overall system complexity while maintaining autonomous operation capabilities and extensive coverage.
Solution Approach 2:
The patent divides the large-scale coverage area into multiple trajectory points or waypoints that UAVs visit sequentially. This segmentation transforms the complex problem of continuous area coverage into a series of simpler navigation tasks between discrete points. The deep Q-network learns optimal sequences of visiting these segmented points, making the autonomous control problem more manageable while still achieving comprehensive area coverage.
4Reliability
If existing base station infrastructure is used to meet 5G requirements, then network stability is maintained, but capacity and coverage are limited
Solution Approach 1:
The patent merges traditional ground-based stationary base stations with mobile UAV aerial base stations to create a hybrid network architecture. This combination allows the system to maintain the stability and reliability of ground infrastructure while adding the mobility, rapid deployment, and extended coverage capabilities of UAVs. The two types of base stations work cooperatively, with UAVs providing supplemental capacity and coverage in areas where ground infrastructure is insufficient or cannot be rapidly deployed.
Data Source
AI summary
According to a technical aspect of the invention, there is provided a multiple unmanned aerial vehicles navigation optimization method is performed at a ground base station which operates in conjunction with unmanned aerial vehicles-base stations which are driven by a battery to move and cover a given trajectory point set, the multiple unmanned aerial vehicles navigation optimization method including: calculating an age-of-information metric by receiving an information update from the unmanned aerial vehicles-base stations through communication, when the ground base station is present within a transmission range of the unmanned aerial vehicles-base stations; setting conditions of a trajectory, energy efficiency, and age of information of each of the unmanned aerial vehicles-base stations; and executing Q-learning for finding a trajectory path policy of each of the unmanned aerial vehicles-base stations, so as to maximize total energy efficiency of an unmanned aerial vehicles-base station relay network to which the energy efficiency and the age of information are applied.According to the invention, the following effects are obtained. Age of information (AoI) that is a new matrix used to measure up-do-dateness of data is set, an edge computing environment for a remote cloud environment is provided by using the AoI, and a computing-oriented communications application can be executed by using the edge computing environment.


