Multi-UAV Coverage Path Planning with Q-Learning Ant Colony Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing path planning methods for unmanned aerial vehicles (UAVs) in cooperative coverage tasks are computationally intensive and complex, struggling with efficiency and robustness, especially in complex environments.

Innovation Solution

A multi-UAV cooperative coverage path planning method using an improved ant colony algorithm with a Q-learning adaptive strategy, involving a memory, image collection device, and UAVs with a path planning module that constructs a 3D model, performs cell division, establishes constraints, and iteratively optimizes paths using pheromone augmentation and adaptive heuristic adjustment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing path planning methods are used for multi-UAV cooperative coverage tasks, then path planning can be performed, but computational complexity increases and efficiency decreases

Engineering Contradiction:
Improvepath planning efficiencyVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the continuous path planning problem into discrete grid cells, transforming the complex continuous optimization problem into a discrete search problem. The search space is segmented into manageable grid units that can be processed independently, reducing computational complexity while maintaining planning efficiency

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the path planning problem by changing parameters from continuous coordinates to discrete grid cell indices. This parameter transformation simplifies the mathematical complexity of path planning while preserving the essential optimization objectives, enabling more efficient computation

Inventive Principle:
Principle #35Parameter changes

2Use of energy by moving object

If existing path planning methods are used for multi-UAV cooperative coverage tasks, then coverage can be achieved, but energy consumption increases

Engineering Contradiction:
ImproveUAV energy consumptionVSAvoidpath planning robustness
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent implements feedback mechanisms where the ant colony algorithm learns from previous path selections and iteratively improves solutions. The pheromone updates provide continuous feedback that guides UAVs toward energy-efficient paths while ensuring reliable coverage, balancing energy consumption with task completion reliability

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces traditional mechanical path planning approaches with a bio-inspired ant colony optimization system. This substitution enables more adaptive and energy-efficient path finding through collective intelligence, reducing overall energy consumption while maintaining robust coverage capabilities

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Speed

If traditional algorithms are used for path optimization, then solutions can be found, but convergence speed is slow

Engineering Contradiction:
Improvealgorithm convergence speedVSAvoidpath optimization precision
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent employs dynamic parameter adjustment where the ant colony algorithm adapts its search behavior during execution. Pheromone evaporation rates and heuristic weights are dynamically adjusted to balance exploration and exploitation, enabling fast convergence while maintaining path optimization precision throughout the iterative process

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250238033A1Multi-unmanned aerial vehicle (UAV) cooperative coverage path planning methods based on improved ant colony algorithm with q-learning adaptive strategy
Publication Date: 2025.07.24 ZHONGYUAN ENGINEERING COLLEGE
  • US20250238033A1 patent drawing
  • US20250238033A1 patent drawing
  • US20250238033A1 patent drawing

AI summary

A system for UAV collaborative coverage path planning based on a Q-learning adaptive ant colony algorithm including a memory, an image collection device, and a plurality of UAVs loaded with a path planning module configured to: construct a 3D model in a collaborative coverage environment, by performing a cell division on the 3D model based on a scanning range of an airborne radar of each UAV, obtain one or more sub-regions; by establishing constraints of the UAV and the environment based on the determined 3D model of the region to be searched, establish a problem total cost model; perform a plurality of rounds of iterations, calculate a reward value of each ant colony and determine whether a maximum iteration count is reached, if the maximum iteration count is reached, enter a new round of iteration, otherwise, output a path corresponding to a current round of iteration as a final path.