Micro-nano unmanned aerial vehicle cluster mutual positioning method and device

Through the relative distance and angle measurement within the drone cluster, combined with self-testing posture and sharing information, the problem of low positioning accuracy of micro-nano drone clusters is solved, and robust and high-precision positioning is achieved, suitable for limited resources. micro-nano drone platform.

CN118980375APending Publication Date: 2024-11-19启元实验室
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411034791.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-30
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

Micro-nano UAV cluster positioning accuracy is low, making it difficult to deploy technologies such as high-precision visual inertial fusion on platforms with limited sensing and computing resources.

Method used

Through the relative distance and angle measurement within the drone cluster, combined with self-testing posture and shared position information, local relative position calculation is performed using the on-board measurement module and pre-trained object detection model, and a distributed delay filter is used and Kalman filters perform data processing and correction.

Benefits of technology

It realizes the independent positioning of robust and high-precision micro-nano UAVs, reduces the use of data transmission resources and low power consumption, and is suitable for micro-nano UAV platforms with limited sensing, communication and computing resources.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118980375A_ABST
    Figure CN118980375A_ABST
Patent Text Reader

Abstract

The invention discloses a micro-nano unmanned aerial vehicle cluster mutual positioning method and device and electronic equipment, and belongs to the technical field of unmanned aerial vehicle positioning, and the method comprises the steps: obtaining the relative distance and relative angle between a positioned micro-nano unmanned aerial vehicle in an unmanned aerial vehicle cluster and other micro-nano unmanned aerial vehicles; obtaining a self-measurement pose of the positioned micro-nano unmanned aerial vehicle through an airborne measurement module of the positioned micro-nano unmanned aerial vehicle; receiving position information shared by other micro-nano unmanned aerial vehicles; and calculating a cluster local relative position of the positioned micro-nano unmanned aerial vehicle based on the relative distance, the relative angle, the self-test pose and the shared position information. According to the method, attitude recognition is carried out through the airborne measurement module, sharing of measurement data of the unmanned aerial vehicle cluster is realized through an inter-vehicle information sharing mechanism, stable and high-precision independent positioning of the micro-nano unmanned aerial vehicle is further realized, the occupation amount of data transmission resources is remarkably reduced, the power consumption is low, the occupied computing power is low, and the method is suitable for large-scale popularization and application. The method is especially suitable for the micro-nano unmanned aerial vehicle with limited sensing, communication and computing resources.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of UAV positioning technology, and specifically relates to a method, device, electronic device and storage medium for mutual positioning of a micro-nano UAV cluster. Background Art

[0002] UAV swarms have increasingly important applications in emergency search and rescue, environmental monitoring, pipe corridors, and power inspections. Among them, UAV swarm positioning technology is the basis and key to swarm control and collaboration. The current UAV swarm positioning methods are divided into two methods: external positioning (or absolute positioning) and internal positioning (or relative positioning). Among them, external positioning is to use devices outside the swarm to locate individuals in the swarm. Generally, methods such as the Global Positioning System (GPS), near-infrared imaging motion capture system, and ground-fixed ultra-wideband (UWB) base stations are used to obtain the absolute position of each individual in the swarm. However, since it requires measurement conditions outside the swarm, its use scenarios are limited. Autonomous positioning uses the relative distance measurement and relative angle measurement information between UAVs to calculate the position of each individual in the swarm. It generally relies on high-precision visual-inertial odometry (VIO), high-power sensors, and high-computing computing platforms, and is difficult to deploy on micro-nano UAV platforms.

[0003] Micro-nano UAVs generally refer to UAVs with a total weight of about 50g to 200g and an overall size of several centimeters to more than ten centimeters. They usually have low energy and power consumption, and only carry sensors with limited resolution and processing systems with limited computing power. Therefore, it is difficult for them to use cluster positioning methods based on technologies such as visual inertial fusion based on high-precision vision and high-computing power computing platforms. Summary of the invention

[0004] The purpose of this application is to provide a micro-nano UAV cluster mutual positioning method, a micro-nano UAV positioning device, an electronic device and a storage medium to solve the problem of low positioning accuracy of micro-nano UAVs.

[0005] According to a first aspect of an embodiment of the present application, a micro-nano UAV cluster mutual positioning method is provided, and the method may include:

[0006] In some optional embodiments of the present application, the relative distance and relative angle between the located micro-nano drone and the other micro-nano drones in the drone cluster are obtained;

[0007] Acquire the self-measured posture of the located micro-nano UAV through the airborne measurement module of the located micro-nano UAV;

[0008] Receiving the location information shared by the remaining micro-nano drones;

[0009] The local relative position of the cluster of the located micro-nano UAVs is calculated based on the relative distance, the relative angle, the self-measured posture and the shared position information.

[0010] In some optional embodiments of the present application, obtaining the relative distance between the located micro-nano drone and other micro-nano drones in the drone cluster includes:

[0011] The relative distance is obtained by measuring the ultra-wideband circuit in the onboard measurement module of the located micro-nano UAV; and / or

[0012] The image data of the drone cluster is collected by a camera in the airborne measurement module of the located micro-nano drone, and the image data is input into a pre-trained target detection model to obtain a detection image with a detection frame, and then the relative distance is calculated based on the width, height and position of the detection frame in the detection image.

[0013] In some optional embodiments of the present application, obtaining the relative angle between the located micro-nano drone and the other micro-nano drones in the drone cluster includes:

[0014] The image data of the drone cluster is collected by a camera in an airborne measurement module of the located micro-nano drone, and the image data is input into a pre-trained target detection model to obtain a detection image with a detection frame;

[0015] The relative angle is calculated based on the detected image and the similar triangle direction finding principle.

[0016] In some optional embodiments of the present application, it also includes:

[0017] Outlier detection is performed on the relative distance and the relative angle based on a Z-score method.

[0018] In some optional embodiments of the present application, obtaining the self-measured posture of the located micro-nano UAV through an airborne measurement module of the located micro-nano UAV includes:

[0019] Measuring the acceleration and angular velocity of the located micro-nano UAV by using the inertial measurement unit of the airborne measurement module;

[0020] Measuring the height of the located micro-nano UAV from the ground by using the laser flight time sensor of the airborne measurement module;

[0021] The acceleration, the angular velocity and the altitude are fused through the extended Kalman filter of the airborne measurement module to obtain the self-measured posture.

[0022] In some optional embodiments of the present application, receiving the location information shared by the remaining micro-nano drones includes:

[0023] The location information is obtained by performing data interaction through the ultra-wideband circuit in the airborne measurement module of the located micro-nano UAV.

[0024] In some optional embodiments of the present application, the local relative position of the cluster of the located micro-nano UAV is calculated based on the relative distance, the relative angle, the self-measured posture and the shared position information, including:

[0025] Constructing a distance measurement cost function with the local relative position as a variable based on the position information and the relative distance;

[0026] Constructing a direction finding cost function with the local relative position as a variable based on the position information and the relative angle;

[0027] Constructing a posture estimation cost function with a local relative position as a variable based on the position information and the self-measured posture;

[0028] Obtain a cost function by weighted summing the distance measurement cost function, the direction finding cost function and the pose estimation cost function;

[0029] The local relative position of the cluster of the located micro-nano UAVs is obtained by minimizing the cost function.

[0030] In some optional embodiments of the present application, the ranging cost function is:

[0031]

[0032] Among them, d k,(i,j) is the relative distance of the remaining drones numbered j measured by the located micro-nano drone numbered i at the kth algorithm step; the set is the set of other micro-nano UAVs within the range of the located micro-nano UAV numbered i; p k,(i) is the local relative position of the located micro-nano UAV numbered i at the kth algorithm step; is the location information shared by the remaining micro-nano UAVs numbered j in the kth algorithm step; Represents two positions p k,(i) and A function of the relative distance between is the ranging cost function of the located micro-nano UAV numbered i;

[0033] The direction finding cost function is:

[0034]

[0035] Among them, θ k,(i,j) is the kth algorithm step, the relative angle of the remaining drones numbered j measured by the located micro-nano drone numbered i; the set is the set of other micro-nano UAVs within the measurement range of the located micro-nano UAV numbered i; Represents two positions p k,(i) and A function of the relative angle between is the direction finding cost function of the located micro-nano UAV numbered i;

[0036] The pose estimation cost function is:

[0037]

[0038] in, The difference between the self-measured posture of the located micro-nano UAV numbered i measured at the kth algorithm step and the self-measured posture of the located micro-nano UAV numbered i measured at the k-1th algorithm step; The pose estimation cost function of the located micro-nano UAV numbered i;

[0039] The cost function is:

[0040]

[0041] Among them, w d , w θ , w o is the weight value; J k,(i) is the cost function of the located micro-nano UAV numbered i.

[0042] In some optional embodiments of the present application, it also includes:

[0043] The distributed delay filter of the located micro-nano UAV is used to perform delay compensation and smoothing filtering on the local relative position of the cluster to obtain a corrected local relative position of the cluster;

[0044] Performing a dispersed drift correction on the self-measured posture based on the corrected local relative position of the cluster to obtain a corrected self-measured posture;

[0045] The corrected local relative position of the cluster and the corrected self-measured posture are sent to the remaining micro-nano drones.

[0046] According to a second aspect of an embodiment of the present application, a micro-nano UAV positioning device is provided, comprising:

[0047] The first acquisition module is used to obtain the relative distance and relative angle between the located micro-nano UAV and other micro-nano UAVs in the UAV cluster;

[0048] A second acquisition module is used to acquire the self-measured posture of the located micro-nano UAV through the airborne measurement module of the located micro-nano UAV;

[0049] A receiving module, used for receiving the location information shared by the remaining micro-nano drones;

[0050] A data processing module is used to calculate the local relative position of the cluster of the located micro-nano UAVs based on the relative distance, the relative angle, the self-measured posture and the shared position information.

[0051] According to a third aspect of an embodiment of the present application, an electronic device is provided, which may include:

[0052] processor;

[0053] a memory for storing processor-executable instructions;

[0054] The processor is configured to execute instructions to implement the method described in any one of the embodiments of the first aspect.

[0055] According to a fourth aspect of an embodiment of the present application, a non-transitory computer-readable storage medium is provided, storing one or more programs, wherein the one or more programs are configured to, when executed by a processor, enable execution of a method as described in any embodiment of the first aspect.

[0056] The above technical solution of the present application has the following beneficial technical effects:

[0057] A micro-nano UAV cluster mutual positioning method provided in an embodiment of the present application performs posture recognition through an airborne measurement module, realizes the sharing of UAV cluster measurement data through an inter-machine information sharing mechanism, and thus realizes robust and high-precision independent positioning of micro-nano UAVs, significantly reduces the occupancy of data transmission resources, has low power consumption, and low computing power occupation, and is particularly suitable for micro-nano UAVs with limited sensing, communication and computing resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 It is a flow chart of a micro-nano UAV cluster mutual positioning method in the first embodiment of the present application;

[0059] Figure 2 It is a flow chart of a micro-nano UAV cluster mutual positioning method in the second embodiment of the present application;

[0060] Figure 3 This is a schematic diagram of the micro-nano UAV hardware platform in an exemplary embodiment of this application.

[0061] Figure 4It is a flowchart of a lightweight cluster relative posture detection method based on end-side monocular vision in an exemplary embodiment of the present application;

[0062] Figure 5 It is a schematic diagram of the EKF fusion process of the self-measured posture in an exemplary embodiment of the present application;

[0063] Figure 6 It is a schematic diagram of a distributed graph optimization solution process on the end side in an exemplary embodiment of the present application;

[0064] Figure 7 is a schematic diagram of a relative position delay filtering process in an exemplary embodiment of the present application;

[0065] Figure 8 It is a structural schematic diagram of a micro-nano UAV positioning device in an exemplary embodiment of the present application;

[0066] Fig. 9 is a schematic diagram of the structure of an electronic device in an exemplary embodiment of the present application;

[0067] Fig.10 It is a schematic diagram of the hardware structure of an electronic device in an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0068] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is further described in detail below in conjunction with specific implementations and with reference to the accompanying drawings. It should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present application. In addition, in the following description, the description of known structures and technologies is omitted to avoid unnecessary confusion of the concepts of the present application.

[0069] The accompanying drawings show schematic diagrams of layer structures according to embodiments of the present application. These figures are not drawn to scale, and some details are magnified and some details may be omitted for the purpose of clarity. The shapes of various regions and layers shown in the figures and the relative sizes and positional relationships therebetween are only exemplary, and may deviate in practice due to manufacturing tolerances or technical limitations, and those skilled in the art may additionally design regions / layers with different shapes, sizes, and relative positions according to actual needs.

[0070] Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0071] In the description of the present application, it should be noted that the terms "first", "second" and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0072] In addition, the technical features involved in the different embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.

[0073] Micro-nano UAVs, i.e. micro UAVs and nano UAVs, usually weigh hundreds of grams or even tens of grams. Micro UAVs can weigh less than 200 grams, and nano UAVs can weigh less than 50 grams. They are sized from decimeters to centimeters, and have the advantages of low cost, strong concealment, flexibility, and easy batch production. Due to size, weight, and power consumption limitations, their sensing, communication, and computing resources are limited. Existing cluster measurement methods are difficult to deploy on micro-nano UAVs, so the demand for new frameworks and methods is increasingly urgent.

[0074] In order to realize fully autonomous and high-precision cluster mutual positioning on a micro-nano UAV platform, the present invention proposes a new cluster collaborative relative measurement method: relying only on the resources within the cluster and under limited sensing and computing conditions, the single-step running speed reaches the millisecond level, the relative position error reaches the centimeter level, and the inter-cluster communication frequency reaches less than tens of Hz.

[0075] In combination with the accompanying drawings, the micro-nano UAV cluster mutual positioning method, micro-nano UAV positioning device, electronic device and storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0076] like Figure 1 As shown, in the first embodiment of the first aspect of the present application, a micro-nano UAV cluster mutual positioning method is provided, and the method may include:

[0077] Step S101: obtaining the relative distance and relative angle between the located micro-nano UAV and other micro-nano UAVs in the UAV cluster;

[0078] Step S102: obtaining the self-measured posture of the located micro-nano UAV through the airborne measurement module of the located micro-nano UAV;

[0079] Step S103: receiving the location information shared by the remaining micro-nano drones;

[0080] Step S104: Calculate the local relative position of the cluster of the located micro-nano UAVs based on the relative distance, the relative angle, the self-measured posture and the shared position information.

[0081] A micro-nano UAV cluster mutual positioning method provided in an embodiment of the present application performs posture recognition through an airborne measurement module, realizes the sharing of UAV cluster measurement data through an inter-machine information sharing mechanism, and thus realizes robust and high-precision independent positioning of micro-nano UAVs, significantly reduces the occupancy of data transmission resources, has low power consumption, and low computing power occupation, and is particularly suitable for micro-nano UAVs with limited sensing, communication and computing resources.

[0082] Embodiment 2 of the present application provides a method for mutual positioning of a micro-nano UAV cluster, which may include:

[0083] Part 1: Each micro-nano UAV obtains the original measurement values ​​of its own airborne relative distance and relative direction sensors, performs outlier detection and preprocessing, and obtains stable and smooth relative distance and relative angle measurement results. Perform preliminary fusion filtering on inertial sensors to achieve self-measurement posture estimation of the micro-nano UAV.

[0084] Part 2: Each micro-nano UAV uses the low-frequency, limited-bandwidth information sharing mechanism within the cluster to obtain the measurement information transmitted by other micro-nano UAV nodes in the cluster (hereinafter referred to as "other nodes"), including the relative position optimization calculation results of the previous algorithm step (corresponding to the local relative position of the cluster in the previous algorithm step of other nodes), ranging and direction finding information, which is used for the micro-nano UAV to perform local relative position calculation of the cluster locally.

[0085] Part 3: Each micro-nano drone uses the local relative distance, relative angle, self-measured posture and shared information obtained from other nodes (including the local relative position of the cluster of other nodes in the previous algorithm step shared by other nodes, that is, shared position information), based on the end-side distributed graph optimization computing architecture and its onboard hardware and software deployment, to build an optimization target cost function and select reasonable cost function weights to perform distributed iterative solutions for the relative position of the cluster. In the end-side distributed graph optimization calculation process, the variable to be optimized is the local relative position of the cluster. The result is shared with other nodes in the next algorithm step.

[0086] Part 4: Each micro-nano UAV performs fusion filtering on the local relative position obtained by optimizing the distributed graph on the end side in Part 3 to further improve the calculation accuracy of the relative position of the cluster. The relative position is compensated for delay and smoothed using a delay filter, and the result is then fused with the self-measured posture of the micro-nano UAV to correct the accumulated drift error of the self-measured posture, thereby reducing the relative position error.

[0087] The corrected relative position results and self-measured posture can be used for cluster collaborative control, so that the cluster has the ability to complete various tasks collaboratively.

[0088] The first part specifically includes:

[0089] (1) For the relative distance and direction measurement results given by the airborne sensors, some historical relative measurement information is used to determine the confidence level of the relative measurement results at the current moment based on statistical methods, and outliers are eliminated.

[0090] (2) The relative measurement sensor information after removing the outliers is subjected to preliminary smoothing filtering to filter out the white noise in the original measurement results.

[0091] (3) For the velocity, acceleration, angular velocity, heading and other information provided by the airborne inertial sensors, the relative displacement between the micro-nano UAV and the initial position is solved by integration, and fusion filtering is performed to reduce the cumulative error caused by the inertial sensor noise.

[0092] The second part specifically includes:

[0093] (1) Before the micro-nano UAV cluster takes off, each UAV is powered on and runs, and communicates to share the local system time. It synchronizes the time according to the received system time of other nodes, and starts sharing data through low-frequency communication at the agreed time.

[0094] (2) In the communication sharing phase, each drone broadcasts some local measurement information including angle measurement information, velocity estimation information, and local relative position solution information of the previous algorithm step at the beginning of the communication cycle. At the same time, the drone will also receive the information shared by other nodes and unpack it for subsequent calculations.

[0095] The third part specifically includes:

[0096] (1) Based on the local relative measurement results and the information shared by other drones described in the second part, each micro-nano drone decomposes the global relative position topology of the cluster, constructs the local relative position topology of the micro-nano drone, and constructs the end-side distributed graph optimization cost function with the sensor residual term.

[0097] Among them (1) include:

[0098] The UAV obtains the position solution result of the previous algorithm step transmitted by other nodes through limited communication, and uses the relative distance measurement value d of UAV i to UAV j at the kth algorithm step k,(i,j) The residual constructs the ranging cost function:

[0099]

[0100] Among them, d k,(i,j) is the relative distance of the remaining drones numbered j measured by the located micro-nano drone numbered i at the kth algorithm step; the set is the set of other micro-nano UAVs within the range of the located micro-nano UAV numbered i; p k,(i)is the local relative position of the located micro-nano UAV numbered i at the kth algorithm step; is the location information shared by the remaining micro-nano UAVs numbered j in the kth algorithm step; Represents two positions p k,(i) and function of the relative distance between them.

[0101] Further relative azimuth measurement value θ k,(i,j) The residual constructs the direction finding cost function:

[0102]

[0103] where θ k,(i,j) represents the relative direction finding result of UAV i to UAV j in the kth algorithm step, that is, in the kth algorithm step, the relative angle of the remaining UAVs numbered j measured by the located micro-nano UAV numbered i, the set represents the set of cooperative target UAVs within the measurement range of UAV i; Represents two positions p k,(i) and function of the relative angle between them.

[0104] Based on the self-test posture results of the drone, a self-test posture cost function is constructed:

[0105]

[0106] in Represents the displacement between the current algorithm step k and the previous algorithm step k-1 given by the self-measured posture.

[0107] Using the above three types of cost functions, construct the final cost function J k,(i) :

[0108]

[0109] where w d , w θ , w o Represents the weight of each cost function. k,(i) Minimize to get the position solution of drone i And calculate the relative position to other nodes.

[0110] (2) The cost function is minimized through a nonlinear optimization framework, thereby iteratively solving the local relative position topology of the cluster. The nonlinear optimization framework has been designed to be lightweight and can be deployed on a micro-nano UAV platform for real-time solution.

[0111] (3) The relative position information obtained by each UAV is shared with other nodes in the next algorithm step, thus iterating the cycle.

[0112] Part IV specifically includes:

[0113] (1) Based on the relative position information between each micro-nano UAV and other UAVs obtained in the third part, each micro-nano UAV uses a distributed delay filter to perform delay compensation and smoothing on the relative position results, thereby reducing the impact of delay, noise and outliers and further improving the relative position accuracy.

[0114] (2) Using the relative position results corrected by time delay filtering obtained in (1), the dispersed drift caused by the accumulated error of the self-measured posture of the micro-nano UAV cluster is corrected. The corrected self-measured posture results are used in the next algorithm step to participate in the distributed graph optimization solution on the end side to achieve iterative improvement of the relative positioning accuracy of the cluster, and to make the self-measured posture update rate reach the frequency required for control.

[0115] The present embodiment provides a micro-nano UAV cluster mutual positioning method, which is used for a micro-nano UAV equipped with a relative measurement module, a communication sharing module, an optimization solution module, and a fusion filter module. The low-power cluster collaborative positioning based on the end-side distributed graph optimization provides a key foundation for the autonomous collaborative flight control of the micro-nano UAV cluster. Distributed inter-machine relative distance measurement is performed through ranging technology, and the relative angle and posture between machines are identified through end-side visual technology. Multi-source information fusion is performed with inertial sensor data, and the cluster collaborative measurement accuracy is improved through a limited inter-machine information sharing mechanism, thereby jointly realizing robust and high-precision cluster autonomous collaborative positioning. Compared with the cluster mutual positioning method in the existing research, the present invention has the characteristics of lightweight, high real-time performance, strong scalability, and low demand for sensing and computing hardware resources. It does not rely on methods such as high-power and high-computing visual inertial odometers, and can be deployed on micro-nano unmanned platforms to achieve high-precision relative measurement using limited sensing and computing resources.

[0116] like Figure 2 As shown, the third embodiment of the present application provides a micro-nano UAV cluster mutual positioning method, and the micro-nano UAV may include a relative measurement module, a communication sharing module, an optimization solution module, and a fusion filtering module. Figure 3 The micro-nano UAV hardware platform shown in the figure is deployed, and the hardware platform consists of a relative measurement unit, a self-measurement posture unit, a data acquisition unit, an intelligent computing unit, a UAV control unit, and a communication unit. The method provided by the present invention includes the following parts:

[0117] Part 1: The micro-nano UAV uses a low-power UWB distributed ranging sensor to perform relative ranging, uses a visual target recognition method based on a lightweight neural network to achieve relative direction finding, and performs outlier detection and preprocessing on the relative ranging and relative direction finding results. In the micro-nano UAV self-measurement posture system, the micro-nano UAV's own acceleration and angular velocity are measured by the consumer-grade IMU (Inertial measurement unit) of the onboard measurement module, and the laser ToF (Time of Flight) of the onboard measurement module is used to measure the height of the UAV from the ground. The EKF (Extended Kalman Filter) based on the onboard measurement module performs a preliminary fusion of the acceleration, angular velocity and height of the above self-measurement posture sensors (including IMU, optical flow and ToF) to obtain the self-measurement posture.

[0118] Part 2: Use UWB communication technology to obtain the measurement information transmitted by other nodes, including the relative position optimization solution results of other nodes in the previous algorithm step (corresponding to the position information of the previous algorithm step shared by other nodes), timestamp, speed, etc., for local cluster relative position calculation.

[0119] Part 3: The micro-nano UAV constructs an optimization target cost function based on the UWB relative ranging residual, the visual relative heading residual and the self-measured posture, and iterates the solution based on the end-side distributed graph optimization architecture. The variable to be optimized is the local relative position of the cluster. The local relative position calculation result is shared with other nodes in the next algorithm step to achieve the collaborative solution of the relative position of the cluster.

[0120] Part 4: Using the information reconstruction-based DEKF (Delay Extended Kalman Filter), the relative measurement results of Part 3 are delayed compensated and smoothed to improve accuracy. The delay filter correction result is fed back to the EKF filter of the self-measured posture, and further integrated with the self-measured posture to correct the cluster dispersion drift.

[0121] The first part specifically includes:

[0122] (1) Deploy UWB ranging sensors on the micro-nano UAV platform and pre-calibrate them before use to compensate for ranging errors caused by temperature, transmission power, etc., to achieve distributed relative ranging.

[0123] (2) Based on the lightweight neural network algorithm, cooperative target detection and relative orientation measurement are realized. The overall algorithm is designed based on the single-stage lightweight target detection framework of the convolutional neural network. First, the training data set is obtained by collecting and annotating drone images at various distances, angles, and flight states; in the model training stage, the public target detection data set is used for pre-training, and then the collected training data set is used for parameter fine-tuning; after the target detection model (i.e., the pre-trained target detection model) is trained, the model is tested, quantized, and deployed. In the inference stage of the model, the input of the model is the RGB image I with a width of w and a height of h collected by the camera in the airborne measurement module. After normalization preprocessing, it is sent to the model for calculation. The output of the model is a number of data sets G containing the center position x, y, width w, height h, and classification probability p of the target detection box. After non-maximum suppression, the position and size of the drone target in the image are obtained. In other words, the image data is input into the pre-trained target detection model to obtain a detection image with a detection box, and then the relative distance is calculated based on the width, height, and position of the detection box in the detection image. In addition, after inputting the image data into the pre-trained target detection model to obtain a detection image with a detection frame, relative angle measurement can also be achieved through the detection image and similar triangle direction finding principle.

[0124] (3) Based on statistical methods such as Z-score, outlier detection is performed on the relative distance and direction measurement results to eliminate outlier interference:

[0125]

[0126] Where c is the measurement value, including the measurement value of relative distance and relative angle, μ is the average value of measurement within a period of time, and σ is the standard deviation. For the sensor output result at each moment, the Z value and the relative measurement information of a small number of historical moments are obtained using the above formula to determine its confidence, wherein the relative measurement information of a small number of historical moments is information determined based on one or more Z values ​​obtained in the previous measurement process, which can be the average value, maximum value, etc. of one or more X values ​​obtained previously. For example, it can be the relative measurement information of the historical moments based on the previous 5 time steps, and this application does not impose any restrictions on this. For example, the Z value threshold of the relative measurement information of a small number of historical moments is set to 3. If |Z|>3, it means that the current measurement result is most likely an abnormal value and can be excluded.

[0127] (4) Using the combination of IMU, optical flow and ToF, EKF is applied to estimate the pose information of the micro-nano UAV itself, such as Figure 5 The self-measurement posture system outputs the position and speed information of the UAV, meeting the microsystem constraints of low power consumption and low computing power.

[0128] Among them, the EKF prediction process is as follows:

[0129] The micro-nano UAV's own posture variable is defined as

[0130] x=[p,v,q,a b ,ω b ,g] T (6)

[0131] Where p is the three-dimensional position of the drone in space, v is the three-dimensional velocity, q is the attitude of the drone expressed in quaternion, and a b is the accelerometer offset, ω b is the gyroscope offset and g is the acceleration due to gravity.

[0132] Predict its own posture based on the IMU pre-integration model:

[0133]

[0134] Among them, a m and ω m is the measurement of acceleration and angular velocity, and Δt represents the time difference or time interval.

[0135] The measurement results of optical flow and ToF are used as quantitative measurements and updated in EKF:

[0136]

[0137] Where K is the Kalman gain, P is the covariance matrix, H is the measurement matrix, V is the measurement noise matrix, z is the measurement, and h(x) is the measurement function. After the measurement update, the self-measured pose is obtained, which is used for the subsequent relative position optimization solution and as the initial value of the self-measured pose in the next algorithm step.

[0138] The second part specifically includes:

[0139] (1) Use the data transmission function of the onboard UWB module for inter-cluster communication and sharing. Before the micro-nano UAV cluster takes off, each drone is powered on and runs, and the communication shares the local system time. Time synchronization is performed based on the information received from other nodes. After the time synchronization is completed, low-frequency communication and data sharing begin at the agreed time.

[0140] (2) A mesh topology is used to network the cluster, and fast communication can be achieved between nodes. The drone is connected to the UWB module through a serial port, and the airborne data flows to the UWB module through the serial port. The data is transmitted to other UWB nodes through the self-organizing network communication between UWB modules, and then sent to other drones through the serial port, thereby realizing data interaction between drones. The shared data includes frame header, node ID, position (shared position information), speed (including angular velocity and acceleration), ranging, angle measurement, reserved instructions, etc., with a total of less than 100 bytes. Using the data transmission function of the UWB module, the communication rate is 78.125Kpbs. The information sharing frequency between clusters is set to 10Hz.

[0141] The third part specifically includes:

[0142] (1) Figure 5 As shown in Figure 1, each micro-nano UAV is based on the local UWB ranging results or visual ranging results, visual direction finding results and self-measured posture results, as shown in Figure 1. Figure 6 As shown in the figure, combined with the information shared by other drones, the global relative position topology map of the cluster is decomposed, the local relative position topology map is constructed, and the end-side distributed graph optimization cost function is constructed with the sensor residual term.

[0143] Relative distance measurement using UWB Construct the ranging residual cost function:

[0144]

[0145] Direction finding results using monocular vision Construct the direction finding residual cost function:

[0146]

[0147] Use the self-test pose results of the drone to construct the self-test pose cost function:

[0148]

[0149] Using the above three types of cost functions, construct the final cost function J k,(i) :

[0150]

[0151] (2) L-BFGS (Limited-memory Broyden–Fletcher–Goldfarb–Shann, BFGS algorithm under memory constraints) is used to perform distributed solution of the graph optimization cost function constructed in (1). L-BFGS can be used to solve large unconstrained optimization problems, and compared with the BFGS algorithm, it reduces the amount of historical information storage through approximate calculations. It can be deployed on micro-nano drones with limited computing unit resources, improving the real-time performance of cluster relative position solution.

[0152] (3) The relative position information (relative position in the cluster) of each drone obtained by L-BFGS is shared with other nodes through UWB module communication in the next algorithm step, thus iterating the cycle.

[0153] Part IV includes:

[0154] (1) Figure 7 As shown, the relative position obtained in the third part is fused and filtered based on the DEKF method to compensate for delay, improve accuracy and update rate. Under the premise that the delay is fixed and known, the state error between the two with and without communication delay is compensated to obtain more accurate positioning information. In the gap between the updates of the distributed graph optimization results on the end side, the relative speed information of the cluster is used for prediction to achieve the fusion of prediction and measurement, which is conducive to eliminating interference and outliers and improving the accuracy of relative position estimation.

[0155] DEKF prediction process:

[0156]

[0157] in is the relative pose of the kth algorithm step, P k is the covariance matrix, A k is the state transfer matrix, Q k is the process noise matrix, G k is the process noise transfer matrix.

[0158] DEKF delay compensation link:

[0159]

[0160] Where K k-i is the DEKF Kalman gain, H k is the measurement matrix, is the quantity measurement of the sth algorithm step (the algorithm step where the delay occurs), is the estimated delay error.

[0161] DEKF measurement update link:

[0162]

[0163] P k+1 =(IK k+1 H k+1 ) k+1|k (20)

[0164] Where R k is the measurement noise matrix, is the relative pose output after filtering.

[0165] The relative position result after delay filtering (delay compensation and smoothing filtering) is used to correct the self-measured posture sensor, thereby achieving iterative improvement of accuracy. Among them, the self-measured posture sensors are mainly IMU and optical flow, and their output has obvious drift. The relative position estimation result is transformed into a coordinate system that is consistent with the self-measured posture coordinate system, and then integrated into the EKF of the self-measured posture as a quantitative measurement to achieve correction of the dispersed drift between clusters.

[0166] This embodiment proposes a lightweight cluster collaborative mutual positioning method suitable for micro-nano unmanned system clusters. Compared with the existing research solutions, this embodiment has the characteristics of lightweight, strong real-time performance, and strong scalability. It can meet the resource constraints of sensors, power consumption, computing power, communication, size, etc. of micro-nano unmanned platforms. It can achieve cluster collaborative measurement accuracy improvement based on the end-side distributed graph optimization method, and can get rid of the dependence of micro-nano unmanned system clusters on external positioning and realize fully autonomous flight of the cluster.

[0167] like Figure 8 As shown, in a second aspect of the embodiment of the present application, a micro-nano UAV positioning device is provided, comprising:

[0168] The first acquisition module 11 is used to obtain the relative distance and relative angle between the located micro-nano UAV and other micro-nano UAVs in the UAV cluster;

[0169] The second acquisition module 12 is used to obtain the self-measured posture of the located micro-nano UAV;

[0170] A receiving module 13 is used to receive the location information shared by other micro-nano drones;

[0171] The data processing module 14 is used to calculate the local relative position of the cluster of located micro-nano UAVs based on the relative distance, relative angle, self-measured posture and shared position information.

[0172] Alternatively, if Fig. 9As shown, an embodiment of the present application also provides an electronic device 1100, including a processor 1101, a memory 1102, and a program or instruction stored in the memory 1102 and executable on the processor 1101. When the program or instruction is executed by the processor 1101, each process of the above-mentioned micro-nano UAV positioning method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0173] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0174] Fig.10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0175] The electronic device 1200 includes but is not limited to: a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210 and other components.

[0176] Those skilled in the art will appreciate that the electronic device 1200 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1210 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.10 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0177] It should be understood that in the embodiment of the present application, the input unit 1204 may include a graphics processor (Graphics Processing Unit, GPU) 12041 and a microphone 12042, and the graphics processor 12041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1207 includes a touch panel 12071 and other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include two parts: a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 1209 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 1210 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1210.

[0178] The embodiment of the present application also provides a non-temporary computer-readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by the processor, the various processes of the above-mentioned micro-nano UAV positioning method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0179] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0180] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned micro-nano UAV positioning method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0181] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0182] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0183] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0184] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A micro-nano UAV cluster mutual positioning method, characterized in that: include: Obtain the relative distance and relative angle between the located micro-nano UAV and other micro-nano UAVs in the UAV cluster; Acquire the self-measured posture of the located micro-nano UAV through the airborne measurement module of the located micro-nano UAV; Receiving the location information shared by the remaining micro-nano drones; The local relative position of the cluster of the located micro-nano UAVs is calculated based on the relative distance, the relative angle, the self-measured posture and the shared position information.

2. The method according to claim 1, characterized in that Obtain the relative distance between the located micro-nano UAV and other micro-nano UAVs in the UAV cluster, including: The relative distance is obtained by measuring the ultra-wideband circuit in the onboard measurement module of the located micro-nano UAV; and / or The image data of the drone cluster is collected by a camera in the airborne measurement module of the located micro-nano drone, and the image data is input into a pre-trained target detection model to obtain a detection image with a detection frame, and then the relative distance is calculated based on the width, height and position of the detection frame in the detection image.

3. The method according to claim 1 or 2, characterized in that: Obtain the relative angle between the located micro-nano UAV and the other micro-nano UAVs in the UAV cluster, including: The image data of the drone cluster is collected by a camera in an airborne measurement module of the located micro-nano drone, and the image data is input into a pre-trained target detection model to obtain a detection image with a detection frame; The relative angle is calculated based on the detected image and the similar triangle direction finding principle.

4. The method according to claim 1, characterized in that: Also includes: Outlier detection is performed on the relative distance and the relative angle based on a Z-score method.

5. The method according to claim 1, characterized in that The step of obtaining the self-measured posture of the located micro-nano UAV through the airborne measurement module of the located micro-nano UAV includes: Measuring the acceleration and angular velocity of the located micro-nano UAV by using the inertial measurement unit of the airborne measurement module; Measuring the height of the located micro-nano UAV from the ground by using the laser flight time sensor of the airborne measurement module; The acceleration, the angular velocity and the altitude are fused through the extended Kalman filter of the airborne measurement module to obtain the self-measured posture.

6. The method according to claim 1, characterized in that The receiving the location information shared by the remaining micro-nano drones includes: The location information is obtained by performing data interaction through the ultra-wideband circuit in the airborne measurement module of the located micro-nano UAV.

7. The method according to claim 1, characterized in that The calculating the local relative position of the cluster of the located micro-nano UAVs based on the relative distance, the relative angle, the self-measured posture and the shared position information includes: Constructing a distance measurement cost function with the local relative position as a variable based on the position information and the relative distance; Constructing a direction finding cost function with the local relative position as a variable based on the position information and the relative angle; Constructing a posture estimation cost function with a local relative position as a variable based on the position information and the self-measured posture; Obtain a cost function by weighted summing the distance measurement cost function, the direction finding cost function and the pose estimation cost function; The local relative position of the cluster of the located micro-nano UAVs is obtained by minimizing the cost function.

8. The method according to claim 7, characterized in that The ranging cost function is: Among them, d k,(i,j) is the relative distance of the remaining UAVs numbered j measured by the located micro-nano UAV numbered i at the kth algorithm step; the set is the set of other micro-nano UAVs within the range of the located micro-nano UAV numbered i; p k,(i) is the local relative position of the located micro-nano UAV numbered i at the kth algorithm step; is the location information shared by the remaining micro-nano UAVs numbered j at the kth algorithm step; Represents two positions p k,(i) and A function of the relative distance between is the ranging cost function of the located micro-nano UAV numbered i; The direction finding cost function is: Among them, θ k,(i,j) is the kth algorithm step, the relative angle of the remaining drones numbered j measured by the located micro-nano drone numbered i; the set is the set of other micro-nano UAVs within the measurement range of the located micro-nano UAV numbered i; Represents two positions p k,(i) and A function of the relative angle between is the direction finding cost function of the located micro-nano UAV numbered i; The pose estimation cost function is: in, The difference between the self-measured posture of the located micro-nano UAV numbered i measured at the kth algorithm step and the self-measured posture of the located micro-nano UAV numbered i measured at the k-1th algorithm step; The pose estimation cost function of the located micro-nano UAV numbered i; The cost function is: Among them, w d , w θ , w o is the weight value; J k,(i) is the cost function of the located micro-nano UAV numbered i.

9. The method according to claim 1, characterized in that: Also includes: The distributed delay filter of the located micro-nano UAV is used to perform delay compensation and smoothing filtering on the local relative position of the cluster to obtain a corrected local relative position of the cluster; Performing a dispersed drift correction on the self-measured posture based on the corrected local relative position of the cluster to obtain a corrected self-measured posture; The corrected local relative position of the cluster and the corrected self-measured posture are sent to the remaining micro-nano drones.

10. A micro-nano UAV positioning device, characterized in that: include: The first acquisition module is used to obtain the relative distance and relative angle between the located micro-nano UAV and other micro-nano UAVs in the UAV cluster; A second acquisition module is used to acquire the self-measured posture of the located micro-nano UAV through the airborne measurement module of the located micro-nano UAV; A receiving module, used for receiving the location information shared by the remaining micro-nano drones; A data processing module is used to calculate the local relative position of the cluster of the located micro-nano UAVs based on the relative distance, the relative angle, the self-measured posture and the shared position information.

11. An electronic device, characterized in that: include: processor; A memory for storing programs or instructions that can be run on the processor, wherein the program or instructions, when executed by the processor, implements the method according to any one of claims 1 to 9. 12 . A non-transitory computer-readable storage medium storing one or more programs configured to, when executed by a processor, cause the method of claim 1 to be performed.

Citation Information

Cited By

  • Multi-agent relative positioning method and device fusing UWB and VIO

    CN119644242A