Multi-radar omnidirectional detection method for inertial navigation system of unmanned aerial vehicle

By compressing and detecting radar data, combined with track conditions, the accuracy and all-round perception of multi-radar omnidirectional detection in the inertial navigation system of the UAV is solved, and the blind spot problem of environmental impact is ensured that no one is allowed is safe flight of the aircraft.

CN119001659AActive Publication Date: 2024-11-22MICROBRAIN INTELLIGENT LTD

Patent Information

Application Number
CN202411492247.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-24
Publication Date
2024-11-22
Estimated Expiration
2044-10-24

AI Technical Summary

Technical Problem

In the existing drone inertial navigation systems, the multi-radar omnidirectional detection results are susceptible to the environment, resulting in blind spots and signal attenuation in complex mountainous environments, and the inability to achieve all-round obstacle identification and obstacle avoidance.

Method used

By compressing the original radar data, two-dimensional frequency domain data is obtained, constant false alarm rate detection and point cloud clustering are carried out, targets are judged and tracked based on track start conditions, multi-dimensional omnidirectional track point data are spliced, and radar output is obtained Distance and self-avoidance obstacle avoidance is judged, and omnidirectional detection is achieved using multi-radar data fusion.

Benefits of technology

More accurate multi-radar omnidirectional detection is achieved, the drone's perception ability on complex environments is enhanced, the impact of detection blind spots and signal attenuation is reduced, and the drone's safe flight is ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119001659A_ABST
    Figure CN119001659A_ABST
Patent Text Reader

Abstract

The invention discloses a multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system, and relates to the technical field of radar detection. The multi-radar omnidirectional detection method of the unmanned aerial vehicle inertial navigation system comprises the following steps: S1, obtaining a point cloud detection result; s2, acquiring target data; s3, target tracking judgment; and S4, performing autonomous obstacle avoidance judgment. Two-dimensional frequency domain data is obtained by compressing radar original data, a point cloud detection result is obtained accordingly, then whether a target is tracked or not is judged based on the point cloud detection result and a track starting condition, and whether target data is updated or not and a track is maintained or not is judged based on a correlation result of point cloud and the track. And finally, multi-dimensional omnidirectional track point data is obtained according to the radar data, and whether autonomous obstacle avoidance is performed or not is judged based on the obtained radar output distance and the preset safety distance, so that the effect of more accurately performing multi-radar omnidirectional detection is achieved, and the problem that the multi-radar omnidirectional detection result is greatly influenced by the environment in the prior art is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of radar detection technology, and in particular to a multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system. Background Art

[0002] With the rapid development of drones, industry-level drones have begun to be widely used in various fields, among which drones play a very important role in plant protection. When working continuously over a large area in complex environments such as steep mountainous areas, drones are prone to accidents due to obstacles such as wires, hillsides and trees. The method proposed in this application integrates radar data from six directions: front, back, left, right, up and down, and then obtains two-dimensional frequency domain data through compression, and then performs constant false alarm rate detection to obtain point cloud detection results, forming multi-dimensional omnidirectional detection, achieving comprehensive perception of the surrounding environment, and not being affected by ambient light and dust. It feeds back information such as the relative distance, azimuth and altitude between obstacles and radars, and guides the drone system to autonomously avoid obstacles, thereby achieving true omnidirectional safety protection.

[0003] The invention patent with publication number CN115033026A in the prior art discloses a millimeter-wave radar obstacle avoidance and altitude determination method for a side-mounted UAV equipped with a gimbal, which pre-processes the radar raw data; outputs three-dimensional target point cloud data after processing with a high-precision radar angle resolution algorithm; performs a segmentation operation on the point cloud in the entire area, and uses the point cloud near negative 45 degrees as an obstacle avoidance processing area, and the point cloud near positive 45 degrees as an altitude determination processing area; detects and tracks the three-dimensional point cloud data in the obstacle avoidance processing area, and forms an obstacle avoidance distance track if the point cloud of several consecutive frames matches its speed, otherwise the track is cleared; calculates the UAV altitude determination data in the altitude determination source point cloud cluster; and performs fusion processing on the data results to realize the omnidirectional detection function of a single radar.

[0004] For example, the invention patent with publication number: CN115980742B discloses a radar detection method and device for unmanned aerial vehicles. The method obtains the current flight information of the UAV through a first radar, and regularly uploads the current flight information data to a central controller for monitoring and early warning. When the current flight information is analyzed by the central controller and it is determined that the UAV has deviated from its flight course, a deviation alarm instruction of the UAV is sent to the second radar. The second radar obtains the simulated yaw planning information of the UAV based on the yaw position of the UAV. The second radar sends the simulated yaw planning information of the UAV to the UAV, and the UAV performs flight navigation according to the simulated yaw planning information.

[0005] For example, the invention patent with publication number: CN113820709B discloses a wall-penetrating radar detection system and detection method based on a drone, including: a drone, an environment sensing unit, a wall-penetrating radar, a gimbal and a control unit; the drone, the environment sensing unit, the wall-penetrating radar and the gimbal are all connected to the control unit; the wall-penetrating radar is located on the drone, and is used to detect the external structure, internal structure and internal personnel of the building to be tested; the environment sensing unit is located on the drone, and is used to sense the flight environment information of the drone, and send the flight environment information to the control unit; the control unit controls the flight of the drone according to the flight environment information, so that the distance between the drone and the outer wall is kept within a certain range; the gimbal is located on the drone, and the transceiver antenna of the wall-penetrating radar is located on the gimbal, and the control unit controls the movement of the gimbal according to the flight environment information so that the array surface of the transceiver antenna remains parallel to the outer wall.

[0006] However, the inventors of this application found that the above technology has at least the following technical problems in the process of implementing the technical solution of the invention in the embodiment of this application: In the existing technology, usually a single radar (such as a side-mounted millimeter-wave radar) mounted on the gimbal of the drone and the gimbal adjustment capability are used to achieve accurate detection and height measurement of obstacles in front, which improves the altitude determination capability of the drone and is suitable for drone systems with high requirements for obstacle avoidance and altitude determination. However, its data source is relatively single, mainly focusing on the obstacle information in front of the drone, and its comprehensive perception capability of the surrounding environment is limited. In a complex mountainous environment, power lines, hillsides and trees may block radar signals, resulting in detection blind spots, and dust, haze, rain and snow and other meteorological conditions in the mountainous environment will cause radar signals to attenuate, and there is a problem that the omnidirectional detection results of multiple radars are greatly affected by the environment. Summary of the invention

[0007] The embodiment of the present application solves the problem in the prior art that the multi-radar omnidirectional detection results are greatly affected by the environment by providing a multi-radar omnidirectional detection method for an unmanned aerial vehicle inertial navigation system, thereby achieving more accurate multi-radar omnidirectional detection.

[0008] The embodiment of the present application provides a multi-radar omnidirectional detection method for an unmanned aerial vehicle inertial navigation system, comprising the following steps: S1, compressing the collected radar raw data to obtain two-dimensional frequency domain data, accumulating the two-dimensional frequency domain data and performing constant false alarm rate detection to obtain a point cloud detection result, wherein the compression includes one-dimensional compression and two-dimensional compression; S2, classifying the point cloud to obtain a point cloud clustering result, obtaining target data according to the point cloud clustering result, and classifying the obstacle target to be detected according to the target data to obtain a target classification result, wherein the obstacle target to be detected represents an obstacle in the flight direction of the unmanned aerial vehicle; S3, judging whether to track the obstacle target to be detected based on the point cloud detection result and the track starting condition, and judging whether to update the target data and maintain the track based on the association result of the point cloud and the track, and if the point cloud and the track are not successfully associated, only saving the historical data; S4, splicing the radar data to obtain multi-dimensional omnidirectional track point data, and obtaining the radar output distance in combination with the flight direction of the unmanned aerial vehicle, and judging whether to perform autonomous obstacle avoidance based on the radar output distance and the preset safety distance.

[0009] Furthermore, the specific process of the constant false alarm rate detection is as follows: performing a one-dimensional Fourier transform on the radar raw data to obtain the one-dimensional range image data of the radar; performing a two-dimensional Fourier transform on the one-dimensional range image data to obtain the two-dimensional frequency domain data; dividing the target signal into a preset number of detection windows according to the result of accumulating the two-dimensional frequency domain data, obtaining the background noise signal through the neighborhood area of ​​the detection window, and obtaining the detection threshold according to the background noise signal; judging whether the target signal to be detected in the detection window exceeds the detection threshold, if the target signal to be detected exceeds the detection threshold, it is determined to be the target signal, otherwise it is determined to be noise.

[0010] Furthermore, the specific method for obtaining the point cloud detection result is as follows: input the radar data into the radar coordinate system, and convert the radar coordinate system into the drone coordinate system, and input the target point cloud coordinates into the drone coordinate system to obtain the point cloud detection result.

[0011] Furthermore, the specific method for obtaining the association result of the point cloud and the track is as follows: compare the point cloud coordinates and radial velocity with the coordinates and radial velocity of each track, and determine whether the first coordinate difference, the second coordinate difference, the third coordinate difference and the speed difference are not greater than the preset difference threshold; if the first coordinate difference, the second coordinate difference, the third coordinate difference and the speed difference are not greater than the preset difference threshold, it indicates that the point cloud is successfully associated with the track, otherwise it indicates that the association fails; the first coordinate difference represents the difference between the horizontal coordinate of the point cloud and the horizontal coordinate of the track; the second coordinate difference represents the difference between the vertical coordinate of the point cloud and the vertical coordinate of the track; the third coordinate difference represents the difference between the vertical coordinate of the point cloud and the vertical coordinate of the track; the speed difference represents the difference between the radial velocity and the radial velocity of the track.

[0012] Furthermore, the specific process of judging whether to update the target data and maintain the track based on the association result of the point cloud and the track is as follows: judging whether the point cloud and the track are successfully associated, if the point cloud and the track are successfully associated, updating the target data and maintaining the track according to the system state vector, otherwise judging whether the cumulative number of frames reaches the preset frame number requirement, if the cumulative number of frames reaches the preset frame number requirement, updating the target data and maintaining the track according to the system state vector, otherwise only saving the historical data; combining each tracked track to obtain the mean of the associated target data, and obtaining the system state vector, the update error covariance and the update prediction error covariance according to the measurement error between the tracked track state estimate and the target data mean.

[0013] Furthermore, the updating of target data and maintaining the track also includes: B1, associating the point cloud and the target bounding box, determining whether the target point cloud coordinates and radial velocity are within the associated threshold, if the target point cloud coordinates and radial velocity are not within the associated threshold, performing a deletion operation, otherwise retaining the tracking track; B2, determining whether there is data associated with the radar ID and measurement ID associated with the previous frame in the point cloud data of the current frame, if so, updating the target data according to the point cloud data of the current frame, otherwise executing B3; B3, searching for obstacle targets to be detected within the associated threshold, determining whether there is an associated measurement, if there is no associated measurement, executing B4, otherwise determining whether there is a unique associated measurement, if there is a unique associated measurement, updating the target data according to the associated measurement, otherwise comparing the point cloud data of the current frame with the associated measurement to obtain a measurement score, and updating the target data according to the measurement score corresponding to the minimum measurement score obtained by arranging the measurement scores in descending order; B4, adjusting the radial velocity association threshold step by step, re-searching for obstacle targets to be detected within the associated threshold, and determining whether Whether there is an associated measurement, if there is no associated measurement, execute B5, otherwise determine whether there is a unique associated measurement, if there is a unique associated measurement, update the target data according to the associated measurement, otherwise compare the point cloud data of the current frame with the associated measurement to obtain a measurement score, and update the target data according to the measurement score arranged in descending order to obtain the measurement corresponding to the minimum measurement score; B5, adjust the CFAR energy threshold step by step and search for targets on the range Doppler heat map to determine whether there is an associated measurement, if there is no associated measurement, update the fusion target through the system state vector and accumulate the measurement loss time, if the measurement loss time exceeds the preset time, delete the obstacle target to be detected, otherwise determine whether there is a unique associated measurement, if there is a unique associated measurement, update the target data according to the associated measurement, otherwise compare the point cloud data of the current frame with the associated measurement to obtain the degree of association, arrange the degree of association in ascending order to obtain the maximum degree of association, and update the target data according to the measurement corresponding to the maximum degree of association, the measurement loss time indicates the number of frames where the radar data is not successfully associated.

[0014] Furthermore, the specific method for acquiring the multi-dimensional omnidirectional track point data is as follows: E1, receiving and storing radar data within a preset time period, determining whether the stored radar data exceeds the queue length, if the stored radar data exceeds the queue length, deleting the queue head data and storing the unstored radar data at the queue tail, otherwise storing the radar data and executing E2; E2, splicing the time-continuous track point data to obtain omnidirectional detection data, the time-continuous track point data represents the track point data of continuous frames in the time dimension; E3, splicing the space-continuous track point data to obtain overlapping parts, transforming the track point data into the track coordinate system according to the radar illumination angle and position to obtain multi-dimensional detection data, the space-continuous track point data represents the track point data of continuous frames in the space dimension; E4, integrating the track point data according to the omnidirectional detection data and the multi-dimensional detection data to obtain multi-dimensional omnidirectional track point data.

[0015] Furthermore, the specific method for obtaining the radar output distance is as follows: obtain the flight direction of the drone at the current moment, and at the same time obtain the corresponding unique identifier based on the track point in the track point coordinate system, wherein the unique identifier includes the ID of the track point and the corresponding radar number; determine whether there is a track point in the flight direction of the drone, if there is no track in the flight direction of the drone, output the track point as the first identifier, otherwise output the track point as the second identifier and output the radar output distance and speed information.

[0016] Furthermore, the method of obtaining the current flight direction of the UAV also includes: obtaining the inclination data of the UAV in various directions at the current moment by reading the posture information of the UAV when flying in the air; compiling the inclination data into an electronic signal by a compiler in the UAV flight control system, and transmitting it to the single-chip microcomputer in the UAV flight control system in real time; obtaining a compensation angle according to the inclination data of the UAV in various directions at the current moment, and performing track point coordinate system compensation processing on the UAV according to the obtained compensation angle.

[0017] Furthermore, the specific process of the autonomous obstacle avoidance is as follows: the speed of the driving motor of each blade of the drone is controlled according to the radar output distance, and it is determined whether the radar output distance is less than the preset safety distance. If the radar output distance is less than the preset safety distance, the flight action is interrupted and the brakes are applied. At the same time, the radar output distance and relative radar movement speed are output in real time through the drone ground station display, otherwise no processing is performed.

[0018] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. The two-dimensional frequency domain data is obtained by compressing the original radar data, and the point cloud detection result is obtained based on it. Then, based on the point cloud detection result and the track starting condition, it is judged whether to track the target. Finally, the radar data is spliced ​​to obtain multi-dimensional omnidirectional track point data, and the radar output distance is obtained based on it. Based on the radar output distance and the preset safety distance, it is judged whether to perform autonomous obstacle avoidance, so as to more accurately identify and detect the target, and then more accurately perform multi-radar omnidirectional detection, which effectively solves the problem that the multi-radar omnidirectional detection results in the prior art are greatly affected by the environment; 2. By receiving and storing radar data within a preset time period, the time-continuous track point data is spliced ​​to obtain omnidirectional detection data, and then the spatial continuous track point data is spliced ​​to obtain the overlapping part, and the multi-dimensional detection data is obtained by transforming the track point data into the track coordinate system according to the radar illumination angle and position. Finally, the multi-dimensional omnidirectional track point data is obtained according to the omnidirectional detection data and the multi-dimensional detection data, so as to more comprehensively describe the motion state of the target, thereby realizing multi-dimensional omnidirectional detection; 3. By reading the attitude information of the UAV when it is flying in the air, the inclination data of the UAV in all directions at the current moment is obtained, the inclination data is compiled into an electronic signal, and transmitted to the single-chip microcomputer in the UAV flight control system in real time. The compensation angle is obtained according to the inclination data of the UAV in all directions at the current moment, and the UAV track point coordinate system is compensated according to the obtained compensation angle, so as to accurately obtain the inclination data of the UAV, thereby achieving more accurate radar angle measurement and ranging. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 A flow chart of a multi-radar omnidirectional detection method for an unmanned aerial vehicle inertial navigation system provided in an embodiment of the present application; Figure 2 A schematic diagram of coordinate changes for converting a radar coordinate system into a drone coordinate system provided in an embodiment of the present application; Figure 3 A flowchart of specific implementation steps of a multi-radar omnidirectional detection method for an unmanned aerial vehicle inertial navigation system provided in an embodiment of the present application; Figure 4 A flowchart of the autonomous obstacle avoidance operation of the drone system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] The embodiment of the present application solves the problem in the prior art that the results of multi-radar omnidirectional detection are greatly affected by the environment by providing a multi-radar omnidirectional detection method for an unmanned aerial vehicle inertial navigation system. Two-dimensional frequency domain data is obtained by compressing the original radar data, and point cloud detection results are obtained based on the data. Then, based on the point cloud detection results and the track starting conditions, it is determined whether to track the target. Finally, the radar data is spliced ​​to obtain multi-dimensional omnidirectional track point data, and the radar output distance is obtained based on the data. Based on the data, it is determined whether to perform autonomous obstacle avoidance, thereby achieving more accurate multi-radar omnidirectional detection.

[0021] The technical solution in the embodiment of the present application is to solve the problem that the multi-radar omnidirectional detection results are greatly affected by the environment. The overall idea is as follows: Whether to track the target is determined by the point cloud detection results and the track starting conditions. At the same time, whether to perform autonomous obstacle avoidance is determined based on the radar output distance and the preset safety distance, achieving a more accurate multi-radar omnidirectional detection effect.

[0022] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0023] like Figure 1 As shown, it is a flow chart of a multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system provided by an embodiment of the present application, and the method comprises the following steps: comprising the following steps: S1, compressing the collected radar raw data to obtain two-dimensional frequency domain data, and accumulating the two-dimensional frequency domain data and performing constant false alarm rate detection to obtain a point cloud detection result, the compression includes one-dimensional compression and two-dimensional compression, and the obstacle target to be detected represents the obstacle in the flight direction of the unmanned aerial vehicle; S2, classifying the point cloud to obtain a point cloud clustering result, obtaining target data according to the point cloud clustering result, and classifying the obstacle target to be detected according to the target data to obtain a target classification result, the point cloud represents the spatial position of the millimeter wave radar target, and the target data includes the target position, the number of point clouds, the length, the width, Height, volume, projected area, radar cross section and signal-to-noise ratio. The obstacle target to be detected represents the obstacle in the flight direction of the UAV; S3, based on the point cloud detection results and the track starting conditions, determine whether to track the obstacle target to be detected, and based on the association results of the point cloud and the track, determine whether to update the target data and maintain the track. If the point cloud and the track are not successfully associated, only save the historical data; S4, splice the radar data to obtain multi-dimensional omnidirectional track point data, and combine the flight direction of the UAV to obtain the radar output distance. Based on the radar output distance and the preset safety distance, determine whether to perform autonomous obstacle avoidance. The radar data includes the data of the front radar, rear radar, left radar, right radar, upper radar and lower radar. The radar output distance represents the distance to the nearest track point of the UAV.

[0024] In this embodiment, in radar signal processing, compression means converting the original echo signal into a frequency domain signal through Fourier transform technology, reducing the amount of data and improving signal processing efficiency; one-dimensional compression means extracting the distance information of the obstacle target to be detected through one-dimensional Fourier transform; two-dimensional compression means converting the two-dimensional signal from the spatial domain to the frequency domain through two-dimensional Fourier transform to extract two-dimensional frequency domain data; the arrival direction estimation algorithm is used to obtain the target point cloud coordinates through the phase difference formed between the obstacle target to be detected and the two antennas, and the target point cloud coordinates are mapped to the drone coordinate system to obtain the point cloud detection result; constant false alarm rate detection (CFAR) refers to a radar signal processing technology that maintains a constant false alarm rate through adaptive threshold technology, so as to effectively detect targets in complex environments; radar cross section (RCS) is used to reflect the target's reflection ability to radar signals. The larger the radar cross section, the easier it is for the target to be detected by the radar; signal-to-noise ratio (SNR) is used to reflect the target's reflection ability to radar signals. SNR) represents the strength ratio of signal to noise. The higher the SNR, the clearer the signal. The track represents a trajectory representing the target's movement path formed by the radar by continuously tracking the target's position. The target classification result represents the type of obstacle target to be detected, such as trees, rocks, etc. The track starting conditions include that the current track cumulative tracking times are less than the preset tracking times, the point cloud detection results have at least a preset number of millimeter-wave point clouds, the point cloud detection results are higher than the preset height, and the maximum radar cross section of the point cloud detection results is higher than the preset radar cross section. The preset tracking times, the preset number of millimeter-wave point clouds, the preset height, and the maximum radar cross section of the point cloud detection results are greater than the preset radar cross section. The preset degree and preset radar cross section are obtained from the preset database, the preset tracking times are set to 10 times, the preset number of millimeter-wave point clouds are set to 3 point clouds, the preset height is set to 1.5m, and the preset radar cross section is set to -5dB; through signal compression, accumulation and CFAR detection, more accurate recognition and detection of targets are achieved, through point cloud classification and track tracking, effective identification of different targets and continuous tracking of motion trajectories are achieved, and through the fusion of multi-radar data and safe distance judgment, more accurate multi-radar omnidirectional detection is ensured to avoid collision risks, thereby achieving more accurate multi-radar omnidirectional detection.

[0025] Specifically, the Direction of Arrival (DOA) algorithm is usually used to estimate the direction of the signal source relative to the receiver. To perform angle estimation, at least two receiving antennas are required. The distance between the antennas is usually known and is called the array spacing. The spacing between the two antennas is generally a fraction of the signal wavelength to ensure appropriate spatial resolution. Then, there is a difference in the path of the signal from the obstacle target to be detected to the two antennas, resulting in a phase difference between the signals received by the two antennas. Secondly, the phase difference and the signal wavelength are used to obtain the differential distance between the two antennas. Finally, according to the geometric relationship, the differential distance and the antenna spacing are used to obtain the angle of arrival of the signal. The differential distance is calculated using the following formula: ; Where d is the differential distance between the two antennas, is the phase difference between the signals received by the two antennas, is the wavelength of the signal received by the antenna; the angle of arrival is calculated using the following formula: ; In the formula, is the arrival angle of the signal, and D is the distance between the two antennas.

[0026] Specifically, classification is performed through a clustering method (DBSCAN), starting with a starting data point. The neighborhood of the starting data point is to extract neighboring points with a distance d. Neighboring points represent points at a distance of d. If the number of points in the neighborhood exceeds the standard, which is set to 3 points, clustering begins, and the current data point becomes the first point in the new cluster and is marked as a core point. If the point in the neighborhood is less than the threshold, the point is marked as a noise point (which can be covered by other clusters later); for the first point in the new cluster, its points near the distance d will also become part of the same cluster. This process makes all points near the distance d belong to the same cluster, and then repeats all new points just added to the cluster group; repeat the above steps until all points near the cluster have been visited and marked.

[0027] like Figure 3As shown, it is a flowchart of the specific implementation steps of a multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system provided by an embodiment of the present application, step 1: configure the millimeter wave radar waveform, and collect radar raw data by transmitting and receiving electromagnetic waves through the antenna; step 2: 1dfft (one-dimensional Fourier transform), perform 1D-FFT on the radar raw data to complete one-dimensional compression; step 3: 2dfft (two-dimensional Fourier transform), perform 2D-FFT on the radar raw data to complete two-dimensional compression; step 4: cfar (constant false alarm rate detection), perform CFAR processing on the accumulated amplitude matrix; step Step 5: DOA angle solution (arrival direction estimation algorithm), estimate the angle according to the phase difference between the target and the two antennas, and output the target point cloud coordinates; Step 6: Coordinate conversion, convert the radar coordinate system with its own coordinate system; Step 7: Target classification, classify the target and obtain the classification result of the target; Step 8: Track initiation; Step 9: Track maintenance, if the track is successfully associated with the point cloud, update the target attributes and maintain the track; Step 10: Multi-radar fusion processing, splice the data of multiple radars to obtain the multi-radar fusion track points; Step 11: Realize multi-target omnidirectional detection.

[0028] Furthermore, the specific process of constant false alarm rate detection is as follows: one-dimensional Fourier transform is performed on the original radar data to obtain the one-dimensional range image data of the radar. The original radar data is A matrix of , where N is the number of sampling points under a single chirp, M is the number of chirps corresponding to the channel under a single frame, K is the number of antenna channels, one-dimensional Fourier transform represents conversion along the time axis, and one-dimensional range image data represents the distance of the target from the radar in the frequency domain; two-dimensional Fourier transform is performed on the one-dimensional range image data to obtain two-dimensional frequency domain data, two-dimensional Fourier transform represents conversion along the two directions of distance and speed, and two-dimensional frequency domain data is used to analyze the distribution of the target in the distance and speed directions; according to the result of the accumulation of two-dimensional frequency domain data, the target signal is divided into a preset number of detection windows, the background noise signal is obtained through the neighborhood area of ​​the detection window, and the detection threshold is obtained according to the background noise signal, the domain area includes an inner window and an outer window, the inner window includes the target to be detected, and the outer window is used to evaluate the background noise signal; it is judged whether the target signal to be detected in the detection window exceeds the detection threshold, if the target signal to be detected exceeds the detection threshold, it is determined to be a target signal, otherwise it is determined to be noise.

[0029] In this embodiment, the radar raw data represents the echo signal received by the radar, which is usually represented in the form of a matrix, wherein N is the number of sampling points under a single frequency modulation signal (chirp), that is, the number of sampling times of the echo signal during a frequency modulation signal, M is the number of frequency modulation signals per frame, and a frame contains multiple frequency modulation signals, and K is the number of antenna channels, which represents the number of antennas; the one-dimensional Fourier transform represents Fourier transform along the time axis (i.e., the chirp sampling point) to obtain one-dimensional range image data; the one-dimensional Fourier transform converts the original time domain signal of the radar into the frequency domain, reflecting the distance of the target relative to the radar; the data after the one-dimensional Fourier transform represents the target distance information, because there is a linear relationship between the target distance and the frequency; the one-dimensional range image data represents the distance from different targets to the radar, which is obtained through the relationship between frequency and distance; the one-dimensional range image data is subjected to a two-dimensional Fourier transform (transformed along the two dimensions of distance and speed); this step converts the data from the distance-time domain to the distance-speed domain, with the purpose of simultaneously analyzing the distance and speed of the target ; The obtained two-dimensional frequency domain data contains the distance and relative speed information of the target, which is used to locate the motion state of the target; the obtained two-dimensional frequency domain data is accumulated and processed to enhance the signal strength, making the target more obvious and convenient for subsequent detection; the accumulated data is divided into a preset number of detection windows, each window containing a target signal area; according to the background noise data in the outer window, the threshold value for target detection is calculated, and the CFAR algorithm sets the threshold value by dynamically estimating the background noise so that the false alarm rate remains constant; the preset number is obtained from a preset database, usually set according to the known radar resolution and data characteristics; the inner window includes the obstacle target signal to be detected, which is the area that the radar hopes to detect; the outer window is used to evaluate the background noise signal and does not contain the target signal; the data of the outer window is used to adaptively estimate the background noise in the detection window, which is suitable for processing the fluctuation of background noise in different scenarios; the false alarm rate represents the probability of false alarm, that is, the probability of mistaking noise for a target; through the above steps, the target detection performance of the radar is improved.

[0030] Furthermore, the specific method of obtaining the point cloud detection result is as follows: input the radar data into the radar coordinate system, and convert the radar coordinate system into the drone coordinate system, and input the target point cloud coordinates into the drone coordinate system to obtain the point cloud detection result; the point cloud detection result is calculated by the following formula: ; In the formula, is the point cloud detection result, is the x-axis of the drone coordinate system, is the y-axis of the drone coordinate system, is the z-axis of the drone coordinate system, is the x-axis of the radar coordinate system, is the y-axis of the radar coordinate system, is the z-axis of the radar coordinate system, is the counterclockwise rotation angle of the radar coordinate system around the z-axis, is the horizontal coordinate of the radar relative to the drone’s coordinate position, is the ordinate of the radar relative to the drone’s coordinate position, is the height coordinate of the radar relative to the drone's coordinate position.

[0031] In this embodiment, if Figure 2 , which is a schematic diagram of coordinate changes for converting a radar coordinate system into a drone coordinate system provided by an embodiment of the present application. is the x-axis of the drone coordinate system; is the y-axis of the drone coordinate system; is the z-axis of the drone coordinate system; is the x-axis of the radar coordinate system; is the y-axis of the radar coordinate system; is the z-axis of the radar coordinate system.

[0032] The radar coordinate system is usually centered on the radar itself, and the data (point cloud) acquired by the radar is relative to the radar coordinate system; the drone coordinate system represents the coordinate system of the drone itself, usually with the center of the drone as the origin; the relative position of the drone and the radar requires consideration of coordinate transformation to convert the radar data into the drone coordinate system; the point cloud represents a set of discrete points in the three-dimensional space collected by the radar, which is usually used to describe the surface shape and structure of an object. Each discrete point has its own coordinate value, indicating its position in space; the rotation angle represents the rotation angle of the radar around the z-axis relative to the drone coordinate system, which usually represents the relative attitude of the radar and the drone, for example, the direction of the radar relative to the drone; through the above steps, it is ensured that the drone can understand the surrounding environment based on its own perspective.

[0033] Specifically, the rotation matrix for counterclockwise rotation around the Z axis is defined as: ; Where Re is the rotation matrix rotating counterclockwise around the Z axis, is the counterclockwise rotation angle around the z-axis; Re is used to represent the rotation of the radar relative to the drone coordinate system; The radar coordinate system is converted to the drone coordinate system by the following formula: ; In the formula, is the drone coordinate system, is the x-axis of the drone coordinate system, is the y-axis of the drone coordinate system, is the z-axis of the drone coordinate system, is the radar coordinate system, is the x-axis of the radar coordinate system, is the y-axis of the radar coordinate system, is the z-axis of the radar coordinate system.

[0034] Furthermore, the specific method for obtaining the association result of the point cloud and the track is as follows: compare the point cloud coordinates and radial velocity with the coordinates and radial velocity of each track, and determine whether the first coordinate difference, the second coordinate difference, the third coordinate difference and the speed difference are not greater than the preset difference threshold. If the first coordinate difference, the second coordinate difference, the third coordinate difference and the speed difference are not greater than the preset difference threshold, it indicates that the point cloud is successfully associated with the track, otherwise it indicates that the association fails; the first coordinate difference represents the difference between the horizontal coordinate of the point cloud and the horizontal coordinate of the track; the second coordinate difference represents the difference between the vertical coordinate of the point cloud and the vertical coordinate of the track; the third coordinate difference represents the difference between the vertical coordinate of the point cloud and the vertical coordinate of the track; the speed difference represents the difference between the radial velocity and the radial velocity of the track.

[0035] In this embodiment, radial velocity refers to the velocity component of the object relative to the radar in the radial direction, that is, the velocity of the object toward or away from the observation point; the preset difference threshold is obtained from a preset database, and is represented by the threshold of the track coordinates and the radial velocity that meet the association condition, for example, the preset difference threshold of the first coordinate difference is represented by the threshold on the horizontal coordinate of the track that meets the association condition; if all differences are within the preset difference threshold, the point cloud is successfully associated with the track, otherwise the point cloud is failed to be associated with the track; through the above steps, real-time tracking of multiple targets is achieved.

[0036] It should be understood that the first coordinate difference, the second coordinate difference, the third coordinate difference and the speed difference are not greater than the preset difference threshold, which can be expressed as: ; ; ; ; In the formula, Indicates the horizontal coordinate corresponding to the currently traversed point cloud, Indicates the horizontal coordinate of the track associated with the currently traversed point cloud. Indicates the threshold value on the x-coordinate of the track that meets the association condition. Indicates the ordinate corresponding to the currently traversed point cloud, Indicates the ordinate corresponding to the track associated with the currently traversed point cloud. Indicates the threshold on the ordinate of the track that meets the association condition. Indicates the height coordinate corresponding to the currently traversed point cloud, Indicates the height coordinate corresponding to the track associated with the currently traversed point cloud. Indicates the threshold value on the track altitude coordinate that meets the association condition. Indicates the radial velocity corresponding to the currently traversed point cloud, Indicates the radial velocity corresponding to the track associated with the currently traversed point cloud. Indicates the threshold value of the track radial velocity that meets the association condition.

[0037] Furthermore, the specific process of judging whether to update the target data and maintain the track based on the association result of the point cloud and the track is as follows: judging whether the point cloud and the track are successfully associated, if the point cloud and the track are successfully associated, then updating the target data and maintaining the track according to the system state vector, otherwise judging whether the cumulative number of frames reaches the preset frame number requirement, if the cumulative number of frames reaches the preset frame number requirement, then updating the target data and maintaining the track according to the system state vector, otherwise only saving the historical data, the frame number indicates that the radar completes one emission and reception of electromagnetic waves; combining each tracking track to obtain the mean of the associated target data, according to the measurement error between the tracking track state estimate and the target data mean, obtaining the system state vector, the update error covariance and the update posterior prediction error covariance; the system state vector is calculated by the following formula: ; In the formula, n is the frame number, , N is the total number of frames, is the target data mean of the nth frame, is the state estimation vector, is the prior state corresponding to the tracking target of the nth frame, is the system state vector of the nth frame, is the Kalman gain of the nth frame; the updated error covariance is calculated by the following formula: ; In the formula, is the update error covariance of the nth frame, is the observed variance of the nth frame, is the prediction error covariance of the nth frame, The observation matrix of Kalman tracking, is the transpose of the observation matrix of Kalman tracking; the updated posterior prediction error covariance is calculated by the following formula: ; ; In the formula, For the matrix The inverse matrix of is the updated posterior prediction error covariance of the nth frame.

[0038] In this embodiment, in the Kalman filter, the system state vector represents the predicted state of the target, such as position, speed, etc.; the error covariance represents the size of the system state estimation error, which measures the uncertainty of the current system state estimate; the Kalman gain is used to combine the predicted state and the measured state to update the system state in an optimal way; successful association means that a point in the point cloud matches the target trajectory that the system has tracked; the radar system updates these attributes through the data of each frame to make the trajectory and state of the target more accurate; it is determined whether the cumulative number of frames reaches the preset frame number requirement. If the cumulative number of frames does not meet the requirement, only historical data is saved; historical data includes unassociated point cloud data and track information; through the above steps, it can be ensured that the radar system can accurately track targets in multi-target scenarios and reduce the occurrence of false alarms and missed detections.

[0039] Further, the target data is updated and the track is maintained, and then it also includes: B1, associating the point cloud and the target bounding box, judging whether the target point cloud coordinates and radial velocity are within the associated threshold, if the target point cloud coordinates and radial velocity are not within the associated threshold, then performing a deletion operation, otherwise retaining the tracking track, the associated threshold includes the target point cloud horizontal coordinate threshold, the target point cloud vertical coordinate threshold, the target point cloud vertical coordinate threshold and the radial velocity associated threshold; B2, judging whether there is data associated with the radar ID and measurement ID associated with the previous frame in the point cloud data of the current frame, if so, then according to the current frame Update the target data with the point cloud data of the frame, otherwise execute B3; B3, search for the obstacle target to be detected within the associated threshold, determine whether there is an associated measurement, if there is no associated measurement, execute B4, otherwise determine whether there is a unique associated measurement, if there is a unique associated measurement, update the target data according to the associated measurement, otherwise compare the point cloud data of the current frame with the associated measurement to obtain the measurement score, and update the target data according to the measurement corresponding to the minimum measurement score obtained by arranging the measurement scores in descending order; B4, adjust the radial velocity association threshold step by step, and re-search for the obstacle to be detected within the associated threshold Target, determine whether there is an associated measurement. If there is no associated measurement, execute B5. Otherwise, determine whether there is a unique associated measurement. If there is a unique associated measurement, update the target data according to the associated measurement. Otherwise, compare the point cloud data of the current frame with the associated measurement to obtain a measurement score. Update the target data according to the measurement corresponding to the minimum measurement score obtained by arranging the measurement scores in descending order. The measurement score represents the coordinate difference and radial velocity difference between the point cloud data of the current frame and the associated measurement. B5, adjust the cfar energy threshold step by step and search for the target on the range Doppler heat map to determine whether it is Whether there is an associated measurement. If there is no associated measurement, the fusion target is updated through the system state vector and the measurement loss time is accumulated. If the measurement loss time exceeds the preset time, the obstacle target to be detected is deleted. Otherwise, it is determined whether there is a unique associated measurement. If there is a unique associated measurement, the target data is updated according to the associated measurement. Otherwise, the point cloud data of the current frame is compared with the associated measurement to obtain the degree of association, and the degree of association is arranged in ascending order to obtain the maximum degree of association. The target data is updated according to the measurement corresponding to the maximum degree of association. The measurement loss time indicates the number of frames in which the radar data is not successfully associated.

[0040] In this embodiment, each tracking track has its life cycle. During the maintenance process, we may change the state or delete the tracking track that is no longer in use. The life cycle management mainly deals with the generation and extinction of targets. When the track is generated, it is associated with the target bounding box four times according to the coordinates and radial velocity of the point cloud. If the coordinates and velocity of the point cloud data are within the set association threshold, the tracking track of the target will continue to be retained. If the association threshold is exceeded, the target will be deleted. The measurement ID represents the unique identifier of a single measurement data obtained from the point cloud, which is usually used to identify different measurement results when tracking multiple targets. Associated measurement means that by comparing the data of the current frame with the previous frame, it is found that some measurement values ​​or targets are associated with previously detected targets. In target detection, CFAR is an adaptive threshold algorithm used to control the false alarm rate. It dynamically adjusts the threshold to adapt to changes in background noise, thereby more reliably detecting targets. The CFAR energy threshold is used to determine whether certain areas contain target values. The range Doppler heat map represents a two-dimensional image that combines distance and speed information, which is usually used for radar signal processing and target detection. On the range Doppler heat map, the distance and speed information of the target are displayed to help determine the position and motion state of the target. The loss time indicates the number of frames that the radar data has not been successfully associated with. If the radar data has not been successfully associated within multiple frames, it is usually considered that the target has been lost and deleted. Through the above steps, the drone can accurately track and update the motion trajectory and attributes of the target in different environments.

[0041] Furthermore, the specific method for acquiring multi-dimensional omnidirectional track point data is as follows: E1, receiving and storing radar data within a preset time period, determining whether the stored radar data exceeds the queue length, if the stored radar data exceeds the queue length, deleting the queue head data and storing the unstored radar data at the queue tail, otherwise storing the radar data and executing E2, the queue head data represents the earliest received and stored data; E2, splicing the time-continuous track point data to obtain the omnidirectional detection data, the time-continuous track point data represents the track point data of continuous frames in the time dimension, splicing E1 includes data alignment, merging and deduplication. The omnidirectional detection data includes track information within a continuous time period; E2, splicing the spatially continuous track point data to obtain the overlapping part, transforming the track point data into the track coordinate system according to the radar illumination angle and position to obtain multi-dimensional detection data. The spatially continuous track point data represents the track point data of continuous frames in the spatial dimension; E3, integrating the track point data according to the omnidirectional detection data and the multi-dimensional detection data to obtain multi-dimensional omnidirectional track point data. The multi-dimensional omnidirectional track point data is used to describe the track point data under different radar observations.

[0042] In this embodiment, the queue length represents a pre-set upper limit of the capacity for storing radar data; when the received radar data exceeds this capacity, in order to ensure the real-time and latest data, the system needs to delete the earliest received and stored data (i.e., the queue head data) to make room for new data; if there is no latest data, the fusion target is not updated; the radar data includes the data of the front radar, rear radar, left radar, right radar, upper radar and lower radar; the latest data represents the radar echo signal data currently received; the omnidirectional detection data represents a data set obtained by splicing time-continuous track point data, and the omnidirectional detection data covers the track information of the target in a continuous time period, and can fully reflect the motion trajectory of the target in the time dimension; the multidimensional detection data represents the data set obtained by splicing the spatially continuous track point data. The multi-dimensional detection data not only contains the position information of the target in space, but also takes into account the illumination angle and position of the radar, so as to more accurately describe the multi-dimensional characteristics of the target under different radar observations; the track coordinate system represents the reference coordinate system used to describe the target motion trajectory; in the track coordinate system, it is more convenient to describe and analyze the target's position, speed, acceleration and other parameters; if some track points do not meet the fusion index requirements, the track points can be filtered according to the dynamic, static, distance, azimuth and other states, for example, setting dynamic target detection (filtering out static targets), setting distance range (such as 1m-20m) and setting azimuth range (such as -10m to 10m); through the above steps, a comprehensive description of the target's motion state is achieved.

[0043] Specifically, the specific process of splicing time-continuous track point data is as follows: F1, synchronize the radar data in time to ensure that all data are in the same time frame; F2, convert the track point data in different data sources into a unified coordinate system for spatial alignment; F3, segment the time-continuous track point data in chronological order, and for adjacent track segments, use the nearest neighbor matching algorithm to find the best matching point between adjacent track segments; after finding the matching point, merge the adjacent track segments; during the splicing process, there may be overlapping parts between track segments to eliminate the duplicate parts and ensure the seamlessness of the splicing.

[0044] Specifically, the specific process of splicing spatial continuous track point data is as follows: H1, for each pair of tracks, the Euclidean distance calculation method can be used to obtain the minimum distance between their respective track points; H2, if the distance between two track points is less than a preset distance threshold, they are considered to be likely to overlap; H3, based on the distance calculation result, all possible overlapping track segments are marked; H4, for the identified overlapping track segments, a splicing strategy (such as direct connection, interpolation connection, smooth connection, etc.) is selected to merge the track points. In this embodiment, smooth connection is selected to merge the track points, which can effectively filter noise and generate a smooth and coherent trajectory, especially when there is noise in the track points. The smoothed connected trajectory has good stability and accuracy.

[0045] Furthermore, the specific method of obtaining the radar output distance is as follows: obtain the flight direction of the UAV at the current moment, and at the same time obtain the corresponding unique identifier based on the track point in the track point coordinate system, the unique identifier includes the ID of the track point and the corresponding radar number; determine whether there is a track point in the flight direction of the UAV, if there is no track in the flight direction of the UAV, the track point is output as the first identifier, otherwise the track point is output as the second identifier and the radar output distance and speed information is output, the first identifier is blue, and the second identifier is red.

[0046] In this embodiment, the UAV flight direction indicates the direction in which the UAV is currently moving, which is a vector relative to the track point coordinate system; the UAV flight direction is obtained through the UAV flight control system inertial measurement unit (IMU); the unique identifier indicates a special mark used to identify a track point; the unique identifier includes the track point ID (unique number) and the radar number (indicating which radar detected the point) to ensure that each track point can be uniquely identified in the system; the radar output distance indicates the distance from the UAV to the obstacle target to be monitored measured by the radar system; the speed information indicates the speed of the UAV measured by the radar system; through the above steps, accurate tracking of the UAV is achieved.

[0047] Furthermore, obtaining the current flight direction of the UAV also includes: reading the attitude information of the UAV when flying in the air through the UAV flight control system to obtain the inclination data of the UAV in various directions at the current moment; compiling the inclination data into electronic signals through the compiler in the UAV flight control system, and transmitting them to the single-chip microcomputer in the UAV flight control system in real time, and the single-chip microcomputer is used for electronic signal calculation; obtaining the compensation angle according to the inclination data of the UAV in various directions at the current moment, and performing track point coordinate system compensation processing on the UAV according to the obtained compensation angle, and the track point coordinate system compensation processing indicates that the UAV system dynamically compensates for the tilt angle of the UAV with an internal loop of 20HZ.

[0048] In this embodiment, the tilt angle is the tilt angle of the drone relative to the horizontal plane; the tilt angle data includes the pitch angle (Pitch), the roll angle (Roll) and the yaw angle (Yaw); the tilt angle data reflects the posture changes of the drone in various directions during flight; the pitch angle (Pitch) indicates the tilt of the drone in the front and back directions; the roll angle (Roll) indicates the tilt of the drone in the left and right directions; the yaw angle (Yaw) indicates the rotation angle of the drone around the vertical axis, which affects the direction of the drone; the electronic signal indicates that after the drone flight control system obtains the tilt angle data through the sensor, it converts these data into electronic signals, which are calculated and processed by the single-chip microcomputer; in the drone, the single-chip microcomputer The computer processes the attitude information received from the sensor and adjusts the flight attitude based on this data; during the flight of the drone, the attitude may deviate due to external influences (wind, airflow, etc.); the compensation angle is the angle calculated to correct the deviation, which is used to ensure that the drone can fly in the set attitude and direction; the track point coordinate system compensation corrects the flight attitude of the drone to make its position and direction in three-dimensional space more accurate; the inner loop represents the update frequency of the drone flight control system; the 20Hz inner loop means that the system will update and compensate the attitude 20 times per second; through the above steps, the drone can cope with various flight environments and maintain a stable flight attitude.

[0049] Furthermore, the specific process of autonomous obstacle avoidance is as follows: the speed of the driving motor of each blade of the drone is controlled according to the radar output distance, and it is determined whether the radar output distance is less than the preset safety distance. If the radar output distance is less than the preset safety distance, the flight action is interrupted and the brakes are applied. At the same time, the radar output distance and relative radar movement speed are output in real time through the drone ground station display, otherwise no processing is performed.

[0050] In this embodiment, radar refers to a sensor installed on the drone for detecting the surrounding environment; the drive motor refers to the power source of each blade on the drone, and the flight attitude and speed of the drone are adjusted by controlling the speed of the motor; the preset safety distance refers to a minimum safety distance value set to ensure that the drone will not collide with obstacles during flight; the preset safety distance is obtained from a preset database, and the safety distance is dynamically adjusted according to the real-time environmental information and system status. For example, when trees are detected in front of the flight path, the safety distance is automatically shortened and the flight trajectory is adjusted; during the flight of the drone, braking means slowing down or stopping the flight of the drone by reducing or stopping the speed of the drive motor to avoid collision with obstacles; the drone ground station display refers to the equipment used by ground operators to monitor and control the drone, on which various status information of the drone can be displayed in real time, such as the distance output by the radar, relative movement speed, etc.; through the above steps, the flight safety and stability of the drone are improved.

[0051] like Figure 4 As shown, it is an operation flow chart of autonomous obstacle avoidance of the UAV system provided in an embodiment of the present application, step 1: obtaining multi-radar data, the system receives data from the front radar, rear radar, left radar, right radar, upper radar and lower radar; step 2: data caching, the cache stores multi-radar data; step 3: data splicing, the data splicing is divided into two dimensions, one is the time dimension and the other is the space dimension; step 4: dynamic compensation, the obtained compensation angle is transmitted to the radar, and the spatial coordinate system compensation processing is completed; step 5: determine whether there is a track ID in the flight direction of the UAV, if the track point is in the flight direction, the track point output is red, and the distance and speed information of the nearest track point to the UAV are output; otherwise, when the track point is not in the flight direction, the track point output is blue; step 6: The UAV system performs autonomous obstacle avoidance, interrupts the flight action when the detected distance is less than the preset safety distance, and brakes.

[0052] To summarize, the embodiment of the present application compresses the radar raw data to obtain two-dimensional frequency domain data, based on which the point cloud detection results are obtained, and then based on the point cloud detection results and the track starting conditions, it is determined whether to track the target, and finally the radar data is spliced ​​to obtain multi-dimensional omnidirectional track point data, based on which the radar output distance is obtained, and based on the radar output distance and the preset safety distance, it is determined whether to perform autonomous obstacle avoidance, thereby more accurately identifying and detecting targets, and further achieving more accurate multi-radar omnidirectional detection, effectively solving the problem in the prior art that the multi-radar omnidirectional detection results are greatly affected by the environment.

[0053] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0054] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1A device that provides the functions specified in a block or multiple blocks.

[0055] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0056] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0057] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0058] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A multi-radar omnidirectional detection method for an unmanned aerial vehicle inertial navigation system, characterized in that: The following steps are involved: S1, compressing the collected radar raw data to obtain two-dimensional frequency domain data, accumulating the two-dimensional frequency domain data and performing constant false alarm rate detection to obtain a point cloud detection result, wherein the compression includes one-dimensional compression and two-dimensional compression; S2, classifying the point cloud to obtain a point cloud clustering result, obtaining target data according to the point cloud clustering result, and classifying the obstacle target to be detected according to the target data to obtain a target classification result, wherein the obstacle target to be detected represents an obstacle in the flight direction of the UAV; S3, based on the point cloud detection results and the track starting conditions, determine whether to track the obstacle target to be detected, and based on the association result of the point cloud and the track, determine whether to update the target data and maintain the track. If the point cloud and the track are not successfully associated, only the historical data is saved; S4, the radar data is spliced ​​to obtain multi-dimensional omnidirectional track point data, and the radar output distance is obtained in combination with the flight direction of the UAV. Based on the radar output distance and the preset safety distance, it is determined whether to perform autonomous obstacle avoidance.

2. The multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system as claimed in claim 1, characterized in that: The specific process of the constant false alarm rate detection is as follows: Perform one-dimensional Fourier transform on the radar raw data to obtain the radar's one-dimensional range image data; Performing a two-dimensional Fourier transform on the one-dimensional range image data to obtain two-dimensional frequency domain data; The target signal is divided into a preset number of detection windows according to the result of the accumulation of the two-dimensional frequency domain data, the background noise signal is obtained through the neighborhood area of ​​the detection window, and the detection threshold is obtained according to the background noise signal; It is determined whether the target signal to be detected in the detection window exceeds the detection threshold. If the target signal to be detected exceeds the detection threshold, it is determined to be a target signal, otherwise it is determined to be noise.

3. The multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system as claimed in claim 1, characterized in that: The specific method of obtaining the point cloud detection result is as follows: The radar data is input into the radar coordinate system, and the radar coordinate system is converted into the UAV coordinate system. The target point cloud coordinates are input into the UAV coordinate system to obtain the point cloud detection results.

4. The multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system as claimed in claim 1, characterized in that: The specific method of obtaining the association result of the point cloud and the track is as follows: Compare the point cloud coordinates and radial velocity with the coordinates and radial velocity of each track to determine whether the first coordinate difference, the second coordinate difference, the third coordinate difference and the velocity difference are not greater than the preset difference threshold. If the first coordinate difference, the second coordinate difference, the third coordinate difference and the velocity difference are not greater than the preset difference threshold, it indicates that the point cloud is successfully associated with the track, otherwise it indicates that the association fails. The first coordinate difference represents the difference between the point cloud abscissa and the track abscissa; The second coordinate difference represents the difference between the point cloud ordinate and the track ordinate; The third coordinate difference represents the difference between the vertical coordinate of the point cloud and the vertical coordinate of the track; The velocity difference represents the difference between the radial velocity and the track radial velocity.

5. The multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system as claimed in claim 1, characterized in that: The specific process of determining whether to update the target data and maintain the track based on the association result of the point cloud and the track is as follows: Determine whether the point cloud is successfully associated with the track. If so, update the target data according to the system state vector and maintain the track. Otherwise, determine whether the cumulative number of frames reaches the preset frame number requirement. If so, update the target data according to the system state vector and maintain the track. Otherwise, only save the historical data. The mean of the associated target data is obtained by combining each tracking track, and the system state vector, updated error covariance and updated prediction error covariance are obtained according to the measurement error between the tracking track state estimate and the target data mean.

6. A multi-radar omnidirectional detection method for an unmanned aerial vehicle inertial navigation system as claimed in claim 5, characterized in that: The updating of target data and maintaining the track further includes: B1, associate the point cloud with the target bounding box, and determine whether the target point cloud coordinates and radial velocity are within the association threshold. If the target point cloud coordinates and radial velocity are not within the association threshold, a deletion operation is performed, otherwise the tracking track is retained; B2, determine whether there is data associated with the radar ID and measurement ID associated with the previous frame in the point cloud data of the current frame. If so, update the target data according to the point cloud data of the current frame, otherwise execute B3; B3, search for the obstacle target to be detected within the associated threshold, determine whether there is an associated measurement, if there is no associated measurement, execute B4, otherwise determine whether there is a unique associated measurement, if there is a unique associated measurement, update the target data according to the associated measurement, otherwise compare the point cloud data of the current frame with the associated measurement to obtain a measurement score, and update the target data according to the measurement corresponding to the minimum measurement score obtained by arranging the measurement scores in descending order; B4, adjust the radial velocity correlation threshold step by step, re-search the obstacle target to be detected within the correlation threshold, and determine whether there is a correlation measurement. If there is no correlation measurement, execute B5, otherwise determine whether there is a unique correlation measurement. If there is a unique correlation measurement, update the target data according to the correlation measurement, otherwise compare the point cloud data of the current frame with the correlation measurement to obtain a measurement score, and update the target data according to the measurement score corresponding to the minimum measurement score obtained by arranging the measurement scores in descending order; B5, adjust the CFAR energy threshold step by step and perform target search on the range Doppler heat map to determine whether there is an associated measurement. If there is no associated measurement, update the fusion target through the system state vector and accumulate the measurement loss time. If the measurement loss time exceeds the preset time, delete the obstacle target to be detected. Otherwise, determine whether there is a unique associated measurement. If there is a unique associated measurement, update the target data according to the associated measurement. Otherwise, compare the point cloud data of the current frame with the associated measurement to obtain the degree of association, arrange the degree of association in ascending order to obtain the maximum degree of association, and update the target data according to the measurement corresponding to the maximum degree of association. The measurement loss time indicates the number of frames where the radar data is not successfully associated.

7. The multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system as claimed in claim 1, characterized in that: The specific method of obtaining the multi-dimensional omnidirectional track point data is as follows: E1, receiving and storing radar data within a preset time period, determining whether the stored radar data exceeds the queue length, if the stored radar data exceeds the queue length, deleting the queue head data and storing the unstored radar data at the queue tail, otherwise storing the radar data and executing E2; E2, splicing the time-continuous track point data to obtain omnidirectional detection data, wherein the time-continuous track point data represents the track point data of continuous frames in the time dimension; E3, splicing the spatially continuous track point data to obtain overlapping parts, transforming the track point data into a track coordinate system according to the radar illumination angle and position to obtain multi-dimensional detection data, wherein the spatially continuous track point data represents track point data of continuous frames in the spatial dimension; E4, integrating the track point data according to the omnidirectional detection data and the multi-dimensional detection data to obtain multi-dimensional omnidirectional track point data.

8. The multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system as claimed in claim 1, characterized in that: The specific method for obtaining the radar output distance is as follows: Obtain the current flight direction of the drone, and at the same time obtain the corresponding unique identifier according to the track point in the track point coordinate system, the unique identifier includes the track point ID and the corresponding radar number; Determine whether there is a track point in the flight direction of the drone. If there is no track point in the flight direction of the drone, output the track point as the first identifier; otherwise, output the track point as the second identifier and output the radar output distance and speed information.

9. A multi-radar omnidirectional detection method for an unmanned aerial vehicle inertial navigation system as claimed in claim 8, characterized in that: The method of obtaining the current UAV flight direction also includes: By reading the attitude information of the drone when it is flying in the air, the inclination data of the drone in each direction at the current moment is obtained; The tilt angle data is compiled into an electronic signal by a compiler in the UAV flight control system and transmitted to the single chip microcomputer in the UAV flight control system in real time; The compensation angle is obtained according to the inclination data of the UAV in various directions at the current moment, and the track point coordinate system compensation processing is performed on the UAV according to the obtained compensation angle.

10. The multi-radar omnidirectional detection method of an unmanned aerial vehicle inertial navigation system as claimed in claim 1, characterized in that: The specific process of autonomous obstacle avoidance is as follows: The speed of the driving motor of each blade of the drone is controlled according to the radar output distance, and it is determined whether the radar output distance is less than the preset safety distance. If the radar output distance is less than the preset safety distance, the flight action is interrupted and the brakes are applied. At the same time, the radar output distance and relative radar movement speed are output in real time through the drone ground station display, otherwise no processing is performed.

Citation Information

Patent Citations

  • Radar signal processing method

    CN106597411A

  • General aviation flight plan and monitoring target association system and method

    CN112634663A

  • Obstacle-avoiding and height-fixing method for millimeter-wave radar of oblique side-mounted unmanned aerial vehicle carrying holder

    CN115033026A

  • Dead tree target detection method based on obstacle avoidance radar distance Doppler integral

    CN115932779A

  • Method for identifying unmanned aerial vehicle based on radar data

    CN116415163A

Cited By

  • Airborne radar multi-target detection data and truth value matching method

    CN119377704A

  • Relative positioning method and system for cluster robots

    CN120008589A

  • Adaptive filtering method and device, electronic equipment, readable storage medium and chip

    CN120876911A

  • Adaptive filtering method and device, electronic equipment, readable storage medium and chip

    CN120876911B

  • Unmanned aerial vehicle low false alarm identification method based on radar multi-dimensional micro-motion characteristics

    CN121348274A