Automatic obstacle avoidance method and system for unmanned aerial vehicle, and electronic equipment

By obtaining the obstacle boundaries and routes in the drone's flight area, and using multi-source three-dimensional data to analyze and judge obstacle points, the problem of difficulty in avoiding collisions of two-dimensional maps is solved, and the safety and intelligence of the drone are improved.

CN117519250BActive Publication Date: 2024-11-19QINGDAO CLOUD CENTURY INFORMATION TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202311669283.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-07
Publication Date
2024-11-19
Estimated Expiration
2043-12-07

AI Technical Summary

Technical Problem

In the prior art, drone route planning is implemented based on two-dimensional maps, and it is difficult to effectively avoid the problem of drone collisions with land objects.

Method used

By obtaining the obstacle area boundaries and routes in the preset flight area, using terrain data, CAD planning data and BIM model data for three-dimensional fitting analysis of multi-source data, determine whether there are obstacle points, and re-plan the drone path based on the judgment results .

Benefits of technology

It improves the safety, reliability and intelligence of drone flights, effectively avoids collisions with land objects, and provides new ideas for safe flight and route planning of drones.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117519250B_ABST
    Figure CN117519250B_ABST
Patent Text Reader

Abstract

The present invention provides a method and system for automatic obstacle avoidance of a drone, and an electronic device, the method comprising: S100, obtaining the boundary of the obstacle area of ​​a preset flight area, and a preset route; S200, judging whether there is a first obstacle point according to the boundary and the preset route; S300, judging whether to re-plan the drone path according to the judgment result. The present invention uses the terrain data and / or CAD planning data and / or BIM model data of the preset flight area to realize three-dimensional fitting analysis of multi-source data, solves the problem that route planning is only based on two-dimensional maps in the prior art, and it is difficult to effectively avoid collisions between drones and ground objects, greatly improves the safety, reliability, availability and intelligence of drone flight, and provides a new idea for safe drone flight and route planning.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of automatic obstacle avoidance for unmanned aerial vehicles, and in particular to an automatic obstacle avoidance method and system for unmanned aerial vehicles, and electronic equipment. Background Art

[0002] In the prior art, the process of implementing route planning based on visual map data can improve the efficiency of route planning and reduce the cost of test flights. However, in the prior art, route planning is only implemented based on two-dimensional maps. Due to the variety of landform types, different landform types usually correspond to different terrain heights, and different buildings also have different heights. There is still the problem of collision between drones and landforms. It is difficult to effectively avoid the problem of collision between drones and landforms by implementing route planning based only on two-dimensional maps.

[0003] Therefore, the prior art needs to be further developed. Summary of the invention

[0004] The purpose of the present invention is to overcome the above technical deficiencies and provide a method and system for automatic obstacle avoidance of a drone, and an electronic device to solve the problems existing in the prior art.

[0005] To achieve the above technical objectives, according to a first aspect of the present invention, the present invention provides a method for automatic obstacle avoidance of a drone, the method comprising:

[0006] S100, obtaining the boundary of the obstacle area of ​​the preset flight area and the preset route;

[0007] S200, judging whether there is a first obstacle point according to the boundary and the preset route;

[0008] S300: Determine whether to re-plan the UAV path based on the judgment result.

[0009] Specifically, obtaining the boundary of the obstacle area of ​​the preset flight area includes:

[0010] S110, obtaining terrain data and / or CAD planning data and / or BIM model data of a preset flight area;

[0011] S111, based on the terrain data and / or CAD planning data and / or BIM model data of the preset flight area, perform layer overlay and determine the type and boundary of each obstacle, and set a safety distance based on the type of each obstacle;

[0012] S112: Divide the preset flight area into an obstacle area and a non-obstacle area based on the boundaries of each obstacle and the safety distance corresponding to each obstacle.

[0013] Specifically, judging whether there is a first obstacle point according to the boundary and the preset route includes:

[0014] S210, the preset route includes a first waypoint and a second waypoint that the drone passes in sequence, calculating a line segment formed by the first waypoint and the second waypoint, determining whether there is a first intersection between the boundary and the line segment, if not, then there is no first obstacle point, if so, calculating the first longitude and latitude coordinates of the first intersection, obtaining the altitude of the first obstacle in the obstacle area corresponding to the first longitude and latitude coordinates, and the preset flight altitude of the drone at the first longitude and latitude coordinates;

[0015] S211, determining whether the difference between the preset flight altitude and the altitude is greater than or equal to a first preset threshold; if not, the first intersection is a first obstacle point; if so, there is no obstacle point between the first waypoint and the second waypoint;

[0016] S212: Calculate other first obstacle points in the preset route according to the above method.

[0017] Specifically, obtaining the altitude of the first obstacle in the obstacle area corresponding to the first longitude and latitude coordinates includes:

[0018] Acquire terrain data and a type of land feature at which the first longitude and latitude coordinates are located, and acquire a terrain height of the first longitude and latitude coordinates according to the terrain data at which the first longitude and latitude coordinates are located;

[0019] Determine whether the ground object type of the first obstacle is a building, determine whether CAD planning data and / or BIM model data of the first obstacle can be obtained, and calculate the first body height of the first obstacle according to the CAD planning data and / or BIM model data according to the determination result;

[0020] The altitude of the first obstacle is calculated according to the terrain height at which the first longitude and latitude coordinates are located and the height of the first body.

[0021] Specifically, the step of calculating the first body height of the first obstacle according to the CAD planning data and / or the BIM model data according to the judgment result includes:

[0022] If the ground object type of the first obstacle is a building, and BIM model data of the first obstacle can be obtained, the first body height of the first obstacle is calculated according to the BIM model data;

[0023] If the ground object type of the first obstacle is a building, and the CAD planning data of the first obstacle can be obtained, but the BIM data of the first obstacle cannot be obtained, the floor data in the CAD planning data of the first obstacle is obtained, and the first body height of the first obstacle is calculated according to the preset floor height data and the floor data;

[0024] If the ground object type of the first obstacle is not a building, a preset body height corresponding to the ground object type of the first obstacle is obtained as a first body height of the first obstacle.

[0025] Specifically, judging whether there is a first obstacle point according to the boundary and the preset route includes:

[0026] S220, the preset route includes a first waypoint and a second waypoint that the drone passes through in sequence, calculating a ray formed by taking the first waypoint as an endpoint and passing through the second waypoint, calculating whether the ray has a second intersection with the boundary, if not, then there is no first obstacle point between the first waypoint and the second waypoint, if so, calculating the second longitude and latitude coordinates of the second intersection, calculating the first distance between the second longitude and latitude coordinates and the first waypoint, and calculating the second distance between the first waypoint and the second waypoint;

[0027] S221, determining whether the first distance is greater than or equal to the second distance; if so, there is no first obstacle point between the first waypoint and the second waypoint; if not, the second intersection point is the first obstacle point;

[0028] S222. Calculate other first obstacle points in the preset route according to the above method.

[0029] Specifically, determining whether to re-plan the drone path according to the judgment result includes:

[0030] If the first obstacle point exists, it is determined that the drone path planning needs to be re-performed, and the drone path planning is re-performed;

[0031] If the first obstacle point does not exist, it is determined that there is no need to re-plan the drone path.

[0032] Specifically, the re-planning of the drone path includes:

[0033] S310, dividing the obstacle area into two curved surfaces through a line connecting the first waypoint and the second waypoint, recorded as a first curved surface and a second curved surface;

[0034] S311, calculating the tangent point between the first waypoint and the tangent line of the first curved surface, recording it as the first candidate waypoint, calculating the tangent point between the second waypoint and the tangent line of the first curved surface, recording it as the second candidate waypoint, and taking the first waypoint, the first candidate waypoint, the second candidate waypoint, and the second waypoint as the first candidate route;

[0035] S312, calculating the tangent point between the first waypoint and the tangent line of the second curved surface, recording it as the third alternative waypoint, calculating the tangent point between the second waypoint and the tangent line of the second curved surface, recording it as the fourth alternative waypoint, and taking the first waypoint, the third alternative waypoint, the fourth alternative waypoint, and the second waypoint as the second alternative route;

[0036] S313, calculating the Cartesian distance between the first alternative route and the second alternative route, and using the alternative route with the shorter Cartesian distance as the obstacle avoidance route between the first waypoint and the second waypoint;

[0037] S314: Plan obstacle avoidance routes between other waypoints according to the above method.

[0038] According to a second aspect of the present invention, there is provided an automatic obstacle avoidance system for a drone, comprising:

[0039] An acquisition module, used to acquire the boundary of the obstacle area of ​​the preset flight area and the preset route;

[0040] The control module is used to determine whether there is a first obstacle point based on the boundary and the preset route; or to determine whether to re-plan the drone path based on the judgment result.

[0041] According to a third aspect of the present invention, there is provided an electronic device, comprising: a memory; and a processor, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the above-mentioned automatic obstacle avoidance method for a drone is implemented.

[0042] Beneficial effects:

[0043] The present invention provides an automatic obstacle avoidance method and system for unmanned aerial vehicles, and electronic equipment, which obtain the boundary of an obstacle area in a preset flight area and a preset route; determine whether a first obstacle point exists according to the boundary and the preset route; determine whether to re-plan the path of the unmanned aerial vehicle according to the determination result, and use terrain data and / or CAD planning data and / or BIM model data of the preset flight area to implement three-dimensional fitting analysis of multi-source data, thereby solving the problem in the prior art that route planning is only based on two-dimensional maps and it is difficult to effectively avoid collisions between unmanned aerial vehicles and ground objects, thereby greatly improving the safety, reliability, availability and intelligence of unmanned aerial vehicle flight, and providing a new idea for safe flight and route planning of unmanned aerial vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 is a flow chart of a method for automatic obstacle avoidance of a drone provided in a specific embodiment of the present invention;

[0045] Figure 2 Schematic diagram of the system composition of the automatic obstacle avoidance system for a drone provided in a specific embodiment of the present invention;

[0046] Figure 3 is a flow chart of a method for obtaining obstacle points based on rays proposed in a specific embodiment of the present invention;

[0047] Figure 4 is a flow chart of a method for obtaining obstacle points based on an interpolation method proposed in a specific embodiment of the present invention;

[0048] Figure 5 is a schematic diagram of a method for re-planning a UAV path proposed in a specific embodiment of the present invention;

[0049] Figure 6 is a schematic diagram of a method flow of a method for re-planning a UAV path proposed in a specific embodiment of the present invention;

[0050] Figure 7 It is a method flow chart of the automatic obstacle avoidance method for a drone proposed in a specific embodiment of the present invention. DETAILED DESCRIPTION

[0051] In order to enable those skilled in the art to better understand the technical solution of the present invention, the technical solution of the present invention is clearly and completely described below in conjunction with the accompanying drawings of the present invention. Based on the embodiments in this application, other similar embodiments obtained by ordinary technicians in this field without making creative work should all fall within the scope of protection of this application. In addition, the directional words mentioned in the following embodiments, such as "up", "down", "left", "right", etc., are only reference to the directions of the accompanying drawings. Therefore, the directional words used are used to illustrate rather than limit the invention.

[0052] The present invention will be further described below in conjunction with the accompanying drawings and preferred embodiments.

[0053] See also Figure 1 and Figure 3-7 The present invention provides a method for automatic obstacle avoidance of a drone, the method comprising:

[0054] S100: Obtain the boundary of the obstacle area of ​​the preset flight area and the preset flight route.

[0055] It should be noted that the step before step S100 includes:

[0056] The control module presets the terrain data and / or CAD planning data and / or BIM model data of the preset flight area, preset floor height data, a safety distance corresponding to the terrain type of each obstacle, a first preset threshold, a preset body height corresponding to the terrain type of the first obstacle, the latitude and longitude coordinates of each waypoint of the UAV in the preset route, and the preset flight altitude of each waypoint of the UAV in the preset route.

[0057] It should be noted here that the CAD planning data includes building vector outline data and building floor number data corresponding to the building vector outline data, which is used to determine the building floor number data of the first obstacle based on the building vector outline data, and calculate the preset body height of the first obstacle based on the preset floor height data and the building floor number data.

[0058] It can be understood that the preset floor height data, the preset body height corresponding to the terrain type of the first obstacle, the safety distance corresponding to the terrain type of each obstacle, the first preset threshold, the latitude and longitude coordinates of each waypoint of the UAV in the preset route, and the preset flight altitude of each waypoint of the UAV in the preset route can all be specifically set according to actual flight needs, common knowledge, experience, national standard parameters and national safety regulations, and the present invention does not require the specific values ​​of the above parameters.

[0059] It should be noted that the preset height of the first obstacle is different for different types of objects. The present invention does not specifically limit the data of the preset height of the first obstacle. The following example is given. For example, if the first obstacle is vegetation, the preset height of the vegetation is preferably 20 meters. The preset height of the vegetation is preferably 20 meters, which is obtained by the technicians of the present invention through a large number of experiments, and can help the drone avoid vegetation areas better.

[0060] Specifically, obtaining the boundary of the obstacle area of ​​the preset flight area includes:

[0061] S110, obtaining terrain data and / or CAD planning data and / or BIM model data of a preset flight area;

[0062] S111, based on the terrain data and / or CAD planning data and / or BIM model data of the preset flight area, perform layer overlay and determine the type and boundary of each obstacle, and set a safety distance based on the type of each obstacle;

[0063] S112: Divide the preset flight area into an obstacle area and a non-obstacle area based on the boundaries of each obstacle and the safety distance corresponding to each obstacle.

[0064] S200: Determine whether there is a first obstacle point based on the boundary and the preset route.

[0065] It should be noted here that there may be multiple first obstacle points.

[0066] Specifically, judging whether there is a first obstacle point according to the boundary and the preset route includes:

[0067] S210, the preset route includes a first waypoint and a second waypoint that the UAV passes in sequence, calculates a line segment formed by the first waypoint and the second waypoint, determines whether there is a first intersection between the boundary and the line segment, if not, then there is no first obstacle point, if so, calculates the first longitude and latitude coordinates of the first intersection, obtains the altitude of the first obstacle in the obstacle area corresponding to the first longitude and latitude coordinates, and the preset flight altitude of the UAV at the first longitude and latitude coordinates.

[0068] It should be noted here that please refer to Figure 4 In a preferred embodiment, the present invention proposes a method for obtaining obstacle points based on an interpolation method. The present invention loads BIM model data, terrain data, latitude and longitude data of each waypoint of a preset route, and preset flight altitude data based on Cesium. Then, the present invention traverses the data longitude and latitude data and preset flight altitude data of each waypoint of the preset route, and interpolates between two adjacent waypoints A and B, that is, the waypoint data is interpolated into multiple contour segments based on a fixed value delta. After encrypting the data between the two waypoints, the preset flight altitude data h0 corresponding to each endpoint of the multiple contour segments, the BIM model height and the terrain height in the BIM scene are calculated, and the preset flight altitude data of each endpoint of the multiple contour segments are used to compare with the BIM model height h1 and the terrain height h2 corresponding to the point. If the preset flight altitude data h0 of an endpoint in a certain contour segment is lower than the model h1 or the terrain height h2, the endpoint is judged to be the first obstacle point.

[0069] It is understandable that the fixed value delta can be specifically set according to the length of the actual route, and the present invention does not make specific requirements on the numerical setting of the fixed value delta.

[0070] It can be understood that the preset flight altitude data corresponding to each endpoint of the multiple contour segments of the present invention is the average value of the preset flight altitude data of two adjacent waypoints corresponding to the divided route.

[0071] S211. Determine whether the difference between the preset flight altitude and the altitude is greater than or equal to a first preset threshold; if not, the first intersection is a first obstacle point; if so, there is no obstacle point between the first waypoint and the second waypoint.

[0072] It should be noted here that the first preset threshold is a preset safety threshold. If the difference between the preset flight altitude and the altitude is greater than or equal to the first preset threshold, it proves that the difference between the preset flight altitude and the altitude is greater than or equal to the preset safety threshold, and the preset route of the drone between the first waypoint and the second waypoint is safe, that is, there is no first obstacle point between the first waypoint and the second waypoint, otherwise, there is an obstacle point.

[0073] It can be understood that in other embodiments, the present invention uses each waypoint in the preset route and the projection ray direction of the route perpendicular to the ground to detect the terrain data or model data, obtain the projection height of each waypoint on the terrain or model below each waypoint, determine whether the projection height is greater than or equal to a first preset threshold, and determine whether each waypoint is the first obstacle point based on the judgment result. If the projection height of a waypoint is less than the safety distance, the waypoint is determined to be the first obstacle point; otherwise, the waypoint is not the first obstacle point.

[0074] S212: Calculate other first obstacle points in the preset route according to the above method.

[0075] Specifically, obtaining the altitude of the first obstacle in the obstacle area corresponding to the first longitude and latitude coordinates includes:

[0076] Acquire terrain data and a type of land feature at which the first longitude and latitude coordinates are located, and acquire a terrain height of the first longitude and latitude coordinates according to the terrain data at which the first longitude and latitude coordinates are located;

[0077] Determine whether the ground object type of the first obstacle is a building, determine whether CAD planning data and / or BIM model data of the first obstacle can be obtained, and calculate the first body height of the first obstacle according to the CAD planning data and / or BIM model data according to the determination result;

[0078] The altitude of the first obstacle is calculated according to the terrain height at which the first longitude and latitude coordinates are located and the height of the first body.

[0079] Specifically, the step of calculating the first body height of the first obstacle according to the CAD planning data and / or the BIM model data according to the judgment result includes:

[0080] If the ground object type of the first obstacle is a building, and BIM model data of the first obstacle can be obtained, the first body height of the first obstacle is calculated according to the BIM model data;

[0081] If the terrain type of the first obstacle is a building, and the CAD planning data of the first obstacle can be obtained, but the BIM data of the first obstacle cannot be obtained, obtain the floor data in the CAD planning data of the first obstacle, and calculate the first body height of the first obstacle based on the preset floor height data and the floor data.

[0082] If the ground object type of the first obstacle is not a building, a preset body height corresponding to the ground object type of the first obstacle is obtained as a first body height of the first obstacle.

[0083] It should be noted here that please refer to Figure 3In a preferred embodiment, the present invention proposes a method for obtaining an obstacle point based on rays. Specifically, judging whether there is a first obstacle point according to the boundary and the preset route includes:

[0084] S220, the preset route includes a first waypoint A and a second waypoint B that the drone passes through in sequence, calculating a ray that takes the first waypoint as an endpoint and passes through the second waypoint, calculating whether the ray has a second intersection with the boundary, if not, then there is no first obstacle point between the first waypoint and the second waypoint, if so, calculating the second longitude and latitude coordinates of the second intersection, calculating the first distance between the second longitude and latitude coordinates and the first waypoint, and calculating the second distance between the first waypoint and the second waypoint;

[0085] S221, determining whether the first distance is greater than or equal to the second distance; if so, there is no first obstacle point between the first waypoint and the second waypoint; if not, the second intersection point is the first obstacle point;

[0086] S222. Calculate other first obstacle points in the preset route according to the above method.

[0087] Specifically, determining whether to re-plan the drone path according to the judgment result includes:

[0088] If the first obstacle point exists, it is determined that the drone path planning needs to be re-performed, and the drone path planning is re-performed;

[0089] If the first obstacle point does not exist, it is determined that there is no need to re-plan the drone path.

[0090] S300: Determine whether to re-plan the UAV path based on the judgment result.

[0091] For details, please refer to Figure 5-Figure 6 ,include:

[0092] S310, dividing the obstacle area into two curved surfaces through a line connecting the first waypoint and the second waypoint, recorded as a first curved surface and a second curved surface;

[0093] S311, calculating the tangent point between the first waypoint and the tangent line of the first curved surface, recording it as the first candidate waypoint, calculating the tangent point between the second waypoint and the tangent line of the first curved surface, recording it as the second candidate waypoint, and taking the first waypoint, the first candidate waypoint, the second candidate waypoint, and the second waypoint as the first candidate route;

[0094] S312, calculating the tangent point between the first waypoint and the tangent line of the second curved surface, recording it as the third alternative waypoint, calculating the tangent point between the second waypoint and the tangent line of the second curved surface, recording it as the fourth alternative waypoint, and taking the first waypoint, the third alternative waypoint, the fourth alternative waypoint, and the second waypoint as the second alternative route;

[0095] S313: Calculate the Cartesian distance between the first alternative route and the second alternative route, and use the alternative route with the shorter Cartesian distance as the obstacle avoidance route between the first waypoint and the second waypoint.

[0096] It should be noted here that if the curved sides of the first curved surface and the second curved surface both exceed the preset flight area, that is, there is no tangent point between the first curved surface and the first waypoint and the second waypoint, and there is no tangent point between the second curved surface and the first waypoint and the second waypoint, then in the three-dimensional scene, based on the position of the first obstacle point, the altitude of the current first obstacle is obtained, and on the basis of the altitude of the current first obstacle, the first preset threshold is increased, and the altitude after increasing the first preset threshold is used as the new flight altitude of the modified first waypoint and the second waypoint, the waypoint after the modified flight altitude is used as the new first waypoint and the second waypoint, and the route formed by the new first waypoint and the second waypoint is used as the obstacle avoidance route.

[0097] S314: Plan obstacle avoidance routes between other waypoints according to the above method.

[0098] It is understandable that, in other embodiments, the present invention also re-plans the drone path by the following method, including:

[0099] S320, dividing the obstacle area into two curved surfaces by a line connecting the first waypoint and the second waypoint, recorded as a first curved surface and a second curved surface;

[0100] S321, calculating the tangent point between the first waypoint and the tangent line of the first curved surface, recorded as the first tangent point, and calculating a ray formed by taking the first waypoint as an endpoint and passing through the first tangent point, recorded as the first ray;

[0101] S322, calculating the tangent point between the second waypoint and the tangent line of the first curved surface, recorded as the second tangent point, and calculating a ray formed by taking the second waypoint as an endpoint and passing through the second tangent point, recorded as the second ray;

[0102] S323, calculating the intersection of the first ray and the second ray, and recording it as the first candidate waypoint;

[0103] S324, using the route formed by the first waypoint, the first alternative waypoint, and the second waypoint as the first alternative route;

[0104] S325, calculating the tangent point between the first waypoint and the tangent line of the second curved surface, recorded as the third tangent point, and calculating a ray formed by taking the first waypoint as an endpoint and passing through the third tangent point, recorded as the third ray;

[0105] S326, calculating the tangent point between the second waypoint and the tangent line of the second curved surface, recorded as the fourth tangent point, and calculating a ray formed by taking the second waypoint as an endpoint and passing through the fourth tangent point, recorded as the fourth ray;

[0106] S327, calculating the intersection of the third ray and the fourth ray, and recording it as the second candidate waypoint;

[0107] S328, using the route formed by the first waypoint, the second alternative waypoint, and the second waypoint as the second alternative route;

[0108] S329, calculating the Cartesian distance between the first alternative route and the second alternative route, and using the alternative route with the shorter Cartesian distance as the obstacle avoidance route between the first waypoint and the second waypoint;

[0109] It should be noted here that if the curved sides of the first curved surface and the second curved surface both exceed the preset flight area, that is, there is no tangent point between the first curved surface and the first waypoint and the second waypoint, and there is no tangent point between the second curved surface and the first waypoint and the second waypoint, then in the three-dimensional scene, based on the position of the first obstacle point, the altitude of the current first obstacle is obtained, and on the basis of the altitude of the current first obstacle, the first preset threshold is increased, and the altitude after increasing the first preset threshold is used as the new flight altitude of the modified first waypoint and the second waypoint, the waypoint after the modified flight altitude is used as the new first waypoint and the second waypoint, and the route formed by the new first waypoint and the second waypoint is used as the obstacle avoidance route.

[0110] S3210. Plan obstacle avoidance routes between other waypoints according to the above method.

[0111] It can be understood that the obstacle avoidance route planning in the above-mentioned embodiment of the present invention is that the obstacle avoidance route does not pass through the boundary of the obstacle area at all, which further improves the obstacle avoidance effect, further improves the safety and reliability of the drone obstacle avoidance solution, and does not require complex algorithm modeling, which greatly expands the application scenarios of the present invention and greatly improves the usability of the present invention.

[0112] It should be noted here that the present invention provides an automatic obstacle avoidance method and system for unmanned aerial vehicles, and an electronic device, which obtain the boundary of the obstacle area of ​​a preset flight area and a preset route; determine whether there is a first obstacle point based on the boundary and the preset route; determine whether to re-plan the path of the unmanned aerial vehicle based on the judgment result, and use the terrain data and / or CAD planning data and / or BIM model data of the preset flight area to realize three-dimensional fitting analysis of multi-source data, thereby solving the problem in the prior art that route planning is only based on two-dimensional maps and it is difficult to effectively avoid collisions between unmanned aerial vehicles and ground objects, thereby greatly improving the safety, reliability, availability and intelligence of unmanned aerial vehicle flight, and providing a new idea for safe flight and route planning of unmanned aerial vehicles.

[0113] See also Figure 2The present invention provides another embodiment, which provides an automatic obstacle avoidance system for a drone, and the automatic obstacle avoidance system for a drone includes:

[0114] The acquisition module 100 is used to acquire the boundary of the obstacle area of ​​the preset flight area and the preset flight route;

[0115] The control module 200 is used to determine whether there is a first obstacle point based on the boundary and the preset route; or to determine whether to re-plan the drone path based on the judgment result.

[0116] It can be understood that the present invention provides an automatic obstacle avoidance method and system for unmanned aerial vehicles, and an electronic device, which obtain the boundary of the obstacle area of ​​a preset flight area and a preset route; determine whether there is a first obstacle point based on the boundary and the preset route; determine whether to re-plan the path of the unmanned aerial vehicle based on the judgment result, and use the terrain data and / or CAD planning data and / or BIM model data of the preset flight area to realize three-dimensional fitting analysis of multi-source data, thereby solving the problem in the prior art that route planning is only based on two-dimensional maps and it is difficult to effectively avoid collisions between unmanned aerial vehicles and ground objects, thereby greatly improving the safety, reliability, availability and intelligence of unmanned aerial vehicle flight, and providing a new idea for safe flight and route planning of unmanned aerial vehicles.

[0117] In a preferred embodiment, the present application further provides an electronic device, the electronic device comprising:

[0118] A memory; and a processor, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the automatic obstacle avoidance method of the unmanned aerial vehicle is implemented. The computer device can be broadly a server, a terminal, or any other electronic device with necessary computing and / or processing capabilities. In one embodiment, the computer device may include a processor, a memory, a network interface, a communication interface, etc. connected via a system bus. The processor of the computer device can be used to provide necessary computing, processing and / or control capabilities. The memory of the computer device may include a non-volatile storage medium and an internal memory. An operating system, a computer program, etc. may be stored in or on the non-volatile storage medium. The internal memory can provide an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface and the communication interface of the computer device can be used to connect and communicate with external devices through a network. When the computer program is executed by the processor, the steps of the method of the present invention are performed.

[0119] The present invention may be implemented as a computer-readable storage medium having a computer program stored thereon, which causes the steps of the method of an embodiment of the present invention to be executed when executed by a processor. In one embodiment, the computer program is distributed on a plurality of computer devices or processors coupled to a network so that the computer program is stored, accessed and executed in a distributed manner by one or more computer devices or processors. A single method step / operation, or two or more method steps / operations, may be performed by a single computer device or processor or by two or more computer devices or processors. One or more method steps / operations may be performed by one or more computer devices or processors, and one or more other method steps / operations may be performed by one or more other computer devices or processors. One or more computer devices or processors may perform a single method step / operation, or perform two or more method steps / operations.

[0120] It will be appreciated by those skilled in the art that the method steps of the present invention may be performed by instructing related hardware such as a computer device or a processor through a computer program, and the computer program may be stored in a non-temporary computer-readable storage medium, which causes the steps of the present invention to be performed when the computer program is executed. Depending on the circumstances, any reference to memory, storage, database, or other media herein may include non-volatile and / or volatile memory. Examples of non-volatile memory include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid state disk, etc. Examples of volatile memory include random access memory (RAM), external cache memory, etc.

[0121] It should be noted here that the present invention provides an automatic obstacle avoidance method and system for unmanned aerial vehicles, and an electronic device, which obtain the boundary of the obstacle area of ​​a preset flight area and a preset route; determine whether there is a first obstacle point based on the boundary and the preset route; determine whether to re-plan the path of the unmanned aerial vehicle based on the judgment result, and use the terrain data and / or CAD planning data and / or BIM model data of the preset flight area to realize three-dimensional fitting analysis of multi-source data, thereby solving the problem in the prior art that route planning is only based on two-dimensional maps and it is difficult to effectively avoid collisions between unmanned aerial vehicles and ground objects, thereby greatly improving the safety, reliability, availability and intelligence of unmanned aerial vehicle flight, and providing a new idea for safe flight and route planning of unmanned aerial vehicles.

[0122] The various technical features described above can be combined arbitrarily. Although all possible combinations of these technical features are not described, any combination of these technical features should be considered to be covered by this specification as long as there is no contradiction in such combination.

[0123] The specific implementation of the present invention described above does not constitute a limitation on the protection scope of the present invention. Any other corresponding changes and modifications made based on the technical concept of the present invention should be included in the protection scope of the claims of the present invention.

Claims

1. A method for automatic obstacle avoidance of a drone, characterized in that: The method comprises: S100: Obtain the boundary of the obstacle area of ​​the preset flight area and the preset flight route; S200, determining whether there is a first obstacle point based on the boundary and the preset route; S300: Determine whether to re-plan the UAV path based on the judgment result; The determining whether there is a first obstacle point based on the boundary and the preset route includes: S210: The preset route includes a first waypoint and a second waypoint that the drone passes through in sequence, calculating a line segment formed by the first waypoint and the second waypoint, determining whether a first intersection exists between the boundary and the line segment; if not, then no first obstacle exists; if so, calculating first longitude and latitude coordinates of the first intersection, obtaining an altitude of a first obstacle in an obstacle area corresponding to the first longitude and latitude coordinates, and a preset flight altitude of the drone at the first longitude and latitude coordinates; S211, determining whether the difference between the preset flight altitude and the altitude is greater than or equal to a first preset threshold; if not, the first intersection is a first obstacle point; if so, there is no obstacle point between the first waypoint and the second waypoint; S212, calculating other first obstacle points in the preset route according to the above method; The obtaining the altitude of the first obstacle in the obstacle area corresponding to the first latitude and longitude coordinates includes: Obtaining terrain data and a type of terrain feature at the first longitude and latitude coordinates, and obtaining a terrain height at the first longitude and latitude coordinates based on the terrain data at the first longitude and latitude coordinates; Determining whether the ground feature type of the first obstacle is a building, determining whether CAD planning data and / or BIM model data of the first obstacle can be obtained, and calculating the first body height of the first obstacle based on the CAD planning data and / or BIM model data according to the determination result; Calculate the altitude of the first obstacle based on the terrain height at which the first longitude and latitude coordinates are located and the height of the first body; The step of calculating the first body height of the first obstacle according to the CAD planning data and / or the BIM model data based on the judgment result includes: If the terrain type of the first obstacle is a building and BIM model data of the first obstacle is available, calculate the first body height of the first obstacle according to the BIM model data; If the first obstacle is a building, and the CAD planning data of the first obstacle is available but the BIM data of the first obstacle is not available, obtain floor data from the CAD planning data of the first obstacle, and calculate the first body height of the first obstacle based on the preset floor height data and the floor data; If the object type of the first obstacle is not a building, obtaining a preset body height corresponding to the object type of the first obstacle as the first body height of the first obstacle; The determining whether there is a first obstacle point based on the boundary and the preset route includes: S220, the preset route includes a first waypoint and a second waypoint that the drone passes through in sequence, calculating a ray formed with the first waypoint as an endpoint and passing through the second waypoint, calculating whether the ray has a second intersection with the boundary, if not, then there is no first obstacle point between the first waypoint and the second waypoint, if so, calculating second longitude and latitude coordinates of the second intersection, calculating a first distance between the second longitude and latitude coordinates and the first waypoint, and calculating a second distance between the first waypoint and the second waypoint; S221. Determine whether the first distance is greater than or equal to the second distance; if so, there is no first obstacle point between the first waypoint and the second waypoint; if not, the second intersection point is the first obstacle point; S222. Calculate other first obstacle points in the preset route according to the above method; Determining whether to re-plan the drone path based on the judgment result includes: If the first obstacle point exists, it is determined that the drone path planning needs to be re-performed, and the drone path planning is re-performed; If the first obstacle point does not exist, it is determined that there is no need to re-plan the drone path; The re-planning of the UAV path includes: S310, dividing the obstacle area into two curved surfaces using a line connecting the first waypoint and the second waypoint, denoted as a first curved surface and a second curved surface; S311. Calculate the tangent point between the first waypoint and the tangent line of the first curved surface, record it as the first candidate waypoint, calculate the tangent point between the second waypoint and the tangent line of the first curved surface, record it as the second candidate waypoint, and use the first waypoint, the first candidate waypoint, the second candidate waypoint, and the second waypoint as the first candidate route; S312. Calculate the tangent point between the first waypoint and the tangent line of the second curved surface, record it as the third alternative waypoint, calculate the tangent point between the second waypoint and the tangent line of the second curved surface, record it as the fourth alternative waypoint, and use the first waypoint, the third alternative waypoint, the fourth alternative waypoint, and the second waypoint as the second alternative route; S313: Calculate the Cartesian distance between the first alternative route and the second alternative route, and use the alternative route with the shorter Cartesian distance as the obstacle avoidance route between the first waypoint and the second waypoint; S314. Plan obstacle avoidance routes between other waypoints according to the above method. If the curved sides of the first curved surface and the second curved surface both exceed the preset flight area, that is, there is no tangent point between the first curved surface and the first waypoint and the second waypoint, and there is no tangent point between the second curved surface and the first waypoint and the second waypoint, then based on the position of the first obstacle point in the three-dimensional scene, the current altitude of the first obstacle is obtained, and a first preset threshold is added to the current altitude of the first obstacle. The altitude after adding the first preset threshold is used as the new flight altitude of the modified first waypoint and second waypoint, the waypoints after the modified flight altitude are used as the new first waypoint and second waypoint, and the route formed by the new first waypoint and second waypoint is used as the obstacle avoidance route.

2. The automatic obstacle avoidance method for a UAV according to claim 1, characterized in that: The step of obtaining the boundary of the obstacle area of ​​the preset flight area includes: S110, obtaining terrain data and / or CAD planning data and / or BIM model data of a preset flight area; S111. Overlaying layers based on terrain data and / or CAD planning data and / or BIM model data of the preset flight area and determining the type and boundary of each obstacle, and setting a safety distance based on the type of each obstacle. S112: Divide the preset flight area into an obstacle area and a non-obstacle area based on the boundaries of each obstacle and the safety distance corresponding to each obstacle.

3. An automatic obstacle avoidance system for a drone, characterized in that: The automatic obstacle avoidance method for a drone according to claim 1 or 2 comprises: An acquisition module, used to obtain the boundary of the obstacle area of ​​the preset flight area and the preset route; The control module is used to determine whether a first obstacle point exists based on the boundary and the preset route; or to determine whether to re-plan the drone path based on the judgment result.

4. An electronic device, characterized in that: include: Memory; and a processor, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the automatic obstacle avoidance method for a drone according to claim 1 or 2 is implemented.

Citation Information

Patent Citations

  • Circular roadblock avoiding-based sea route planning algorithm

    CN110470299A

  • Flight route generation method and device, unmanned aerial vehicle system and storage medium

    CN113939786A

  • Three-dimensional track planning method based on free space and A* algorithm

    CN114740898A

  • Method, system and device for measuring earthwork volume by combining BIM with unmanned aerial vehicle and storage medium

    CN115979125A

  • Unmanned aerial vehicle dynamic obstacle avoidance method, system and device based on salient point translation and medium

    CN116430906A