UAV joint inspection method, device, electronic equipment and storage medium

Abstract

The present invention provides a method, device, electronic device, and storage medium for joint inspection by unmanned aerial vehicles (UAVs), relating to the field of UAV technology. The method comprises the following steps: obtaining a pre-generated inspection task; determining whether to conduct a joint inspection based on the inspection task and a first operating range of a first base station; if a joint inspection is to be conducted, determining a second base station for joint inspection with the first base station based on the first operating range; formulating a joint inspection route based on the inspection task, the first operating range, and the second operating range of the second base station; capturing images of inspection points of interest in the inspection task via the joint inspection route, with the UAV's pan-tilt camera facing the inspection points of interest during image capture; and conducting a joint inspection via the joint inspection route by a first UAV at the first base station and a second UAV at the second base station. This method utilizes UAVs from multiple base stations to jointly complete the inspection task, overcoming the problems of insufficient operating range of a single base station and insufficient UAV battery power.

Description

Technical Field

[0001] The present invention relates to the field of drone technology, and in particular to a drone joint inspection method, device, electronic equipment and storage medium. Background Art

[0002] With the development of technology, the use of drones for inspections has become increasingly common. In related technologies, drone base stations (airports) can control corresponding drones and issue inspection tasks to them. However, some inspection tasks involve a large inspection range, which may exceed the operating range of the corresponding drone base station, making it impossible for the drone to complete the inspection task. Alternatively, even if the inspection range is within the working range, the battery may not be able to support the entire inspection task. This requires the drone to interrupt the mission to recharge before continuing. Whether the working range is insufficient or the drone battery is insufficient to support the entire inspection task, this increases the limitations of drone inspections. Summary of the Invention

[0003] In view of this, the purpose of the present invention is to provide a drone joint inspection method, device, electronic equipment and storage medium, which can jointly complete the inspection task through the joint inspection of drones of multiple base stations, overcome the problems of insufficient working range of a single base station and insufficient power of drones, and reduce the limitations of drone inspections.

[0004] In a first aspect, an embodiment of the present invention provides a method for joint inspection by unmanned aerial vehicles (UAVs), the method comprising: obtaining a pre-generated inspection task; determining whether to conduct a joint inspection based on the inspection task and a first working range of a first base station; if a joint inspection is to be conducted, determining a second base station for joint inspection with the first base station based on the first working range; formulating a joint inspection route based on the inspection task, the inspection power corresponding to the inspection task, the first working range, and the second working range of the second base station; performing image acquisition of inspection points of interest in the inspection task through the joint inspection route, with the gimbal camera of the UAV facing the inspection points of interest during image acquisition; a first UAV of the first base station and a second UAV of the second base station performing a joint inspection through the joint inspection route.

[0005] In a preferred embodiment of the present invention, the above-mentioned determination of whether to conduct a joint inspection based on the inspection task and the first working range of the first base station includes: determining a target inspection route based on the inspection task; determining whether the target inspection route is completely contained in the first working range; if the target inspection route is not completely contained in the first working range, determining to conduct a joint inspection.

[0006] In a preferred embodiment of the present invention, the above-mentioned determination of the target inspection route based on the inspection task includes: determining the inspection waypoints and inspection points of interest based on the inspection task; determining the surrounding waypoints based on the inspection points of interest through a pre-set surrounding radius, number of waypoints and shooting targets; jointly numbering the inspection waypoints and the surrounding waypoints to obtain a numbering sequence; connecting the inspection waypoints and the surrounding waypoints in the numbering sequence to form the target inspection route; the target inspection route is marked with the drone navigation information corresponding to the inspection waypoints and the surrounding waypoints; the drone navigation information includes: drone angle information, drone speed information and drone altitude information.

[0007] In a preferred embodiment of the present invention, the above-mentioned drone angle information includes: a heading deflection angle and a gimbal pitch angle; the drone navigation information is determined by: determining the drone speed information, drone height information and drone position information based on the inspection task; the drone speed information includes: the first speed information corresponding to the inspection waypoint; the drone height information includes: the first height information corresponding to the inspection waypoint and the second height information corresponding to the inspection point of interest; the drone position information includes: the first position information corresponding to the inspection waypoint and the second position information corresponding to the inspection point of interest; the waypoint position corresponding to the first position information and the waypoint position corresponding to the second position information are arranged in numbered order; the waypoint height corresponding to the first height information and the waypoint height corresponding to the second height information are arranged in numbered order; the heading deflection angle is determined based on the arranged waypoint position and the arranged waypoint height; the third height information, second speed information and third position information corresponding to each of the surrounding waypoints are set based on the shooting target; the gimbal pitch angle is determined based on the second position information, the third position information, the second height information and the third height information.

[0008] In a preferred embodiment of the present invention, the above-mentioned determination of the second base station for joint inspection with the first base station based on the first working range includes: determining a partial target inspection route located outside the first working range; determining whether the partial target inspection route includes a circling waypoint; if it does not include a circling waypoint, performing base station screening based on the partial target inspection route to determine a candidate second base station whose working range includes the partial target inspection route; and selecting the candidate second base station closest to the first base station as the second base station.

[0009] In a preferred embodiment of the present invention, after determining whether a partial target inspection route includes a circling waypoint, the method further includes: if it includes a circling waypoint, determining the target inspection interest point corresponding to the circling waypoint; performing base station screening based on all circling waypoints corresponding to the partial target inspection route and the target inspection interest point, and determining a candidate second base station whose working range includes the partial target inspection route.

[0010] In a preferred embodiment of the present invention, the above-mentioned joint inspection route is formulated based on the inspection task, the inspection power corresponding to the inspection task, the first working range and the second working range of the second base station, including: determining the base station for executing the task first and the base station for executing the task later based on the distances between the first base station and the second base station and the starting waypoint of the target inspection route respectively; circle the target inspection route based on the maximum working range corresponding to the base station for executing the task first; circle part of the target inspection route outside the circled range through the working range of the base station for executing the task later; if there are inspection waypoints and / or surrounding waypoints with incoherent numbering sequence within the circled range of the base station for executing the task first, then narrow the circled range corresponding to the base station for executing the task first and expand the circled range corresponding to the base station for executing the task later, until the inspection waypoints and / or the numbering sequence of the surrounding waypoints is consistent; based on the inspection power, the inspection route power of the first target route composed of the inspection waypoints and / or surrounding waypoints with a consistent numbering sequence is estimated to obtain an estimated result; if the estimated result indicates that the inspection power corresponding to the first target route is less than the full power of the drone, then the first target route composed of the inspection waypoints and / or surrounding waypoints with a consistent numbering sequence is used as the route corresponding to the base station that first executes the task, and the next waypoint of the first target route is used as a transition waypoint; the second target route other than the first target route in the target inspection route is used as the route corresponding to the base station that later executes the task; wherein, the starting waypoint of the base station that first executes the task is the starting waypoint of the target inspection route, and the starting waypoint of the base station that later executes the task is the transition waypoint; the first target route and the second target route constitute a joint inspection route.

[0011] In a second aspect, an embodiment of the present invention also provides a UAV joint inspection device, including: an inspection task acquisition module for acquiring a pre-generated inspection task; a joint inspection determination module for determining whether to perform a joint inspection based on the inspection task and the first working range of the first base station; a second base station determination module for determining, based on the first working range, a second base station for joint inspection with the first base station if a joint inspection is performed; a joint inspection route formulation module for formulating a joint inspection route based on the inspection task, the first working range, and the second working range of the second base station; performing image acquisition of inspection points of interest in the inspection task through the joint inspection route, and the pan-tilt camera of the UAV is opposite to the inspection points of interest when performing image acquisition; a joint inspection module for performing a joint inspection through the joint inspection route by a first UAV of the first base station and a second UAV of the second base station.

[0012] In a third aspect, an embodiment of the present invention further provides an electronic device comprising a processor and a memory, wherein the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the UAV joint inspection method of the first aspect mentioned above.

[0013] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the drone joint inspection method of the first aspect mentioned above.

[0014] The embodiments of the present invention bring the following beneficial effects:

[0015] An embodiment of the present invention provides a method, device, electronic device, and storage medium for joint inspection by unmanned aerial vehicles. The method obtains a pre-generated inspection task, determines whether to conduct a joint inspection based on the inspection task and the first working range of the first base station; if a joint inspection is to be conducted, determines a second base station for joint inspection with the first base station based on the first working range, and formulates a joint inspection route based on the inspection task, the first working range, and the second working range of the second base station; wherein, images of inspection points of interest in the inspection task are captured through the joint inspection route, and when capturing images, the gimbal camera of the unmanned aerial vehicle is opposite to the inspection points of interest; a first unmanned aerial vehicle of the first base station and a second unmanned aerial vehicle of the second base station conduct a joint inspection through the joint inspection route. In this method, the inspection task is completed jointly by unmanned aerial vehicles of multiple base stations, overcoming the problems of insufficient working range of a single base station and insufficient battery power of the unmanned aerial vehicle, and reducing the limitations of unmanned aerial vehicle inspections.

[0016] Other features and advantages of the present disclosure will be set forth in the following description, or some features and advantages may be inferred or unambiguously determined from the description, or may be learned by practicing the above-mentioned technology of the present disclosure.

[0017] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 A flowchart of a UAV joint inspection method provided by an embodiment of the present invention;

[0020] Figure 2 A flowchart of another UAV joint inspection method provided by an embodiment of the present invention;

[0021] Figure 3A flowchart of another UAV joint inspection method provided by an embodiment of the present invention;

[0022] Figure 4 A flowchart of formulating a joint inspection route based on an inspection task, the inspection power corresponding to the inspection task, a first working range, and a second working range of a second base station in a joint inspection method for unmanned aerial vehicles provided in an embodiment of the present invention;

[0023] Figure 5 A schematic structural diagram of a UAV combined inspection device provided by an embodiment of the present invention;

[0024] Figure 6 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0025] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0026] With the development of technology, the use of drones for inspections has become increasingly common. In related technologies, drone base stations (airports) can control corresponding drones and issue inspection tasks to them. However, some inspection tasks involve a large inspection range, which may exceed the operating range of the corresponding drone base station, making it impossible for the drone to complete the inspection task. Alternatively, even if the inspection range is within the working range, the battery may not be able to support the entire inspection task. This requires the drone to interrupt the mission to recharge before continuing. Whether the working range is insufficient or the drone battery is insufficient to support the entire inspection task, this increases the limitations of drone inspections.

[0027] Based on this, an embodiment of the present invention provides a method, device, electronic device, and storage medium for joint inspection by unmanned aerial vehicles (UAVs). The method can obtain a pre-generated inspection task, determine whether to conduct a joint inspection based on the inspection task and the first working range of the first base station; if a joint inspection is to be conducted, determine the second base station for joint inspection with the first base station based on the first working range, and formulate a joint inspection route based on the inspection task, the first working range, and the second working range of the second base station; wherein, images of inspection points of interest in the inspection task are captured through the joint inspection route, and when capturing images, the gimbal camera of the UAV is opposite to the inspection points of interest; the first UAV of the first base station and the second UAV of the second base station conduct a joint inspection through the joint inspection route. In this method, the inspection task is completed jointly by the joint inspection of UAVs of multiple base stations, overcoming the problems of insufficient working range of a single base station and insufficient power of the UAV, and reducing the limitations of UAV inspections.

[0028] To facilitate understanding of this embodiment, a UAV joint inspection method disclosed in an embodiment of the present invention is first introduced in detail.

[0029] Example 1

[0030] The embodiment of the present invention provides a UAV joint inspection method. Figure 1 The flowchart of a UAV joint inspection method provided by an embodiment of the present invention. Figure 1 As shown, the UAV joint inspection method may include the following steps:

[0031] Step S101: Acquire a pre-generated inspection task.

[0032] Among them, the inspection task can be generated regularly according to the inspection plan, for example, it can be generated regularly at a specified time every day or every week.

[0033] Among them, the inspection task may include: target inspection route, the target inspection route is marked with drone navigation information, the drone navigation information may include: drone angle information, drone speed information and drone altitude information, and the drone angle information may include: heading deflection angle and gimbal pitch angle.

[0034] Step S102: determining whether to perform a joint inspection based on the inspection task and the first working range of the first base station.

[0035] Among them, the target inspection route can be determined first through the inspection task. If the target inspection route is all included in the first working range, it can be said that the first base station can cover the target inspection route, and there is no need for joint inspection; if the target inspection route has a part that is not included in the first working range, it can be said that the first base station cannot cover all the target inspection routes, and a joint inspection is required.

[0036] Step S103: If a joint inspection is to be performed, a second base station for joint inspection with the first base station is determined based on the first working range.

[0037] Among them, there can be multiple base stations around the first base station, and the second base station needs to be screened from the multiple base stations. The target inspection route has a starting point and an end point. The drone starts from the starting point and reaches the end point along the trajectory corresponding to the target inspection route. This process requires the first base station and the second base station to complete it together in a relay manner. Therefore, the end point reached by the drone that takes off first is usually used as the starting point for the drone that takes off later. Therefore, the first working range can be gradually narrowed until the part of the target inspection route included in the first working range is a coherent trajectory. At this time, the base station closest to the first base station is selected as the second base station among the base stations whose working range can include the remaining target inspection routes.

[0038] If a joint inspection is not performed, the first drone of the first base station performs the inspection along the target inspection route.

[0039] Step S104 , formulating a joint inspection route based on the inspection task, the inspection power corresponding to the inspection task, the first working range, and the second working range of the second base station.

[0040] Among them, images of inspection points of interest in the inspection mission are collected through the joint inspection route, and the gimbal camera of the drone is opposite to the inspection points of interest during image collection.

[0041] The inspection routes of the two base stations can be determined by the inspection tasks, the inspection power corresponding to the inspection tasks, the first working range and the second working range of the second base station, and the two inspection routes form a joint inspection route.

[0042] In step S105 , the first drone of the first base station and the second drone of the second base station perform a joint inspection along a joint inspection route.

[0043] Among them, one drone will perform the corresponding inspection task from the starting point until it reaches the target point and completes the corresponding inspection task. Then another drone will use the next point after the target point as the starting point to perform the corresponding inspection task until it reaches the end point.

[0044] The method for joint inspection by unmanned aerial vehicles provided in an embodiment of the present invention can determine whether to conduct a joint inspection based on the inspection task and the first working range of the first base station by obtaining a pre-generated inspection task; if a joint inspection is to be conducted, a second base station for joint inspection with the first base station is determined based on the first working range, and a joint inspection route is formulated based on the inspection task, the first working range, and the second working range of the second base station; wherein, images of inspection points of interest in the inspection task are captured through the joint inspection route, and the gimbal camera of the unmanned aerial vehicle is opposite to the inspection points of interest during image capture; the first unmanned aerial vehicle of the first base station and the second unmanned aerial vehicle of the second base station conduct a joint inspection through the joint inspection route. In this method, the inspection task is completed jointly by the joint inspection of unmanned aerial vehicles of multiple base stations, which overcomes the problems of insufficient working range of a single base station and insufficient battery power of the unmanned aerial vehicle, and reduces the limitations of unmanned aerial vehicle inspections.

[0045] Example 2

[0046] An embodiment of the present invention also provides another UAV joint inspection method; this method is implemented based on the method of the above embodiment; this method focuses on describing the specific implementation method of determining whether to perform a joint inspection based on the inspection task and the first working range of the first base station.

[0047] Figure 2 A flowchart of another UAV joint inspection method provided by an embodiment of the present invention is shown as follows: Figure 2 As shown, the step of determining whether to perform a joint inspection based on the inspection task and the first working range of the first base station may include the following steps:

[0048] Step S201: determining a target inspection route based on the inspection task.

[0049] Specifically, determining the target inspection route based on the inspection task may include: determining the inspection waypoints and inspection points of interest based on the inspection task; determining the circling waypoints based on the inspection points of interest through a pre-set circling radius, number of waypoints and shooting targets; jointly numbering the inspection waypoints and circling waypoints to obtain a numbering sequence; and connecting the inspection waypoints and circling waypoints in the numbering sequence to form the target inspection route.

[0050] Among them, the inspection points of interest are points that require the drone to circle and shoot with the lens always aimed at. The shooting target is the demand for shooting the inspection points of interest, such as the angle requirement. Combined with the circling radius and the number of waypoints, the number of circling waypoints, the distance from the inspection points of interest, and the height can be determined.

[0051] Among them, the inspection waypoints and the circling waypoints are both waypoints, which together constitute the inspection trajectory. The inspection waypoints and the circling waypoints can be jointly numbered in sequence according to the target inspection route to obtain a numbering sequence.

[0052] Among them, the target inspection route is marked with the drone navigation information corresponding to the inspection waypoints and the circling waypoints.

[0053] Among them, the drone navigation information includes: drone angle information, drone speed information and drone altitude information.

[0054] Among them, the drone angle information may include: heading deflection angle and gimbal pitch angle.

[0055] Specifically, the method for determining the drone navigation information can be: determining the drone speed information, drone height information and drone position information based on the inspection task; the drone speed information includes: the first speed information corresponding to the inspection waypoint; the drone height information includes: the first height information corresponding to the inspection waypoint and the second height information corresponding to the inspection point of interest; the drone position information includes: the first position information corresponding to the inspection waypoint and the second position information corresponding to the inspection point of interest; arranging the waypoint position corresponding to the first position information and the waypoint position corresponding to the second position information in numbered order; arranging the waypoint height corresponding to the first height information and the waypoint height corresponding to the second height information in numbered order; determining the heading deflection angle based on the arranged waypoint position and the arranged waypoint height; setting the third height information, second speed information and third position information corresponding to each of the surrounding waypoints based on the shooting target; determining the gimbal pitch angle based on the second position information, the third position information, the second height information and the third height information.

[0056] Step S202: Determine whether the target inspection route is completely included in the first working range.

[0057] The first working range is the range of a circle with the first base station as the center and the farthest working distance as the radius.

[0058] Step S203: If the target inspection route is not completely included in the first working range, it is determined to perform a joint inspection.

[0059] When the target inspection route is not completely included in the first working range, it can be considered that the first base station cannot complete the corresponding inspection task alone and needs other base stations to perform joint inspection.

[0060] Example 3

[0061] An embodiment of the present invention also provides another UAV joint inspection method; this method is implemented on the basis of the method of the above embodiment; this method focuses on describing the specific implementation method of determining the second base station for joint inspection with the first base station based on the first working range.

[0062] Figure 3 A flowchart of another UAV joint inspection method provided by an embodiment of the present invention is as follows: Figure 3As shown, the process of determining the second base station for joint inspection with the first base station based on the first working range may include the following steps:

[0063] Step S301: determining a portion of target inspection routes outside a first working range.

[0064] Step S302: Determine whether the partial target inspection route includes a circling waypoint.

[0065] Among them, the circling waypoints are set around the inspection interest points. For an inspection interest point, some circling waypoints may be within the first working range, and some circling waypoints may be outside the first working range. At this time, the target inspection route will be divided and discontinuous, and it will be impossible to realize the inspection task of multiple base stations relaying. Therefore, it is necessary to determine whether some target inspection routes contain circling waypoints.

[0066] Step S303: If a surrounding waypoint is included, determine the target inspection interest point corresponding to the surrounding waypoint.

[0067] Step S304 , performing base station screening based on all surrounding waypoints corresponding to the partial target inspection route and the target inspection point of interest, and determining a candidate second base station whose working range includes the partial target inspection route.

[0068] Among them, when including circling waypoints, all circling waypoints corresponding to the target inspection interest point are excluded from the working range of the first base station, and the base station whose working range includes all circling waypoints corresponding to the target inspection interest point and part of the target inspection route is the candidate second base station.

[0069] The numbering sequence of the inspection waypoints and / or circling waypoints included in the part of the target inspection route is after the numbering sequence of the circling waypoints corresponding to the target inspection point of interest.

[0070] Step S305: If the circling waypoint is not included, base station screening is performed based on the partial target inspection route to determine a candidate second base station whose working range includes the partial target inspection route.

[0071] The numbering sequence of the inspection waypoints and / or circling waypoints included in the target inspection route is subsequent to the numbering sequence of the inspection waypoints and / or circling waypoints included in the first working range.

[0072] Step S306: select the candidate second base station closest to the first base station as the second base station.

[0073] Furthermore, there may be a situation where the working range cannot include some target inspection routes. In this case, a third base station can be added to jointly complete the inspection task. While ensuring the continuity of the numbering sequence of the inspection waypoints and / or surrounding waypoints within the working range of the first base station, the second base station can be used in the same way to ensure the continuity of the numbering sequence of the inspection waypoints and / or surrounding waypoints within the second working range. At this time, the working range can include the remaining target inspection routes and the base station closest to the second base station is the third base station.

[0074] The above are just illustrative examples, and the number of base stations is determined according to actual conditions.

[0075] Example 4

[0076] An embodiment of the present invention also provides another method for joint inspection of drones; this method is implemented based on the method of the above embodiment; this method focuses on describing the specific implementation method of formulating a joint inspection route based on the inspection task, the inspection power corresponding to the inspection task, the first working range and the second working range of the second base station.

[0077] Figure 4 A flowchart of another UAV joint inspection method provided by an embodiment of the present invention is shown as follows: Figure 4 As shown, formulating a joint inspection route based on the inspection task, the inspection power corresponding to the inspection task, the first working range and the second working range of the second base station may include the following steps:

[0078] Step S401 : determining a base station for executing the task first and a base station for executing the task later based on the distances between the first base station and the second base station and the starting point of the target inspection route respectively.

[0079] Among them, the base station close to the starting waypoint can be used as the base station for executing the task first, and the base station far from the starting waypoint can be used as the base station for executing the task later.

[0080] Step S402: The target inspection route is circled based on the maximum working range corresponding to the base station that first performs the task.

[0081] Step S403: circle the working range of the base station that performs the task after the target inspection route passes outside the circled range.

[0082] In step S404, if there are inspection waypoints and / or circling waypoints with inconsistent numbering sequence within the circled range of the base station that first performs the task, the circled range corresponding to the base station that first performs the task is narrowed and the circled range corresponding to the base station that later performs the task is expanded until the numbering sequence of the inspection waypoints and / or circling waypoints is consistent within the circled range of the base station that first performs the task.

[0083] Step S405 , based on the inspection power, an inspection route power estimation is performed on the first target route consisting of inspection waypoints and / or surrounding waypoints with consecutive numbering sequences to obtain an estimation result.

[0084] In step S406, if the estimated result indicates that the inspection power corresponding to the first target route is less than the full power of the drone, the first target route consisting of inspection waypoints and / or surrounding waypoints with consecutive numbering sequence is used as the route corresponding to the base station for the first mission execution, and the next waypoint of the first target route is used as a transition waypoint.

[0085] Step S407: The second target route in the target inspection route except the first target route is used as the route corresponding to the base station for subsequent task execution.

[0086] Among them, the starting waypoint of the base station that executes the task first is the starting waypoint of the target inspection route, and the starting waypoint of the base station that executes the task later is the transition waypoint; the first target route and the second target route constitute a joint inspection route.

[0087] Based on the above-mentioned UAV joint inspection method, a UAV management platform system can be further proposed, which can perform base station management, UAV management, alarm management, task management, inspection plan management and route management.

[0088] Specifically, regarding base station management: When adding a new base station, enter the nest name, nest model, equipment SN, selected drone, bound off-nest monitoring, GPS coordinates, and operating radius. Each drone airport represents a base station. Base stations can interact with each other through inspection plans, forming a mesh inspection route, solving the problems of limited range and flight range at a single point. A mesh inspection route is manually created when establishing an inspection route. When establishing an inspection route or inspection plan, you can select at least two airports for joint inspections.

[0089] Specifically, regarding drone management: the problem of binding base stations and drones has been solved, and base station drones can be bound, unbound, and replaced at any time.

[0090] Specifically, regarding alarm management: algorithm analysis is performed based on the images obtained from drone inspections. For example, the images can be sent to the algorithm server for identification. Conventional algorithm identification such as vehicle identification, pedestrian identification, and fire alarm identification can be performed. If violations are discovered, an alarm will be issued immediately and automatic announcements will be made.

[0091] Specifically, regarding task management: you can manage the tasks that the drone has performed in the past, ongoing tasks, and tasks to be performed in the future. For ongoing tasks, you can see the drone's real-time location, inspection progress, inspection results, alarm records, inspection routes, etc., and communicate with the drone airport through the middleware mqtt. The system sends messages to mqtt, and the drone airport receives messages from mqtt; for scheduled tasks, the system generates the corresponding route file in advance, and pushes the file to mqtt 30 seconds in advance. After the drone airport receives it, it executes the route flight. After the flight, the drone airport will The shooting results during the flight are uploaded back to the system and can be viewed by the system. During the flight, the drone continuously reports its own status through the drone airport-mqtt-system, including real-time location, inspection progress, flight speed, altitude, etc. You can enter the map interface through the task details. On one side are the task information and route information. The map overlay displays the waypoints. If it is flying, it will also obtain the current real-time information of the drone and overlay it on the map for display, including the drone shooting results. Specifically, the drone will bring its own GPS coordinates when sending back the results. You can overlay icons on the map based on the coordinates and click the icons to view the results.

[0092] Specifically, regarding inspection plan management: daily or weekly inspection tasks can be generated regularly through the inspection plan, and the drone will conduct inspections at the corresponding time, without the need for manual task setting, to achieve the function of daily automatic inspections.

[0093] Specifically, regarding route management: by setting waypoints, flight trajectories, points of interest, and gimbal camera angles, customized routes can be achieved. When generating inspection tasks, the corresponding routes can be selected for inspection. The route file is a kml file similar to the XML format. We only need to generate a file that it can recognize according to the corresponding format requirements to achieve a customized route. Instead of having to use a remote control to set the route, the route can be determined through the joint inspection route determination method mentioned in the UAV joint inspection method.

[0094] Example 5

[0095] Corresponding to the above method embodiment, the embodiment of the present invention provides a UAV joint inspection device, Figure 5 A schematic diagram of the structure of a UAV joint inspection device provided by an embodiment of the present invention is shown as follows: Figure 5 As shown, the UAV joint inspection device may include:

[0096] The inspection task acquisition module 501 is used to acquire pre-generated inspection tasks.

[0097] The joint inspection determination module 502 is configured to determine whether to perform a joint inspection based on the inspection task and the first operating range of the first base station.

[0098] The second base station determining module 503 is configured to determine, based on the first working range, a second base station for joint inspection with the first base station if joint inspection is performed.

[0099] The joint inspection route formulation module 504 is used to formulate a joint inspection route based on the inspection task, the first working range and the second working range of the second base station; the image of the inspection interest points in the inspection task is collected through the joint inspection route, and the gimbal camera of the drone is relative to the inspection interest points during image collection.

[0100] The joint inspection module 505 is used for the first UAV of the first base station and the second UAV of the second base station to perform a joint inspection through a joint inspection route.

[0101] The drone joint inspection device provided by the embodiment of the present invention can obtain a pre-generated inspection task, and determine whether to conduct a joint inspection based on the inspection task and the first working range of the first base station; if a joint inspection is to be conducted, a second base station for joint inspection with the first base station is determined based on the first working range, and a joint inspection route is formulated based on the inspection task, the first working range, and the second working range of the second base station; wherein, images of inspection points of interest in the inspection task are captured through the joint inspection route, and when capturing images, the gimbal camera of the drone is opposite to the inspection points of interest; the first drone of the first base station and the second drone of the second base station conduct a joint inspection through the joint inspection route. In this method, the inspection task is completed jointly by drones of multiple base stations, which overcomes the problems of insufficient working range of a single base station and insufficient battery power of the drone, and reduces the limitations of drone inspections.

[0102] In some embodiments, the joint inspection determination module is further used to determine a target inspection route based on the inspection task; determine whether the target inspection route is completely included in the first working range; if the target inspection route is not completely included in the first working range, determine to perform a joint inspection.

[0103] In some embodiments, the joint inspection determination module is also used to determine inspection waypoints and inspection points of interest based on the inspection tasks; determine the circling waypoints based on the inspection points of interest through a pre-set circling radius, number of waypoints and shooting targets; jointly number the inspection waypoints and circling waypoints to obtain a numbering sequence; connect the inspection waypoints and circling waypoints in the numbering sequence to form a target inspection route; the target inspection route is marked with the drone navigation information corresponding to the inspection waypoints and circling waypoints; the drone navigation information includes: drone angle information, drone speed information and drone altitude information.

[0104] In some embodiments, the joint inspection determination module is also used to determine the drone speed information, drone height information and drone position information based on the inspection task; the drone speed information includes: the first speed information corresponding to the inspection waypoint; the drone height information includes: the first height information corresponding to the inspection waypoint and the second height information corresponding to the inspection point of interest; the drone position information includes: the first position information corresponding to the inspection waypoint and the second position information corresponding to the inspection point of interest; the waypoint position corresponding to the first position information and the waypoint position corresponding to the second position information are arranged in numbered order; the waypoint height corresponding to the first height information and the waypoint height corresponding to the second height information are arranged in numbered order; the heading deflection angle is determined based on the arranged waypoint position and the arranged waypoint height; the third height information, second speed information and third position information corresponding to each of the surrounding waypoints are set based on the shooting target; the gimbal pitch angle is determined based on the second position information, the third position information, the second height information and the third height information.

[0105] In some embodiments, the second base station determination module is also used to determine a portion of the target inspection route located outside the first working range; determine whether the portion of the target inspection route includes a circling waypoint; if it does not include a circling waypoint, perform base station screening based on the portion of the target inspection route to determine a candidate second base station whose working range includes the portion of the target inspection route; and use the candidate second base station closest to the first base station as the second base station.

[0106] In some embodiments, the second base station determination module is further used to determine the target inspection point of interest corresponding to the surrounding waypoint if it includes a surrounding waypoint; perform base station screening based on all surrounding waypoints corresponding to part of the target inspection route and the target inspection point of interest, and determine a candidate second base station whose working range includes part of the target inspection route.

[0107] In some embodiments, the joint inspection route formulation module is further used to determine the base station for performing the task first and the base station for performing the task later based on the distances between the first base station and the second base station and the starting waypoint of the target inspection route respectively; circle the target inspection route based on the maximum working range corresponding to the base station for performing the task first; circle part of the target inspection route outside the circled range through the working range of the base station for performing the task later; if there are inspection waypoints and / or surrounding waypoints with inconsistent numbering sequence within the circled range of the base station for performing the task first, then narrow the circled range corresponding to the base station for performing the task first and expand the circled range corresponding to the base station for performing the task later, until the numbering sequence of the inspection waypoints and / or surrounding waypoints is consistent within the circled range of the base station for performing the task first; based on the inspection power An inspection route power estimation is performed on the first target route composed of inspection waypoints and / or circling waypoints with consecutive numbering sequence to obtain an estimation result; if the estimation result indicates that the inspection power corresponding to the first target route is less than the full power of the UAV, the first target route composed of inspection waypoints and / or circling waypoints with consecutive numbering sequence is used as the route corresponding to the base station that first executes the task, and the next waypoint of the first target route is used as the transition waypoint; the second target route other than the first target route in the target inspection route is used as the route corresponding to the base station that later executes the task; wherein, the starting waypoint of the base station that first executes the task is the starting waypoint of the target inspection route, and the starting waypoint of the base station that later executes the task is the transition waypoint; the first target route and the second target route constitute a joint inspection route.

[0108] The device provided in the embodiment of the present invention has the same implementation principle and technical effects as those in the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference can be made to the corresponding content in the aforementioned method embodiment.

[0109] Example 6

[0110] The embodiment of the present invention also provides an electronic device for running the above-mentioned UAV joint inspection method; see Figure 6 A structural schematic diagram of an electronic device is shown, which includes a memory 600 and a processor 601, wherein the memory 600 is used to store one or more computer instructions, and the one or more computer instructions are executed by the processor 601 to implement the above-mentioned drone joint inspection method.

[0111] Further, Figure 6 The electronic device shown further includes a bus 602 and a communication interface 603 , and the processor 601 , the communication interface 603 and the memory 600 are connected via the bus 602 .

[0112] The memory 600 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is achieved through at least one communication interface 603 (which may be wired or wireless), and may use the Internet, a wide area network, a local area network, a metropolitan area network, etc. The bus 602 may be an ISA bus, a PCI bus, or an EISA bus. Buses can be divided into address buses, data buses, control buses, etc. For ease of representation, Figure 6 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0113] The processor 601 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits in the processor 601 or by software instructions. The above processor 601 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in conjunction with the embodiments of the present invention can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in memory 600, and processor 601 reads the information in memory 600 and, in conjunction with its hardware, completes the steps of the method of the aforementioned embodiment.

[0114] An embodiment of the present invention also provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the above-mentioned drone joint inspection method. The specific implementation can be found in the method embodiment and will not be repeated here.

[0115] The computer program product for the method of performing joint drone inspection provided in an embodiment of the present invention includes a computer-readable storage medium storing a non-volatile program code executable by a processor. The instructions included in the program code can be used to execute the method described in the previous method embodiment. For specific implementation, please refer to the method embodiment and will not be repeated here.

[0116] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0117] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. There may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be through some communication interface, indirect coupling or communication connection of devices or units, which may be electrical, mechanical or other forms.

[0118] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0119] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0120] If the functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include various media capable of storing program code, such as USB flash drives, mobile hard drives, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0121] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The scope of protection of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the above-described embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-described embodiments within the technical scope disclosed by the present invention, or replace some of the technical features therein with equivalents. Such modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A UAV joint inspection method, characterized in that: The method comprises: Get pre-generated inspection tasks; determining whether to perform a joint inspection based on the inspection task and the first working range of the first base station; If a joint inspection is to be performed, determining a second base station for joint inspection with the first base station based on the first working range; A joint inspection route is formulated based on the inspection task, the inspection power corresponding to the inspection task, the first working range, and the second working range of the second base station; images of inspection points of interest in the inspection task are captured through the joint inspection route, with the gimbal camera of the drone facing the inspection points of interest during the image capture; The first drone of the first base station and the second drone of the second base station perform a joint inspection along the joint inspection route; The determining whether to perform a joint inspection based on the inspection task and the first working range of the first base station includes: Determining a target inspection route based on the inspection task; determining whether the target inspection route is completely contained within the first working range; If the target inspection route is not completely included in the first working range, determining to perform a joint inspection; The determining of a target inspection route based on the inspection task includes: Determining inspection waypoints and inspection points of interest based on the inspection tasks; Determine the surrounding waypoints based on the inspection interest points by pre-set surrounding radius, number of waypoints and shooting targets; Jointly numbering the inspection waypoints and the circling waypoints to obtain a numbering sequence; The inspection waypoints and the circling waypoints are connected in the order of the numbers to form the target inspection route; the target inspection route is marked with the drone navigation information corresponding to the inspection waypoints and the circling waypoints; the drone navigation information includes: drone angle information, drone speed information and drone altitude information; The formulating a joint inspection route based on the inspection task, the inspection power corresponding to the inspection task, the first working range, and the second working range of the second base station includes: Determining a base station for executing the task first and a base station for executing the task later based on the distances between the first base station and the second base station and the starting point of the target inspection route respectively; Defining the target inspection route based on the maximum working range corresponding to the base station that first performs the task; Circle the part of the target inspection route outside the circled range through the working range of the post-task execution base station; If there are inspection waypoints and / or circling waypoints with inconsistent numbering sequence within the circled range of the first-performing task base station, narrow the circled range corresponding to the first-performing task base station and expand the circled range corresponding to the second-performing task base station until the numbering sequence of the inspection waypoints and / or circling waypoints is consistent within the circled range of the first-performing task base station; Based on the inspection power, an inspection route power estimation is performed on a first target route consisting of the inspection waypoints and / or the surrounding waypoints that are consecutively numbered to obtain an estimation result; If the estimated result indicates that the inspection power corresponding to the first target route is less than the full power of the drone, the first target route consisting of the inspection waypoints and / or the surrounding waypoints with consecutive numbering sequence is used as the route corresponding to the first mission execution base station, and the next waypoint of the first target route is used as a transition waypoint; Using a second target route in the target inspection route other than the first target route as the route corresponding to the subsequent task execution base station; The starting point of the first-performing base station is the starting point of the target inspection route, and the starting point of the second-performing base station is the transition point; the first target route and the second target route constitute a joint inspection route; Among them, the inspection points of interest are points where the drone needs to circle around and shoot with the lens always aimed at.

2. The method according to claim 1, characterized in that The drone angle information includes: heading deflection angle and gimbal pitch angle; the drone navigation information is determined as follows: Determine the drone speed information, drone altitude information, and drone position information based on the inspection task; the drone speed information includes: first speed information corresponding to the inspection waypoint; the drone altitude information includes: first altitude information corresponding to the inspection waypoint and second altitude information corresponding to the inspection point of interest; the drone position information includes: first position information corresponding to the inspection waypoint and second position information corresponding to the inspection point of interest; Arrange the waypoint positions corresponding to the first position information and the waypoint positions corresponding to the second position information in the order of the numbers; Arrange the waypoint heights corresponding to the first height information and the waypoint heights corresponding to the second height information in the order of the numbers; Determining the heading deflection angle based on the arranged waypoint positions and the arranged waypoint altitudes; Setting third altitude information, second speed information, and third position information corresponding to each of the surrounding waypoints based on the shooting target; The gimbal pitch angle is determined based on the second position information, the third position information, the second height information, and the third height information.

3. The method according to claim 1, characterized in that The determining, based on the first operating range, of a second base station for joint inspection with the first base station includes: determining a portion of the target inspection route outside the first working range; Determining whether part of the target inspection route includes the circling waypoint; If the circling waypoint is not included, performing base station screening based on part of the target inspection route to determine a candidate second base station whose working range includes part of the target inspection route; The candidate second base station closest to the first base station is used as the second base station.

4. The method according to claim 3, characterized in that After determining whether the target inspection route includes the circling waypoint, the method further includes: If the surrounding waypoint is included, determining the target inspection point of interest corresponding to the surrounding waypoint; Base station screening is performed based on all surrounding waypoints corresponding to part of the target inspection route and the target inspection point of interest, and a candidate second base station whose working range includes part of the target inspection route is determined.

5. A UAV joint inspection device, characterized in that: For implementing the UAV joint inspection method according to any one of claims 1 to 4, the device comprises: Inspection task acquisition module, used to obtain pre-generated inspection tasks; a joint inspection determination module, configured to determine whether to perform a joint inspection based on the inspection task and the first working range of the first base station; A second base station determining module is configured to determine, based on the first working range, a second base station for joint inspection with the first base station if a joint inspection is performed; a joint inspection route formulation module, configured to formulate a joint inspection route based on the inspection task, the first working range, and the second working range of the second base station; and to capture images of inspection points of interest in the inspection task using the joint inspection route, with the gimbal camera of the drone facing the inspection points of interest during image capture; The joint inspection module is used for the first UAV of the first base station and the second UAV of the second base station to perform a joint inspection along the joint inspection route.

6. An electronic device, characterized in that: The system comprises a processor and a memory, wherein the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the UAV joint inspection method according to any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are called and executed by the processor, the computer-executable instructions prompt the processor to implement the UAV joint inspection method according to any one of claims 1 to 4.

Images