UAV landing guidance method, device, equipment and storage medium
By using the gimbal camera in the drone to identify the positioning mark and calculate the offset, the drone landing accuracy and reliability problems are solved, and accurate landing in various environments is achieved.
Patent Information
- Application Number
- CN202210085062.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-25
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2042-01-25
AI Technical Summary
The existing drone landing solutions are not accurate enough and have poor reliability, especially in smooth and flat ground, uniform grassland, uniform land or darker environments.
By setting up a gimbal camera in the drone, detect whether there is a landing requirement for the drone to land, and identify multiple positioning signs on the apron to obtain the offset between the drone and the positioning sign, and according to the offset Guide the drone to land.
It realizes accurate landing of drones, improves the reliability of landing, and can ensure safe and accurate landing of drones in various environments.
Smart Images

Figure CN114527792B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of visual positioning technology, and in particular to a method, device, equipment and storage medium for guiding the landing of an unmanned aerial vehicle. Background Art
[0002] At present, the return and landing of most multi-rotor drones rely on GPS positioning, network RTK positioning, base station RTK positioning and visual comparison positioning. GPS positioning: The accuracy is not high enough, generally ±6~8m. This requires a large take-off and landing area. Network RTK positioning: The accuracy can reach ±0.1~0.3m. However, it depends on the operator's network signal. If the network signal is not good, this positioning method cannot be used. Base station RTK positioning: The accuracy can reach ±0.1~0.3m. However, an additional RTK base station needs to be set up. Visual comparison positioning: Compare the picture at landing and the picture at takeoff. The accuracy is not high enough and the reliability is poor. If you encounter non-feature textures, such as smooth and flat ground, uniform grass, uniform land, or dim light, it is likely to fail. The current drone landing solution is not accurate enough and has poor reliability.
[0003] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention
[0004] The main purpose of the present invention is to provide a UAV landing guidance method, device, equipment and storage medium, aiming to solve the technical problems of UAV landing solutions in the prior art that are not accurate enough and have poor reliability.
[0005] To achieve the above-mentioned object, the present invention provides a method for guiding a UAV to land, wherein a pan-tilt camera is provided in the UAV;
[0006] The UAV landing guidance method comprises:
[0007] Detect whether the drone to be landed has a landing requirement;
[0008] When the unmanned aerial vehicle to be landed has a landing demand, the gimbal camera identifies multiple positioning marks on the apron;
[0009] Obtaining the offset between the drone to be landed and each positioning mark;
[0010] The UAV to be landed is guided to land according to the offset.
[0011] Optionally, the detecting whether the drone to be landed has a landing requirement includes:
[0012] Get the current altitude of the drone above the landing pad;
[0013] When it is detected that the drone to be landed maintains the current altitude, it is determined that the drone to be landed has a landing requirement.
[0014] Optionally, obtaining the offset between the drone to be landed and each positioning mark includes:
[0015] Capturing an identifier image of each positioning identifier by means of the pan / tilt camera;
[0016] Determine the center point of the field of view of the pan / tilt camera;
[0017] The actual distance offset of each positioning identifier relative to the center point of the field of view and the angular offset of each positioning identifier are determined according to the identifier image.
[0018] Optionally, determining the actual distance offset of each positioning identifier relative to the center point of the field of view and the angular offset of each positioning identifier according to the identifier image includes:
[0019] Acquire the pixel side length of each positioning identifier and the pixel distance offset of each positioning identifier relative to the center point of the field of view from the identifier image;
[0020] Get the actual side length of each positioning identifier;
[0021] Calculate the actual distance offset of each positioning identifier relative to the center point of the field of view according to the pixel side length, the pixel distance offset and the actual side length;
[0022] The angle between each positioning identifier and the horizontal axis corresponding to the pan / tilt camera is determined according to the identifier image to obtain an angle offset.
[0023] Optionally, guiding the unmanned aerial vehicle to land according to the offset includes:
[0024] Calculate an average distance offset according to the actual distance offsets of each positioning identifier relative to the center point of the field of view;
[0025] Calculating an average angle offset according to the angle offsets of each positioning identifier;
[0026] The unmanned aerial vehicle to be landed is guided to land according to the average distance offset and the average angle offset.
[0027] Optionally, guiding the unmanned aerial vehicle to land according to the average distance offset and the average angle offset includes:
[0028] Calculating a distance adjustment amount according to the average distance offset;
[0029] Calculating an angle adjustment amount according to the average angle offset;
[0030] The unmanned aerial vehicle to be landed is controlled to move and rotate according to the distance adjustment amount and the angle adjustment amount to complete the landing.
[0031] Optionally, after guiding the unmanned aerial vehicle to land according to the offset, the method further includes:
[0032] Descending the drone to be landed from the current height to a new height according to the preset landing amplitude and the offset;
[0033] Maintaining the drone to be landed at a new altitude, and obtaining a new offset between the drone to be landed and each positioning mark;
[0034] Continue to guide the UAV to land according to the new offset;
[0035] Continue to execute the step of descending the drone to be landed from the current height to a new height according to the offset according to the preset landing amplitude, until the drone to be landed lands on the apron.
[0036] In addition, to achieve the above-mentioned purpose, the present invention also proposes a UAV landing guidance device, wherein the UAV is provided with a pan-tilt camera;
[0037] The UAV landing guidance device comprises:
[0038] A detection module is used to detect whether the UAV to be landed has a landing requirement;
[0039] A shooting module is used to identify multiple positioning marks on the apron through the gimbal camera when the unmanned aerial vehicle to be landed has a landing demand;
[0040] A calculation module, used to obtain the offset between the drone to be landed and each positioning mark;
[0041] The control module is used to guide the UAV to land according to the offset.
[0042] In addition, to achieve the above-mentioned objectives, the present invention also proposes a UAV landing guidance device, which includes: a memory, a processor, and a UAV landing guidance program stored in the memory and running on the processor, and the UAV landing guidance program is configured to implement the UAV landing guidance method described above.
[0043] In addition, to achieve the above-mentioned purpose, the present invention also proposes a storage medium, on which a drone landing guidance program is stored. When the drone landing guidance program is executed by a processor, the drone landing guidance method as described above is implemented.
[0044] The present invention detects whether a drone to be landed has a landing demand; when the drone to be landed has a landing demand, identifies multiple positioning marks on a helipad through the pan-tilt camera; obtains the offset between the drone to be landed and each positioning mark; guides the drone to land according to the offset, calculates the offset between the drone and each positioning identifier on the helipad, and guides the drone to land according to the offset, thereby ensuring that the drone lands accurately and improving the reliability of the drone landing. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] Figure 1 It is a structural diagram of a UAV landing guidance device in a hardware operating environment involved in an embodiment of the present invention;
[0046] Figure 2 This is a schematic diagram of the flow chart of the first embodiment of the UAV landing guidance method of the present invention;
[0047] Figure 3 This is a schematic diagram of a positioning identifier in an embodiment of a method for guiding a landing of an unmanned aerial vehicle according to the present invention;
[0048] Figure 4 This is a flow chart of a second embodiment of the method for guiding the landing of an unmanned aerial vehicle according to the present invention;
[0049] Figure 5 This is a schematic diagram of the flow chart of the third embodiment of the method for guiding the landing of an unmanned aerial vehicle according to the present invention;
[0050] Figure 6 This is a structural block diagram of the first embodiment of the UAV landing guidance device of the present invention.
[0051] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0052] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0053] Reference Figure 1 , Figure 1 The figure is a schematic diagram of the structure of the UAV landing guidance device in the hardware operating environment involved in the embodiment of the present invention.
[0054] like Figure 1As shown, the UAV landing guidance device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (Wireless-Fidelity, Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0055] Those skilled in the art will understand that Figure 1 The structure shown in does not constitute a limitation on the UAV landing guidance device, and may include more or fewer components than shown in the figure, or a combination of certain components, or a different arrangement of components.
[0056] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a drone landing guidance program.
[0057] exist Figure 1 In the drone landing guidance device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the drone landing guidance device of the present invention can be set in the drone landing guidance device, and the drone landing guidance device calls the drone landing guidance program stored in the memory 1005 through the processor 1001, and executes the drone landing guidance method provided by the embodiment of the present invention.
[0058] The embodiment of the present invention provides a method for guiding a drone to land, referring to Figure 2 , Figure 2 The figure is a flow chart of a first embodiment of a method for guiding a landing of an unmanned aerial vehicle according to the present invention.
[0059] In this embodiment, the UAV landing guidance method includes the following steps:
[0060] Step S10: Detect whether the drone to be landed has a landing requirement.
[0061] In this embodiment, the executor of this embodiment may be a UAV landing guidance device, which may be an electronic device such as a personal computer or a server, or other terminal devices that can achieve the same or similar functions. This embodiment is not limited to this. In this embodiment and the following embodiments, the UAV landing guidance method of the present invention is described by taking the UAV landing guidance device as an example.
[0062] It should be noted that the current drone landing methods include GPS positioning, network RTK positioning, base station RTK positioning and visual comparison positioning. However, the current drone landing methods are not accurate and have poor reliability. For example, GPS positioning: the accuracy is not high enough, generally with an accuracy of ±6 to 8m. This requires a larger take-off and landing area. Network RTK positioning: the accuracy can reach ±0.1 to 0.3m. However, it depends on the operator's network signal. If the network signal is not good, this positioning method cannot be used. Base station RTK positioning: the accuracy can reach ±0.1 to 0.3m. However, an additional RTK base station needs to be set up. Visual comparison positioning: compare the picture at landing and the picture at takeoff. The accuracy is not high enough and the reliability is poor. If you encounter non-feature textures, such as smooth and flat ground, uniform grass, uniform land, or dim light, it is likely to fail.
[0063] In order to solve the above problems, in this embodiment, the UAV is guided to land by the positioning identifier set on the landing mark. In this embodiment, it can be fully automatic without the need for human intervention, with accurate positioning, precise landing, and simultaneous control of the position and angle of the UAV. Specifically, it can be achieved in the following manner.
[0064] It should be noted that in this embodiment, the drone can be triggered to land based on a landing command input by the user. After receiving the landing command input by the user, the drone is controlled to land. A preset time can also be set. When the preset time is reached, the drone is controlled to land. This allows the drone to automatically land on the helipad after flying for a period of time.
[0065] In a specific implementation, before controlling the drone to land, it is necessary to detect whether the drone has a landing requirement. If the drone has a landing requirement, then control the drone to land. If not, the drone can be allowed to fly.
[0066] Furthermore, to control the landing of the UAV, it is necessary to ensure that the UAV is kept at a certain height. In this embodiment, it is possible to determine whether the UAV has a landing requirement by its height above the helipad.
[0067] In a specific implementation, in this embodiment, the current height of the drone to be landed above the helipad is detected in real time, and then whether the current height changes. If the current height changes in real time, it means that the drone is continuing to fly. If the current height does not change, it means that the drone to be landed is hovering at a certain height above the helipad. In this case, in this embodiment, it is determined that the drone to be landed has a landing demand. Furthermore, within a preset time period, the height of the drone to be landed above the helipad is always the current height, and it is determined that the current height has not changed. The preset time period can be set accordingly according to the actual determination requirements, and this is not limited in this embodiment.
[0068] It should be emphasized that a sensor is also provided on the drone to be landed, and the sensor is used to detect the height of the drone to be landed above the helipad.
[0069] Step S20: When the unmanned aerial vehicle to be landed has a landing demand, a plurality of positioning marks on the apron are identified by the gimbal camera.
[0070] In a specific implementation, a pan-tilt camera is also provided on the drone to be landed, and multiple positioning identifiers on the apron can be identified by the pan-tilt camera. Figure 3 As an example, Figure 3 The positioning identifier set in the AprilTag is used according to Figure 3 The placement shown is set on the apron, and the number, position and style of the positioning identifiers can be adjusted accordingly according to actual needs, which is not limited in this embodiment.
[0071] Step S30: Obtain the offset between the drone to be landed and each positioning mark.
[0072] In the specific implementation, in order to ensure that the drone to be landed lands on the apron without deviation, it is necessary to determine the deviation between the drone to be landed and each positioning identifier, that is, the offset. The offset in this embodiment includes the distance offset and the angle offset. The distance offset is the distance deviation between the drone to be landed and the positioning identifier. After the drone lands on the apron, it is also necessary to ensure that the drone's nose is in the specified direction. Figure 3 The nose direction shown in is the specified nose direction, and the angle offset is the horizontal rotation angle deviation between the current nose direction of the UAV to be landed and the specified nose direction.
[0073] Step S40: guiding the UAV to land according to the offset.
[0074] In the specific implementation, after determining the offset, the attitude of the drone to be landed is adjusted according to the offset in this embodiment, for example, the horizontal displacement of the drone to be landed and the horizontal rotation angle of the drone to be landed are adjusted, and it is necessary to ensure that the center point of the field of view of the gimbal camera on the drone to be landed is aligned with the horizontal displacement of the drone to be landed. Figure 3 The center points of the positioning identifiers shown coincide.
[0075] It should be emphasized that in this embodiment, the angle offset of the UAV to be landed is adjusted first, and after the angle offset is in the non-adjustment range, the distance offset of the UAV to be landed is further adjusted, and after the distance offset is in the surface adjustment range, the UAV to be landed is finally controlled to start landing.
[0076] This embodiment detects whether the drone to be landed has a landing demand; when the drone to be landed has a landing demand, identifies multiple positioning identifiers on the apron through the gimbal camera; obtains the offset between the drone to be landed and each positioning identifier; guides the drone to land according to the offset, calculates the offset between the drone and each positioning identifier on the apron, and guides the drone to land according to the offset, thereby ensuring that the drone lands accurately and improving the reliability of the drone landing.
[0077] refer to Figure 4 , Figure 4 The figure is a flow chart of a second embodiment of a method for guiding a landing of an unmanned aerial vehicle according to the present invention.
[0078] Based on the above first embodiment, in the method for guiding the landing of a drone in this embodiment, step S30 specifically includes:
[0079] Step S301: photographing the identifier image of each positioning identifier by the pan-tilt camera.
[0080] It should be noted that the common methods of identifying these visual positioning marks currently require knowing the focal length of the lens and the size of the photosensor of the lens in advance. However, in actual practice, it is not convenient to know the focal length of the lens and the size of the photosensor of the lens. First, many times we cannot obtain these parameters. For example, if the manufacturer does not tell us these parameters, we must reversely calculate them through experiments, which is troublesome. Second, many lenses have variable focal lengths. It may be that a zoom operation is performed during use, or it may be that the individual differences between lenses cause the focal length to be variable and it is not easy to obtain an accurate value. In this embodiment, positioning based on visual positioning marks can be achieved without obtaining the focal length of the lens and the size of the photosensor.
[0081] In a specific implementation, the positioning identifier in this embodiment is identified based on the identifier image captured by the gimbal camera, and then each identifier is identified by processing the identifier image, and the offset between the drone to be landed and each positioning identifier is calculated.
[0082] Step S302: Determine the center point of the field of view of the pan / tilt camera.
[0083] Step S303: determining the actual distance offset of each positioning identifier relative to the center point of the field of view and the angular offset of each positioning identifier according to the identifier image.
[0084] In a specific implementation, the gimbal camera has a corresponding center point of view when shooting, and the center point of view is used to guide the drone to land accurately. Furthermore, in this embodiment, the actual distance offset of each positioning identifier relative to the center point of view and the angle offset of each positioning identifier can be determined based on the captured identifier image, and the actual distance offset represents the actual offset distance between the drone to be landed and the positioning identifier. If the nose direction of the drone to be landed is consistent with the set nose direction, there will be no horizontal angle deviation, but when the drone to be landed rotates horizontally, the identifier image captured by the gimbal camera will have an angle offset between the drones to be landed.
[0085] In a specific implementation, in this embodiment, the pixel side length of each positioning identifier and the pixel distance offset of each positioning identifier relative to the center point of the field of view can be determined from the identifier image. The above parameters can be obtained based on the existing tag recognition method. The pixel side length and pixel distance offset in this embodiment are not the side length and distance offset of the positioning identifier of the drone to be landed in the real world. The pixel side length and pixel distance offset need to be converted to obtain the side length and distance offset of the positioning identifier in the real world. Among them, the length of the pixel side length can be obtained by calculating the average value of the side lengths of the positioning identifiers.
[0086] In a specific implementation, the actual side length of each positioning identifier in the real world is known. In this embodiment, the side length of the known positioning code and the pixel side length of the positioning code in the image can be used to obtain the ratio of the actual distance to the pixel distance, xShiftInMm=widthInMm*xShiftInPx / widthInPx, where widthInMm is the actual side length of the positioning identifier, widthInPx is the pixel side length of the positioning identifier, xShiftInPx is the pixel distance offset of the positioning identifier in the X-axis direction, and xShiftInMm is the actual distance offset of the positioning identifier in the X-axis direction. In the same way as above, the actual distance offset of the positioning identifier in the Y-axis direction can be obtained, yShiftInMm=widthInMm*yShiftInPy / widthInPy. Further, the angle is calculated based on the tangent value of the angle between one side of the positioning identifier and the x-axis of the image, and the angle is the angle offset.
[0087] Furthermore, since there are multiple positioning identifiers, in this embodiment, the average distance offset and the average angle offset are calculated by average value calculation, and then the drone to be landed is guided to land according to the average distance offset and the average angle offset.
[0088] In a specific implementation, after obtaining the offset, the adjustment amount can be obtained based on the offset in this embodiment. Specifically, the distance adjustment amount can be determined according to the average distance offset, and the angle adjustment amount can be determined according to the average angle offset. For example, assuming that the average distance offset is S (xShiftInMm, yShiftInMm), the distance adjustment amount can be determined to be d (-xShiftInMm, -yShiftInMm), that is, the drone is controlled to move -xShiftInMm in the x direction and -yShiftInMm in the y direction, so as to complete the landing.
[0089] In this embodiment, the gimbal camera captures the identifier image of each positioning identifier; determines the center point of the field of view of the gimbal camera; obtains the pixel side length of each positioning identifier and the pixel distance offset of each positioning identifier relative to the center point of the field of view from the identifier image; obtains the actual side length of each positioning identifier; calculates the actual distance offset of each positioning identifier relative to the center point of the field of view based on the pixel side length, the pixel distance offset and the actual side length; determines the angle in the horizontal direction between each positioning identifier and the horizontal axis corresponding to the gimbal camera based on the identifier image, and obtains the angle offset, which can accurately obtain the distance offset and angle offset between the drone to be landed and the positioning identifier.
[0090] refer to Figure 5 , Figure 5 The figure is a flow chart of a third embodiment of a method for guiding landing of an unmanned aerial vehicle according to the present invention.
[0091] Based on the above-mentioned first embodiment or second embodiment, a third embodiment of a UAV landing guidance method of the present invention is proposed.
[0092] Taking the first embodiment as an example, in this embodiment, after step S40, the following steps are further included:
[0093] Step S50: lowering the drone to be landed from the current height to a new height according to the preset landing amplitude and the offset.
[0094] In specific implementation, in this embodiment, after the angle offset and the distance offset are adjusted to the adjustment-free range, the drone to be landed is not landed directly on the helipad at one time, but the height of the drone to be landed is lowered in sequence according to the preset landing amplitude. For example, the drone is controlled to land according to HAdjust0, HAdjust1, HAdjust2, and HAdjust3 in sequence, HAdjust0>HAdjust1>HAdjust2>HAdjust3, wherein the preset landing amplitude can be set accordingly according to the actual landing requirements, and this is not limited in this embodiment.
[0095] Step S60: Maintain the drone to be landed at a new altitude, and obtain new offsets between the drone to be landed and each positioning mark.
[0096] Step S70: Continue to guide the UAV to land according to the new offset.
[0097] Step S80: Continue to execute the step of lowering the drone to be landed from the current height to a new height according to the offset according to the preset landing amplitude, until the drone to be landed lands on the apron.
[0098] In a specific implementation, after the UAV to be landed lands, the height of the UAV to be landed is a new height. In this case, the offset of the UAV to be landed will also change. In this embodiment, the new offset between the UAV to be landed and each positioning mark is re-acquired, and then the UAV to be landed is adjusted based on the new offset in the above manner. After the adjustment is completed, it continues to descend to another new height, and the above steps are repeated until the UAV to be landed lands on the apron.
[0099] This embodiment lowers the UAV to be landed from the current height to a new height according to the offset according to a preset landing amplitude; maintains the UAV to be landed at the new height, and obtains a new offset between the UAV to be landed and each positioning mark; continues to guide the UAV to be landed to land according to the new offset; continues to execute the step of lowering the UAV to be landed from the current height to a new height according to the offset according to the preset landing amplitude until the UAV to be landed lands on the helipad, by hovering the UAV at a certain height, performing detection and adjustment, and after the detection and adjustment are completed, further lowering it to another height, and then performing detection and adjustment, and multiple rounds of hovering, detection, and adjustment are performed until the UAV lands on the helipad, thereby improving the accuracy and reliability of the UAV landing.
[0100] In addition, an embodiment of the present invention further proposes a storage medium, on which a drone landing guidance program is stored. When the drone landing guidance program is executed by a processor, the steps of the drone landing guidance method described above are implemented.
[0101] Since the storage medium adopts all the technical solutions of all the above embodiments, it has at least all the beneficial effects brought by the technical solutions of the above embodiments, which will not be described one by one here.
[0102] Reference Figure 6 , Figure 6 This is a structural block diagram of the first embodiment of the UAV landing guidance device of the present invention.
[0103] like Figure 6 As shown, the UAV landing guidance device proposed in the embodiment of the present invention includes:
[0104] The detection module 10 is used to detect whether the UAV to be landed has a landing requirement.
[0105] The shooting module 20 is used to identify multiple positioning marks on the apron through the gimbal camera when the unmanned aerial vehicle to be landed has a landing demand.
[0106] The calculation module 30 is used to obtain the offset between the UAV to be landed and each positioning mark.
[0107] The control module 40 is used to guide the UAV to land according to the offset.
[0108] This embodiment detects whether the drone to be landed has a landing demand; when the drone to be landed has a landing demand, identifies multiple positioning identifiers on the apron through the gimbal camera; obtains the offset between the drone to be landed and each positioning identifier; guides the drone to land according to the offset, calculates the offset between the drone and each positioning identifier on the apron, and guides the drone to land according to the offset, thereby ensuring that the drone lands accurately and improving the reliability of the drone landing.
[0109] In one embodiment, the drone landing guidance device further includes: a determination module;
[0110] The determination module is used to obtain the current height of the UAV to be landed above the helipad; when it is detected that the UAV to be landed maintains the current height, it is determined that the UAV to be landed has a landing requirement.
[0111] In one embodiment, the calculation module 30 is also used to capture the identifier image of each positioning identifier through the gimbal camera; determine the center point of the field of view of the gimbal camera; and determine the actual distance offset of each positioning identifier relative to the center point of the field of view and the angular offset of each positioning identifier based on the identifier image.
[0112] In one embodiment, the calculation module 30 is further used to obtain the pixel side length of each positioning identifier and the pixel distance offset of each positioning identifier relative to the center point of the field of view from the identifier image; obtain the actual side length of each positioning identifier; calculate the actual distance offset of each positioning identifier relative to the center point of the field of view based on the pixel side length, the pixel distance offset and the actual side length; determine the angle in the horizontal direction between each positioning identifier and the horizontal axis corresponding to the gimbal camera based on the identifier image to obtain the angle offset.
[0113] In one embodiment, the control module 40 is further used to calculate an average distance offset based on the actual distance offset of each positioning identifier relative to the center point of the field of view; calculate an average angle offset based on the angle offset of each positioning identifier; and guide the drone to land to land based on the average distance offset and the average angle offset.
[0114] In one embodiment, the control module 40 is further used to calculate a distance adjustment amount according to the average distance offset; calculate an angle adjustment amount according to the average angle offset; and control the displacement and rotation of the drone to be landed according to the distance adjustment amount and the angle adjustment amount to complete the landing.
[0115] In one embodiment, the control module 40 is further used to descend the UAV to be landed from the current height to a new height according to a preset landing amplitude based on the offset; maintain the UAV to be landed at the new height, and obtain a new offset between the UAV to be landed and each positioning mark; continue to guide the UAV to be landed to land according to the new offset; continue to execute the step of descending the UAV to be landed from the current height to a new height according to the preset landing amplitude based on the offset until the UAV to be landed lands on the apron.
[0116] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.
[0117] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.
[0118] In addition, for technical details not fully described in this embodiment, reference can be made to the drone landing guidance method provided in any embodiment of the present invention, and will not be repeated here.
[0119] In addition, it should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0120] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0121] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0122] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A method for guiding a drone to land, characterized in that: The drone is provided with a pan-tilt camera; The UAV landing guidance method comprises: Detect whether the drone to be landed has a landing requirement; When the unmanned aerial vehicle to be landed has a landing demand, the gimbal camera identifies multiple positioning marks on the apron; Obtaining the offset between the drone to be landed and each positioning mark; Guiding the UAV to land according to the offset; The obtaining of the offset between the to-be-landed UAV and each positioning mark includes: Capturing an identifier image of each positioning identifier by means of the pan / tilt camera; Determine the center point of the field of view of the pan / tilt camera; Determine, based on the identifier image, the actual distance offset of each positioning identifier relative to the center point of the field of view and the angular offset of each positioning identifier; The determining, according to the identifier image, the actual distance offset of each positioning identifier relative to the center point of the field of view and the angular offset of each positioning identifier comprises: Acquire the pixel side length of each positioning identifier and the pixel distance offset of each positioning identifier relative to the center point of the field of view from the identifier image; Get the actual side length of each positioning identifier; Calculate the actual distance offset of each positioning identifier relative to the center point of the field of view according to the pixel side length, the pixel distance offset and the actual side length; The angle between each positioning identifier and the horizontal axis corresponding to the pan / tilt camera is determined according to the identifier image to obtain an angle offset.
2. The method for guiding the landing of an unmanned aerial vehicle according to claim 1, characterized in that: The detecting whether the UAV to be landed has a landing requirement includes: Get the current altitude of the drone above the landing pad; When it is detected that the drone to be landed maintains the current altitude, it is determined that the drone to be landed has a landing requirement.
3. The method for guiding the landing of an unmanned aerial vehicle according to claim 1, characterized in that: The step of guiding the unmanned aerial vehicle to land according to the offset comprises: Calculate an average distance offset according to the actual distance offsets of each positioning identifier relative to the center point of the field of view; Calculating an average angle offset according to the angle offsets of each positioning identifier; The unmanned aerial vehicle to be landed is guided to land according to the average distance offset and the average angle offset.
4. The method for guiding the landing of an unmanned aerial vehicle according to claim 3, characterized in that: The step of guiding the unmanned aerial vehicle to land according to the average distance offset and the average angle offset includes: Calculating a distance adjustment amount according to the average distance offset; Calculating an angle adjustment amount according to the average angle offset; The unmanned aerial vehicle to be landed is controlled to move and rotate according to the distance adjustment amount and the angle adjustment amount to complete the landing.
5. The method for guiding the landing of an unmanned aerial vehicle according to any one of claims 1 to 4, characterized in that: After guiding the unmanned aerial vehicle to land according to the offset, the method further includes: Descending the drone to be landed from the current height to a new height according to the preset landing amplitude and the offset; Maintaining the drone to be landed at a new altitude, and obtaining a new offset between the drone to be landed and each positioning mark; Continue to guide the UAV to land according to the new offset; Continue to execute the step of descending the drone to be landed from the current height to a new height according to the offset according to the preset landing amplitude, until the drone to be landed lands on the apron.
6. A UAV landing guidance device, characterized in that: The drone is provided with a pan-tilt camera; The UAV landing guidance device comprises: A detection module is used to detect whether the UAV to be landed has a landing requirement; A shooting module is used to identify multiple positioning marks on the apron through the gimbal camera when the unmanned aerial vehicle to be landed has a landing demand; A calculation module, used to obtain the offset between the UAV to be landed and each positioning mark; The computing module is further used to capture the identifier image of each positioning identifier through the pan-tilt camera; Determine the center point of the field of view of the pan / tilt camera; Determine, based on the identifier image, the actual distance offset of each positioning identifier relative to the center point of the field of view and the angular offset of each positioning identifier; The calculation module is further used to obtain the pixel side length of each positioning identifier and the pixel distance offset of each positioning identifier relative to the center point of the field of view from the identifier image; Get the actual side length of each positioning identifier; Calculate the actual distance offset of each positioning identifier relative to the center point of the field of view according to the pixel side length, the pixel distance offset and the actual side length; Determine the angle between each positioning identifier and the horizontal axis corresponding to the PTZ camera in the horizontal direction according to the identifier image to obtain an angle offset; The control module is used to guide the UAV to land according to the offset.
7. A UAV landing guidance device, characterized in that: The drone landing guidance device includes: a memory, a processor, and a drone landing guidance program stored in the memory and running on the processor, wherein the drone landing guidance program is configured to implement the drone landing guidance method according to any one of claims 1 to 5.
8. A storage medium, characterized in that: The storage medium stores a drone landing guidance program, and when the drone landing guidance program is executed by the processor, the drone landing guidance method according to any one of claims 1 to 5 is implemented.
Citation Information
Patent Citations
Automatic landing method and device and air vehicle
CN104049641A
Unmanned aerial vehicle flight control method, device and unmanned aerial vehicle
CN106527481A
Automatic landing method of unmanned aerial vehicle based on visual guidance
CN107544550A
Control method and control device for palm landing of unmanned aerial vehicle and the unmanned aerial vehicle
CN108475070A
Independent unmanned aerial vehicle landing method and system based on two-dimensional code and inertial navigation assistance
CN108549397A
