A UAV composite docking system and method based on near infrared beacon
Through the UAV compound docking system based on near-infrared beacon, the problems of slow speed, complex structure and poor adaptability during operation at high altitudes are solved, and high-precision docking of cleaning devices is achieved, reducing the docking of cleaning devices. The cleaning cost of high-rise buildings has been improved, the working environment of workers and the cleaning efficiency has been improved.
Patent Information
- Application Number
- CN201910322774.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-04-22
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2039-04-22
AI Technical Summary
The existing suspended cleaning robots and wall-climbing robots have problems such as slow speed, complex structure and poor adaptability when operating at high altitudes. High altitude operations have great threats to personal safety, low cleaning efficiency, and cannot effectively ensure personal safety.
Adopt a composite docking system based on near-infrared beacons, including drones, cleaning devices and ground consoles, and improve docking accuracy through near-infrared cameras and vision processors, and use the feature point extraction and relative measurement of near-infrared beacons. Achieve high-precision docking between drones and cleaning devices, reduce the cleaning costs of high-rise buildings, and improve the working environment for workers.
It greatly improves the docking accuracy between the aerial drone and the cleaning device, reduces the cleaning cost of high-rise buildings, improves the working environment of workers, improves the cleaning efficiency, and enhances the adaptability and robustness to complex environments.
Smart Images

Figure CN111824416B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to an aerial unmanned aerial vehicle and key components thereof, and in particular to a near-infrared beacon-based unmanned aerial vehicle composite docking system and method thereof. Background Art
[0002] In the prior art, unmanned aerial vehicles (UAVs) have attracted widespread attention since their introduction. With the advancement of science and technology, UAVs have been applied to many aspects such as terrain detection, disaster detection, and aerial reconnaissance. In addition, there are many high-rise buildings in the existing cities, and the floors can be as high as nearly 100 meters, and the outer wall materials are mainly glass, tiles, etc. For the cleaning of the wall, most of these tasks are still carried out by cleaning staff through hanging wires, ropes, etc., which is not only dangerous but also has low cleaning efficiency. Furthermore, these high-altitude operations cannot fully guarantee personal safety and are very likely to pose a greater threat to the wall. However, existing mobile cleaning robots, such as suspended cleaning robots or wall-climbing robots, have problems such as slow speed, complex structure, and poor adaptability in terms of adsorption mode and movement mode. Summary of the invention
[0003] In view of the above-mentioned defects existing in the prior art suspended cleaning robots or wall-climbing robots when working at high altitudes, the present invention provides a UAV composite docking system and method based on near-infrared beacons.
[0004] According to one aspect of the present invention, a near-infrared beacon-based UAV composite docking system is provided, comprising:
[0005] A drone, comprising a flight control computer, a visual processor and an image acquisition unit, wherein the image acquisition unit is electrically coupled to the visual processor, and the visual processor is electrically coupled to the flight control computer;
[0006] A cleaning device, comprising a cleaning robot, a communication chip and a near-infrared beacon, wherein the near-infrared beacon is fixedly mounted on the cleaning robot, and the communication chip is used to transmit sensor and charging status information to the cleaning robot and receive commands from the cleaning robot;
[0007] A ground control console performs wireless transmission with the UAV and the cleaning device. The ground control console outputs a series of spatial coordinates and implements the mission planning of the UAV according to the relative positioning criterion. The UAV delivers the cleaning device to the target area according to the planned cleaning task.
[0008] In a specific embodiment, the near infrared beacon is configured in a composite spectrum, spatial structure and / or spatial distribution manner.
[0009] In a specific embodiment, the image acquisition unit is a near-infrared camera, which extracts and relatively measures near-infrared feature points by shooting an image sequence of the cleaning device, thereby sending the feature data of the near-infrared beacon to the visual processor.
[0010] In a specific embodiment, a drone delivers the cleaning device to the surface of a wall, a solar thermal panel or a photovoltaic panel, and a cleaning robot of the cleaning device performs autonomous cleaning.
[0011] In a specific embodiment, the ground control console performs task planning according to the cleanliness of the platform surface to be cleaned.
[0012] In a specific embodiment, the near-infrared beacon uses LED light emitting diodes of different wavelength bands.
[0013] According to another aspect of the present invention, a composite docking method for a UAV based on a near-infrared beacon is provided, which is suitable for docking a cleaning robot at a target area. The composite docking method for a UAV comprises the following steps:
[0014] Provided is a drone, comprising a flight control computer, a visual processor, and an image acquisition unit, wherein the image acquisition unit is electrically coupled to the visual processor, and the visual processor is electrically coupled to the flight control computer;
[0015] A cleaning device is provided, comprising a cleaning robot, a communication chip and a near-infrared beacon, wherein the near-infrared beacon is fixedly mounted on the cleaning robot, and the communication chip is used to transmit sensor and charging status information to the cleaning robot and receive commands from the cleaning robot; and
[0016] A ground control console is provided for wireless transmission with the UAV and the cleaning device. The ground control console outputs a series of spatial coordinates and implements the task planning of the UAV according to the relative positioning criterion. The UAV delivers the cleaning device to the target area according to the planned cleaning task.
[0017] In a specific embodiment, the near infrared beacon is configured in a composite spectrum, spatial structure and / or spatial distribution manner.
[0018] In a specific embodiment, the image acquisition unit is a near-infrared camera, which extracts and relatively measures near-infrared feature points by shooting an image sequence of the cleaning device, thereby sending the feature data of the near-infrared beacon to the visual processor.
[0019] In a specific embodiment, the drone delivers the cleaning device to the surface of a wall, a solar thermal panel or a photovoltaic panel, and the cleaning robot of the cleaning device performs autonomous cleaning.
[0020] The UAV composite docking system and method of the present invention are adopted. The UAV includes a flight control computer, a visual processor and an image acquisition unit, the image acquisition unit is electrically coupled to the visual processor, and the visual processor is electrically coupled to the flight control computer; the cleaning device includes a cleaning robot, a communication chip and a near-infrared beacon, the near-infrared beacon is fixedly installed on the cleaning robot, and the communication chip is used to transmit sensor and charging status information to the cleaning robot and receive commands from the cleaning robot; the ground control console performs wireless transmission with the UAV and the cleaning device, and outputs a series of spatial coordinates according to the relative positioning criterion and realizes the task planning of the UAV, and the UAV sends the cleaning device to the target area according to the planned cleaning task.
[0021] Compared with the prior art, the drone of the present invention is equipped with a near-infrared camera of a specific wavelength band, and the cleaning device is equipped with a near-infrared beacon of a specific wavelength band. Based on the pinhole imaging model of the near-infrared camera, a series of spatial coordinates are output by extracting the detected feature points of the near-infrared beacon and realizing the task planning of the drone, so that the drone can send the cleaning device to the target area according to the planned cleaning task. In this way, the present invention can greatly improve the docking accuracy between the aerial drone and the cleaning device, greatly reduce the cleaning cost of high-rise buildings, and greatly improve the working environment of workers, so as to improve the cleaning efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] After reading the specific embodiments of the present invention with reference to the accompanying drawings, readers will understand the various aspects of the present invention more clearly.
[0023] Figure 1 A schematic diagram of the structure of a UAV composite docking system based on near-infrared beacons according to one aspect of the present invention is shown;
[0024] Figure 2 Show Figure 1 A schematic diagram of the state of composite docking between a UAV and a cleaning device in a composite docking system of a UAV;
[0025] Figure 3 Shown in Figure 1 A structural diagram of a near-infrared beacon fixedly installed on a cleaning device in a composite docking system of a UAV; and
[0026] Figure 4 A flowchart of a UAV composite docking method based on near-infrared beacons is shown according to another aspect of the present invention. DETAILED DESCRIPTION
[0027] In order to make the technical content disclosed in this application more detailed and complete, reference may be made to the accompanying drawings and the following various specific embodiments of the present invention, in which the same reference numerals represent the same or similar components. However, it should be understood by those skilled in the art that the embodiments provided below are not intended to limit the scope of the present invention. In addition, the accompanying drawings are only used for schematic illustration and are not drawn according to their original size.
[0028] The specific implementation modes of various aspects of the present invention are further described in detail below with reference to the accompanying drawings.
[0029] Figure 1 FIG. 1 is a schematic diagram showing a structure of a UAV composite docking system based on near infrared beacons according to one aspect of the present invention. Figure 2 Show Figure 1 Schematic diagram of the state of composite docking between the drone and the cleaning device in the composite docking system of the drone. Figure 3 Shown in Figure 1 Structural diagram of the near-infrared beacon fixedly installed on the cleaning device in the UAV composite docking system.
[0030] Reference Figures 1 to 3 In this embodiment, the UAV composite docking system of the present invention includes a UAV, a cleaning device and a ground control console.
[0031] In detail, Figure 1 As shown, the UAV includes a flight control computer, a visual processor and an image acquisition unit. The image acquisition unit is electrically coupled to the visual processor, and the visual processor is electrically coupled to the flight control computer. The cleaning device includes a cleaning robot, a communication chip and a near-infrared beacon, wherein the near-infrared beacon is fixedly installed on the cleaning robot, and the communication chip is used to transmit the sensor and charging status information to the cleaning robot and receive commands from the cleaning robot. That is, a two-way data interaction is implemented between the communication chip and the cleaning robot, for example, the data transmission form based on the MAVLINK protocol is adopted between the two. In this composite docking system, by introducing a near-infrared beacon and fixing it on the cleaning robot, based on computer vision theory, the Perspective-3-Points (P3P) problem is solved to obtain the relative position between the UAV and the cleaning device, thereby reducing the adverse effects of complex situations such as sunlight, strong wind, and no GPS signal, and improving the robustness of the docking process. Therefore, the UAV sends the cleaning device to the surface of the wall, solar thermal panel or photovoltaic panel, and then the cleaning robot of the cleaning device can perform autonomous cleaning. In addition, the ground control console can also plan tasks according to the cleanliness of the platform surface to be cleaned.
[0032] The ground control console wirelessly transmits information to the UAV and the cleaning device. The ground control console outputs a series of spatial coordinates and implements the UAV's mission planning based on the relative positioning criteria. The UAV sends the cleaning device to the target area (such as a wall, solar thermal panel or photovoltaic panel surface) according to the planned cleaning task.
[0033] In a specific embodiment, the near-infrared beacon uses LED light-emitting diodes of different wavelength bands. Further, the near-infrared beacon is configured as a composite spectrum, spatial structure and / or spatial distribution. For example, the near-infrared beacon is attached to a cleaning robot and actively transmits near-infrared information. At the same time, the visual processor of the drone is based on Figure 3 The near-infrared beacon structure shown can calculate the relative posture parameters, thereby suppressing the interference of complex situations such as sunlight, strong wind, and no GPS signal, and improving the accuracy and robustness of the docking process.
[0034] In a specific embodiment, the image acquisition unit is a near-infrared camera, for example, the near-infrared band is between 800nm and 1300nm, which extracts and relatively measures near-infrared feature points by shooting an image sequence of the cleaning device, thereby sending the feature data of the near-infrared beacon to the visual processor in the drone.
[0035] It can be seen from the above embodiments that, compared with the prior art, the drone of the present invention is equipped with a near-infrared camera of a specific band, and the cleaning device is equipped with a near-infrared beacon of a specific band. Based on the pinhole imaging model of the near-infrared camera, a series of spatial coordinates are output by extracting the detected feature points of the near-infrared beacon and realizing the task planning of the drone, so that the drone can send the cleaning device to the target area according to the planned cleaning task. In this way, the present invention can greatly improve the docking accuracy between the aerial drone and the cleaning device, greatly reduce the cleaning cost of high-rise buildings, and greatly improve the working environment of workers, so as to improve the cleaning efficiency.
[0036] Figure 4 A flowchart of a UAV composite docking method based on near-infrared beacons is shown according to another aspect of the present invention.
[0037] Reference Figure 4 The UAV composite docking method based on near-infrared beacon can be mainly implemented through steps S1, S3 and S5.
[0038] In more detail, in step S1, a drone is provided, the drone comprising a flight control computer, a visual processor and an image acquisition unit. The image acquisition unit is electrically coupled to the visual processor, and the visual processor is electrically coupled to the flight control computer. The flight control computer is used to control the aerial flight posture of the drone. The visual processor calculates the relative posture parameters according to the near-infrared beacon structure, thereby suppressing interference in complex situations and improving the accuracy and robustness of the docking process.
[0039] In step S3, a cleaning device is provided, which includes a cleaning robot, a communication chip and a near-infrared beacon, wherein the near-infrared beacon is fixedly mounted on the cleaning robot, and the communication chip is used to transmit the sensor and charging status information to the cleaning robot and receive commands from the cleaning robot. For example, the near-infrared beacon uses LED light-emitting diodes of different bands. The near-infrared beacon is configured as a composite spectrum, a spatial structure and / or a spatial distribution. For example, the near-infrared beacon is attached to the cleaning robot and actively transmits near-infrared information.
[0040] In step S5, a ground control console is provided to wirelessly transmit with the UAV and the cleaning device. The ground control console outputs a series of spatial coordinates and implements the task planning of the UAV according to the relative positioning criteria. The UAV sends the cleaning device to the target area according to the planned cleaning task. Afterwards, based on the cleanliness assessment and the completion of the cleaning task, the UAV successfully docks with the cleaning device so that the cleaning device leaves the target cleaning area and returns.
[0041] The UAV composite docking system and method of the present invention are adopted. The UAV includes a flight control computer, a visual processor and an image acquisition unit, the image acquisition unit is electrically coupled to the visual processor, and the visual processor is electrically coupled to the flight control computer; the cleaning device includes a cleaning robot, a communication chip and a near-infrared beacon, the near-infrared beacon is fixedly installed on the cleaning robot, and the communication chip is used to transmit sensor and charging status information to the cleaning robot and receive commands from the cleaning robot; the ground control console performs wireless transmission with the UAV and the cleaning device, and outputs a series of spatial coordinates according to the relative positioning criterion and realizes the task planning of the UAV, and the UAV sends the cleaning device to the target area according to the planned cleaning task.
[0042] More importantly, the present invention can eliminate the adverse effects of complex environments, such as high-intensity sunlight, strong winds, and no GPS signals, on the entire docking process, and can achieve relative positioning and navigation of drones in complex environments. In addition, the present invention can greatly improve the efficiency of cleaning work, has greater flexibility and robustness, and has strong adaptability to the structure of the cleaning environment, and can be widely used in the fields of glass curtain wall cleaning.
[0043] In the above, the specific embodiments of the present invention are described with reference to the accompanying drawings. However, those skilled in the art will appreciate that various changes and substitutions may be made to the specific embodiments of the present invention without departing from the spirit and scope of the present invention. These changes and substitutions are all within the scope defined by the claims of the present invention.
Claims
1. A composite docking method for UAVs based on near-infrared beacons, suitable for docking a cleaning robot at a target area, characterized in that: The UAV composite docking method comprises the following steps: Provided is a drone, comprising a flight control computer, a visual processor, and an image acquisition unit, wherein the image acquisition unit is electrically coupled to the visual processor, and the visual processor is electrically coupled to the flight control computer; A cleaning device is provided, comprising a cleaning robot, a communication chip and a near-infrared beacon, wherein the near-infrared beacon is fixedly mounted on the cleaning robot, and the communication chip is used to transmit sensor and charging status information to the cleaning robot and receive commands from the cleaning robot; and A ground control console is provided to wirelessly transmit with the UAV and the cleaning device. The ground control console outputs a series of spatial coordinates and implements the task planning of the UAV according to the relative positioning criterion. The UAV sends the cleaning device to the target area according to the planned cleaning task. Wherein, the image acquisition unit is a near-infrared camera, which extracts and relatively measures near-infrared feature points by shooting an image sequence of the cleaning device, thereby sending the feature data of the near-infrared beacon to the visual processor.
2. The UAV composite docking method based on near infrared beacon according to claim 1 is characterized in that: The near infrared beacon is configured in a composite spectrum, spatial structure and / or spatial distribution manner.
3. The UAV composite docking method based on near infrared beacon according to claim 1 is characterized in that: The drone delivers the cleaning device to the surface of a wall, a solar thermal panel or a photovoltaic panel, and the cleaning robot of the cleaning device performs autonomous cleaning.
4. A UAV composite docking system using the docking method according to claim 1, characterized in that: The UAV composite docking system comprises: A drone, comprising a flight control computer, a visual processor and an image acquisition unit, wherein the image acquisition unit is electrically coupled to the visual processor, and the visual processor is electrically coupled to the flight control computer; A cleaning device, comprising a cleaning robot, a communication chip and a near-infrared beacon, wherein the near-infrared beacon is fixedly mounted on the cleaning robot, and the communication chip is used to transmit sensor and charging status information to the cleaning robot and receive commands from the cleaning robot; A ground control console performs wireless transmission with the UAV and the cleaning device. The ground control console outputs a series of spatial coordinates and implements the mission planning of the UAV according to the relative positioning criterion. The UAV delivers the cleaning device to the target area according to the planned cleaning task.
5. The UAV composite docking system according to claim 4, characterized in that: The near infrared beacon is configured in a composite spectrum, spatial structure and / or spatial distribution manner.
6. The UAV composite docking system according to claim 4, characterized in that: The image acquisition unit is a near-infrared camera, which extracts and relatively measures near-infrared feature points by shooting an image sequence of the cleaning device, thereby sending the feature data of the near-infrared beacon to the visual processor.
7. The UAV composite docking system according to claim 4, characterized in that: The drone delivers the cleaning device to the surface of a wall, a solar thermal panel or a photovoltaic panel, and the cleaning robot of the cleaning device performs autonomous cleaning.
8. The UAV composite docking system according to claim 4, characterized in that: The ground control console performs task planning according to the cleanliness of the platform surface to be cleaned.
9. The UAV composite docking system according to claim 4, characterized in that: The near-infrared beacon adopts LED light-emitting diodes of different wavebands.
