Unmanned aerial vehicle acousto-optic-thermal integrated collaborative inspection system based on big data

Abstract

The invention discloses an unmanned aerial vehicle acousto-optic-thermal integrated collaborative inspection system based on big data, relates to the technical field of unmanned aerial vehicles, and mainly aims to solve the problems that an existing unmanned aerial vehicle inspection system needs to manually inspect the state of unmanned aerial vehicle equipment, so that false inspection and missing inspection are caused, and images shot during inspection are low in quality, high in sound wave noise and poor in inspection accuracy. And an existing unmanned aerial vehicle inspection system cannot complete diversified inspection work, and when the inspection range is large, the inspection work needs to be carried out after being allocated to individuals or groups, so that the labor cost is increased, and the inspection efficiency is influenced. Comprising a central processing module, an equipment self-inspection module, an autonomous inspection module, a flight control module, a wireless communication module, a data analysis module and a data collection module.

Description

Technical Field

[0001] The present application relates to the field of drone technology, and in particular to a drone acoustic, optical and thermal integrated collaborative inspection system based on big data. Background Art

[0002] Unmanned aircraft, also known as drones, are unmanned aircraft that are controlled by radio remote control equipment and self-contained program control devices. Drones can be divided into military and civilian applications according to their application areas. The application of civilian drones in aerial photography, agriculture, express delivery, outdoor observation, power inspection and other fields has expanded the use of drones themselves.

[0003] Inspection work is a vital task, which involves various fields and aims to ensure the safe, stable and efficient operation of equipment, facilities and environment. UAVs are an advanced inspection equipment in inspection work. They combine the high-altitude flight capability, flexibility and various sensors carried by UAVs, and can realize comprehensive, rapid and accurate inspection of target areas or equipment. Among them, the integrated collaborative inspection system is extremely important. The existing inspection system basically meets user needs, but there are still certain shortcomings. First, the existing UAV inspection system still needs to manually check the status of the UAV equipment before the UAV inspection, which may result in false detection and missed detection, which may easily cause damage to the UAV and increase unnecessary costs. Second, the images taken by the existing UAV inspection system during the inspection may cause image quality degradation due to various factors, which may easily affect subsequent analysis and judgment, and the UAV sound wave recognition may be affected by the noise of the inspection environment, thereby reducing the accuracy of the inspection work. Third, the existing UAV inspection system cannot complete a variety of inspection work. When the inspection range is large, it needs to be assigned to individuals or groups and then carried out separately, which increases labor costs and affects the inspection efficiency. Therefore, it is necessary to design a UAV acoustic, optical and thermal integrated collaborative inspection system based on big data. Summary of the invention

[0004] In view of this, the present application provides a drone acoustic, optical and thermal integrated collaborative inspection system based on big data, the main purpose of which is to solve the problems raised in the above background technology.

[0005] According to one aspect of the present application, a drone acoustic, optical and thermal integrated collaborative inspection system based on big data is provided, comprising:

[0006] A central processing module (1), an equipment self-checking module (2), an autonomous patrol inspection module (3), a flight control module (4), a wireless communication module (5), a data analysis module (6) and a data collection module (7); the central processing module (1) controls and connects the equipment self-checking module (2), the autonomous patrol inspection module (3), the flight control module (4), the wireless communication module (5), the data analysis module (6) and the data collection module (7) respectively; the autonomous patrol inspection module (3) and the flight control module (4) are connected to each other in a controlled manner; and the data analysis module (6) and the data collection module (7) are connected to each other in a controlled manner.

[0007] Preferably, the data analysis module (6) and the data collection module (7) both control the connection with the data storage module (8), the data transmission module (9) and the data backup module (10).

[0008] Preferably, the data analysis module (6) controls the connection to the image recognition module (11), the sound wave recognition module (12) and the thermal imaging recognition module (13) respectively; the image recognition module (11) controls the connection to the image correction module (38); the image correction module (38) controls the connection to the analysis and comparison module (14); and the sound wave recognition module (12) controls the connection to the environmental noise reduction module (37).

[0009] Preferably, the analysis and comparison module (14) controls the connection abnormality alarm module (15) and the abnormality recording module (16) respectively, and the abnormality recording module (16) controls the connection data collection module (7).

[0010] Preferably, the device self-check module (2) controls the connection to the hardware detection module (20), and the hardware detection module (20) controls the connection to the data upload module (21).

[0011] Preferably, the wireless communication module (5) controls the connection of the signal transmission module (23) and the signal interaction module (24) respectively, and the signal transmission module (23) and the signal interaction module (24) both control the connection of the collaborative control module (25).

[0012] Preferably, the collaborative control module (25) controls the connection route analysis module (17) and the route allocation module (18) respectively.

[0013] Preferably, the autonomous inspection module (3) and the flight control module (4) both control the connection to the equipment positioning module (30), the route preset module (31) and the route change module (32), and the equipment positioning module (30), the route preset module (31) and the route change module (32) all control the connection to the navigation positioning module (33).

[0014] Preferably, the navigation positioning module (33) controls the connection start point positioning module (34), the inspection point module (35) and the end point positioning module (36) respectively.

[0015] Preferably, the flight control module (4) controls the connection to the lifting control module (26), the hovering control module (27) and the direction control module (28) respectively, and the lifting control module (26), the hovering control module (27) and the direction control module (28) all control the connection to the fixed-point surround module (29).

[0016] By means of the above technical solution, the technical solution provided by the embodiment of the present application has at least the following advantages:

[0017] The present application provides a drone acoustic, optical and thermal integrated collaborative inspection system based on big data, including: a central processing module, an equipment self-inspection module, an autonomous inspection module, a flight control module, a wireless communication module, a data analysis module and a data collection module, wherein the central processing module controls the connection equipment self-inspection module, the autonomous inspection module, the flight control module, the wireless communication module, the data analysis module and the data collection module respectively, the autonomous inspection module and the flight control module are mutually controlled and connected, and the data analysis module and the data collection module are mutually controlled and connected. Compared with the prior art, the beneficial effects of the present application are: before the drone conducts an inspection, the central processing module is used to control the equipment self-inspection module to perform self-inspection on the drone, the hardware detection module is used to perform operation detection on each component of the drone, and then the hardware self-inspection data of each part of the drone is transmitted to the main control screen through the data upload module, so that the management personnel can more intuitively confirm the current situation of the drone, ensure that there is no abnormality in the hardware of the drone, and avoid omissions through systematic detection, thereby avoiding damage to the drone caused by false detection and missed detection; during the inspection process, the images, sound waves and thermal images collected by the drone are collected through the data collection module and the data analysis module, and then the image correction module is used to collect the images, sound waves and thermal images collected by the drone. The block adjusts the image, and then uses the analysis and comparison module to compare it with the historical image information to determine whether there is an abnormality. If there is an abnormality, an alarm will be issued in time. At the same time, the external noise during the inspection process is separated by the environmental noise reduction module to prevent external noise from affecting the sound wave recognition of the drone, making the drone inspection work more accurate and avoiding the accuracy of the inspection affected by image blur or abnormal sound wave recognition; the signal transmission module and the signal interaction module regulate the collaborative control module, and then analyze the overall inspection route through the route analysis module, and reasonably allocate the overall route through the route allocation module, so that multiple drones can complete the inspection work together, thereby improving the inspection efficiency.

[0018] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0020] Figure 1 A system flow chart provided by an embodiment of the present application is shown;

[0021] Figure 2 A schematic diagram of the structure of an abnormality judgment module provided in an embodiment of the present application is shown;

[0022] Figure 3 A schematic diagram of the structure of a device self-check module provided in an embodiment of the present application is shown;

[0023] Figure 4 A schematic diagram of the structure of a wireless communication module provided in an embodiment of the present application is shown;

[0024] Figure 5 A schematic diagram of the structure of a flight control module provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0025] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0026] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0027] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present application, its application, or uses.

[0028] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0029] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0030] The present application embodiment provides a drone acoustic, optical and thermal integrated collaborative inspection system based on big data, such as Figure 1-5 As shown, the system includes:

[0031] A central processing module (1), an equipment self-checking module (2), an autonomous patrol inspection module (3), a flight control module (4), a wireless communication module (5), a data analysis module (6) and a data collection module (7); wherein the central processing module (1) controls and connects the equipment self-checking module (2), the autonomous patrol inspection module (3), the flight control module (4), the wireless communication module (5), the data analysis module (6) and the data collection module (7), the autonomous patrol inspection module (3) and the flight control module (4) are connected to each other, and the data analysis module (6) and the data collection module (7) are connected to each other. wherein the central processing module (1) controls and connects the equipment self-checking module (2), the autonomous patrol inspection module (3), the flight control module (4), the wireless communication module (5), the data analysis module (6) and the data collection module (7), the autonomous patrol inspection module (3) and the flight control module (4) are connected to each other, and the data analysis module (6) and the data collection module (7) are connected to each other. Furthermore, the data analysis module (6) and the data collection module (7) both control the connection with the data storage module (8), the data transmission module (9) and the data backup module (10).

[0032] Furthermore, the data analysis module (6) controls the connection to the image recognition module (11), the sound wave recognition module (12) and the thermal imaging recognition module (13), respectively; the image recognition module (11) controls the connection to the image correction module (38); the image correction module (38) controls the connection to the analysis and comparison module (14); and the sound wave recognition module (12) controls the connection to the environmental noise reduction module (37).

[0033] Furthermore, the analysis and comparison module (14) controls the connection abnormality alarm module (15) and the abnormality recording module (16) respectively, and the abnormality recording module (16) controls the connection data collection module (7).

[0034] Furthermore, the device self-check module (2) controls the connection to the hardware detection module (20), and the hardware detection module (20) controls the connection to the data upload module (21).

[0035] Furthermore, the wireless communication module (5) controls the connection with the signal transmission module (23) and the signal interaction module (24) respectively, and the signal transmission module (23) and the signal interaction module (24) both control the connection with the collaborative control module (25).

[0036] Furthermore, the collaborative control module (25) controls the connection route analysis module (17) and the route allocation module (18) respectively.

[0037] Furthermore, the autonomous inspection module (3) and the flight control module (4) both control the connection to the equipment positioning module (30), the route preset module (31) and the route change module (32), and the equipment positioning module (30), the route preset module (31) and the route change module (32) all control the connection to the navigation positioning module (33).

[0038] Furthermore, the navigation positioning module (33) controls the connection start point positioning module (34), the inspection point module (35) and the end point positioning module (36) respectively.

[0039] Furthermore, the flight control module (4) controls the connection to the lifting control module (26), the hovering control module (27) and the direction control module (28) respectively, and the lifting control module (26), the hovering control module (27) and the direction control module (28) all control the connection to the fixed-point surround module (29).

[0040] The central processing module (1), the equipment self-checking module (2), the autonomous patrol inspection module (3), the flight control module (4), the wireless communication module (5), the data analysis module (6) and the data collection module (7) are respectively controlled and connected to the equipment self-checking module (2), the autonomous patrol inspection module (3), the flight control module (4), the wireless communication module (5), the data analysis module (6) and the data collection module (7); the autonomous patrol inspection module (3) and the flight control module (4) are controlled and connected to each other; the data analysis module (6) and the data collection module (7) are controlled and connected to each other; the data analysis module (6) and the data collection module (7) are controlled and connected to each other; The data storage module (8), the data transmission module (9) and the data backup module (10) are all controlled to be connected; the data analysis module (6) is respectively controlled to be connected to the image recognition module (11), the sound wave recognition module (12) and the thermal imaging recognition module (13); the image recognition module (11) is controlled to be connected to the image correction module (38); the image correction module (38) is controlled to be connected to the analysis and comparison module (14); the sound wave recognition module (12) is controlled to be connected to the environment noise reduction module (37); the analysis and comparison module (14) is respectively controlled to be connected to the abnormal alarm module (15) and the abnormal recording module (16); the abnormal recording module (16) is controlled to be connected to the data collection module (7), the device self-check module (2) controls the connection to the hardware detection module (20), the hardware detection module (20) controls the connection to the data upload module (21), the wireless communication module (5) controls the connection to the signal transmission module (23) and the signal interaction module (24) 4, the signal transmission module (23) and the signal interaction module (24) both control the connection to the collaborative control module (25), the collaborative control module (25) controls the connection to the route analysis module (17) and the route allocation module (18), the autonomous inspection module (3) and the flight control module (4) both control the connection to the device positioning module (30), the route preset module (31) and the route change module (3 2), the equipment positioning module (30), the route preset module (31) and the route change module (32) all control the connection with the navigation positioning module (33), the navigation positioning module (33) respectively controls the connection with the starting point positioning module (34), the inspection point module (35) and the end point positioning module (36), the flight control module (4) respectively controls the connection with the lifting control module (26), the hovering control module (27) and the direction control module (28), the lifting control module (26), the hovering control module (27) and the direction control module (28) all control the connection with the fixed point surrounding module (29), and the flight control module (4) is used to complete the automatic inspection flight of the unmanned aerial vehicle.

[0041] The effects that can be achieved are: before the drone conducts an inspection, the central processing module (1) is used to control the equipment self-inspection module (2) to conduct a self-inspection on the drone, and the hardware inspection module (20) is used to conduct an operation inspection on each component of the drone, and then the hardware self-inspection data of each part of the drone is transmitted to the main control screen through the data upload module (21), so that the management personnel can more intuitively confirm the current situation of the drone, ensure that there are no abnormalities in the hardware of the drone, and avoid omissions through systematic inspection, thereby avoiding damage to the drone caused by false detection and missed detection; during the inspection process, the image, sound wave and thermal image collected by the drone are collected through the data collection module (7) and the data analysis module (6), and then the image is corrected through the image correction module (38). The system makes adjustments, and then uses the analysis and comparison module (14) to compare with the historical image information to determine whether there is an abnormality. If an abnormality occurs, an alarm is issued in a timely manner. At the same time, the external noise during the inspection process is separated by the environmental noise reduction module (37) to prevent the external noise from affecting the sound wave recognition of the drone, making the drone inspection work more accurate and avoiding the accuracy of the inspection being affected by image blur or abnormal sound wave recognition. The signal transmission module (23) and the signal interaction module (24) regulate the collaborative control module (25), and then analyze the overall inspection route through the route analysis module (17), and reasonably allocate the overall route through the route allocation module (18), so that multiple drones can complete the inspection work together, thereby improving the inspection efficiency.

[0042] The present application provides a drone acoustic, optical and thermal integrated collaborative inspection system based on big data, including: a central processing module, an equipment self-inspection module, an autonomous inspection module, a flight control module, a wireless communication module, a data analysis module and a data collection module, wherein the central processing module controls the connection equipment self-inspection module, the autonomous inspection module, the flight control module, the wireless communication module, the data analysis module and the data collection module respectively, the autonomous inspection module and the flight control module are mutually controlled and connected, and the data analysis module and the data collection module are mutually controlled and connected. Compared with the prior art, the beneficial effects of the present application are: before the drone conducts an inspection, the central processing module is used to control the equipment self-inspection module to perform self-inspection on the drone, the hardware detection module is used to perform operation detection on each component of the drone, and then the hardware self-inspection data of each part of the drone is transmitted to the main control screen through the data upload module, so that the management personnel can more intuitively confirm the current situation of the drone, ensure that there is no abnormality in the hardware of the drone, and avoid omissions through systematic detection, thereby avoiding damage to the drone caused by false detection and missed detection; during the inspection process, the images, sound waves and thermal images collected by the drone are collected through the data collection module and the data analysis module, and then the image correction module is used to collect the images, sound waves and thermal images collected by the drone. The block adjusts the image, and then uses the analysis and comparison module to compare it with the historical image information to determine whether there is an abnormality. If there is an abnormality, an alarm will be issued in time. At the same time, the external noise during the inspection process is separated by the environmental noise reduction module to prevent external noise from affecting the sound wave recognition of the drone, making the drone inspection work more accurate and avoiding the accuracy of the inspection affected by image blur or abnormal sound wave recognition; the signal transmission module and the signal interaction module regulate the collaborative control module, and then analyze the overall inspection route through the route analysis module, and reasonably allocate the overall route through the route allocation module, so that multiple drones can complete the inspection work together, thereby improving the inspection efficiency.

[0043] Each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0044] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A drone acoustic, optical and thermal integrated collaborative inspection system based on big data, characterized in that: include: A central processing module (1), an equipment self-checking module (2), an autonomous patrol inspection module (3), a flight control module (4), a wireless communication module (5), a data analysis module (6) and a data collection module (7); wherein the central processing module (1) controls and connects the equipment self-checking module (2), the autonomous patrol inspection module (3), the flight control module (4), the wireless communication module (5), the data analysis module (6) and the data collection module (7) respectively, the autonomous patrol inspection module (3) and the flight control module (4) are connected to each other, and the data analysis module (6) and the data collection module (7) are connected to each other.

2. The big data-based drone acoustic, optical and thermal integrated collaborative inspection system according to claim 1 is characterized in that: The data analysis module (6) and the data collection module (7) both control the connection with the data storage module (8), the data transmission module (9) and the data backup module (10).

3. The big data-based drone acoustic, optical and thermal integrated collaborative inspection system according to claim 1 is characterized in that: The data analysis module (6) controls the connection to the image recognition module (11), the sound wave recognition module (12) and the thermal imaging recognition module (13) respectively; the image recognition module (11) controls the connection to the image correction module (38); the image correction module (38) controls the connection to the analysis and comparison module (14); and the sound wave recognition module (12) controls the connection to the environmental noise reduction module (37).

4. The big data-based drone acoustic, optical and thermal integrated collaborative inspection system according to claim 1 is characterized in that: The analysis and comparison module (14) controls the connection abnormality alarm module (15) and the abnormality recording module (16) respectively, and the abnormality recording module (16) controls the connection data collection module (7).

5. The big data-based drone acoustic, optical and thermal integrated collaborative inspection system according to claim 1 is characterized in that: The device self-check module (2) controls the connection to the hardware detection module (20), and the hardware detection module (20) controls the connection to the data upload module (21).

6. The drone acoustic, optical and thermal integrated collaborative inspection system based on big data according to claim 1 is characterized in that: The wireless communication module (5) controls the connection with the signal transmission module (23) and the signal interaction module (24) respectively, and the signal transmission module (23) and the signal interaction module (24) both control the connection with the collaborative control module (25).

7. The big data-based drone acoustic, optical and thermal integrated collaborative inspection system according to claim 6 is characterized in that: The collaborative control module (25) controls the connection route analysis module (17) and the route allocation module (18) respectively.

8. The big data-based drone acoustic, optical and thermal integrated collaborative inspection system according to claim 1 is characterized in that: The autonomous inspection module (3) and the flight control module (4) both control the connection to the equipment positioning module (30), the route preset module (31) and the route change module (32); the equipment positioning module (30), the route preset module (31) and the route change module (32) all control the connection to the navigation positioning module (33).

9. The big data-based drone acoustic, optical and thermal integrated collaborative inspection system according to claim 8 is characterized in that: The navigation positioning module (33) controls the connection start point positioning module (34), the inspection point module (35) and the end point positioning module (36) respectively.

10. The big data-based drone acoustic, optical and thermal integrated collaborative inspection system according to claim 8, characterized in that: The flight control module (4) controls the connection to the lifting control module (26), the hovering control module (27) and the direction control module (28) respectively, and the lifting control module (26), the hovering control module (27) and the direction control module (28) all control the connection to the fixed-point surrounding module (29).

Images