Unmanned aerial vehicle-based air defense warning device appearance inspection system and method thereof

Abstract

The invention discloses an air defense warning device appearance inspection method based on an unmanned aerial vehicle, and the method comprises the following steps: carrying out the inspection of a region map established by a target, and generating a preset inspection path; the unmanned aerial vehicle unit shoots images and videos of the target alarm according to the inspection route; acquiring the shot image or video data through an image acquisition module included in the inspection system unit, inputting the shot image or video data into a pre-trained intelligent analysis module, and judging whether a target inspection alarm is in a recognizable state or not; generating an inspection report of the target inspection alarm through the inspection system unit according to the inspection result of the target inspection alarm checked by a machine or manually; and the unmanned aerial vehicle unit sequentially completes inspection tasks of the target alarms in the regional map according to the inspection route. By adopting the technical scheme, the device is suitable for an operation environment with multiple target air defense warning devices, wide distribution and staggered arrangement, the patrol processing time of the air defense warning devices can be shortened, and manpower is saved.

Description

Technical Field

[0001] The present invention relates to the technical field of appearance inspection of air defense alarm devices, and in particular to an appearance inspection system and method of air defense alarm devices based on unmanned aerial vehicles. Background Art

[0002] In recent years, with the increase of high-rise buildings, the number of alarm devices used for air defense alarms has also been increasing. Due to the special requirements for the installation of air defense alarm devices, most of them are installed at higher places in buildings, which also brings severe challenges and tests to the inspection and testing of alarms.

[0003] In the prior art, the task of the appearance inspection of air defense alarm devices is mainly to conduct a comprehensive inspection of the alarm equipment's exterior paint, rain protection facilities, lightning protection system, control equipment system, power supply system, line layout, etc. At this stage, for air defense alarm devices located at high places, inspections can only rely on traditional manual climbing to high places, resulting in not only low efficiency in the appearance inspection of air defense alarm devices, but also great difficulty in inspection operations. Summary of the invention

[0004] The purpose of the present invention is to provide an air defense alarm device appearance inspection system and method based on a drone, which is used to solve the problem in the prior art that the inspection effect of air defense alarm devices with many devices, wide distribution and staggered layout is poor by manually climbing to high places.

[0005] The purpose of the present invention can be achieved through the following technical solutions:

[0006] A method for inspecting the appearance of an air defense alarm device based on a drone comprises the following steps:

[0007] S1. The route planning module included in the inspection system unit selects the inspection area of ​​a single target inspection alarm or multiple target alarms through a GIS map, establishes an area map based on the inspection target, and generates a preset inspection route;

[0008] S2. While the drone unit is navigating along the preset inspection route, the drone unit bypasses obstacles and continues to complete the preset flight route through its own TOF ranging and binocular vision ranging methods;

[0009] S3, the drone unit first arrives at the target inspection alarm N1 shooting positioning point according to the optimal order of the inspection route, and shoots N1 image and video through the alarm recognition camera module included in the drone unit;

[0010] S4, the image or video data of N1 is acquired through the image acquisition module included in the inspection system unit and input into the pre-trained intelligent analysis module, and the image acquisition module acquires the real-time inspection feature data information of the shooting positioning point of the target inspection alarm N1;

[0011] S5, comparing the real-time inspection feature data information of the target inspection alarm N1 shooting location point with the preset inspection feature data information stored in the intelligent analysis module to determine whether the target inspection alarm N1 is in a recognizable state;

[0012] S6. If the target inspection alarm N1 is determined to be in a recognizable state, a machine-audited inspection result of the target inspection alarm N1 is generated based on a feature comparison analysis of the real-time inspection feature data information and the preset inspection feature data information, and step S8 is executed;

[0013] S7, if it is determined that the target inspection alarm N1 is not in a recognizable state, the network high-definition camera module included in the drone stand-alone is started, and the image captured by the network high-definition camera module is uploaded to the inspection system unit through 5G communication, and the intelligent analysis module included in the inspection system unit manually reviews the captured image, generates a manual inspection result of the target inspection alarm N1, and executes step S8;

[0014] S8, generating an inspection report of the target inspection alarm N1 through the inspection system unit according to the inspection result of the target inspection alarm N1 audited by a machine or manually;

[0015] S9, the drone unit then completes the inspection tasks of the target alarms N2, N3, etc. in the area map in sequence according to the inspection route;

[0016] S10, the inspection system unit includes a result evaluation module that combines inspection reports of a single target alarm and generates an inspection result evaluation;

[0017] S11. Based on the generated inspection result evaluation, the work order dispatching module included in the inspection system unit automatically dispatches the maintenance work order to the responsible entity.

[0018] As a further solution of the present invention: the real-time inspection feature data information in step S5 includes the location of the target inspection alarm, exterior paint, rain protection facilities, lightning protection system, control equipment system, power supply system and line layout information.

[0019] As a further solution of the present invention: the preset inspection feature data information in step S5 includes the target inspection alarm location, exterior paint, rain protection facilities, lightning protection system, control equipment system, power supply system and line layout information stored after training is completed.

[0020] An air defense alarm device appearance inspection system based on a drone comprises a drone unit and an inspection system unit arranged on the drone unit;

[0021] The drone unit includes an alarm recognition camera module and a network high-definition camera module. The alarm recognition camera module is used to capture images and videos of the target patrol alarm. The network high-definition camera module is used to record the target patrol alarm in real time. The alarm recognition camera module and the network high-definition camera module are respectively connected to the patrol system unit via 5G communication.

[0022] The inspection system unit includes a route planning module, an image acquisition module, an intelligent analysis module, a result evaluation module and a work order dispatching module. The route planning module is used to generate a preset inspection path in the target area map. The image acquisition module is used to obtain the images input in real time by the alarm recognition camera module and the network high-definition camera module. The intelligent analysis is used to parse the real-time input images and determine whether the target inspection alarm is in a recognizable state. The result evaluation module is used to generate an inspection result evaluation for the target inspection alarm in the area map. The work order dispatching module is used to automatically dispatch maintenance work orders to the responsible entity.

[0023] As a further solution of the present invention: the captured images acquired in real time by the image acquisition module are compared with the trained images stored in the intelligent analysis module. When the intelligent analysis module determines whether the target inspection alarm is in a recognizable state, if it is determined that the target inspection alarm is in a recognizable state, a machine-audited inspection result of the target inspection alarm is generated.

[0024] As a further solution of the present invention: when the intelligent analysis module determines whether the target inspection alarm is in a recognizable state, if it is determined that the target inspection alarm is not in a recognizable state, the intelligent analysis module manually reviews the captured image and generates a manually reviewed inspection result of the target inspection alarm.

[0025] As a further solution of the present invention: the drone unit also includes a multi-sensor fusion positioning module, and the multi-sensor fusion positioning module is used to feed back the location information of the target inspection alarm to the inspection system unit.

[0026] The drone-based air defense alarm device appearance inspection system and method of the present invention have at least the following beneficial effects: it can be applied to an operating environment where the target air defense alarm devices are numerous, widely distributed, and arranged in a staggered manner; the drone unit and the inspection system unit can be used to complete a comprehensive inspection of the target alarm's appearance paint, rain protection facilities, lightning protection system, control equipment system, power supply system, line layout, etc., thereby shortening the inspection and processing time of the air defense alarm device, saving manpower, and avoiding safety accidents caused by manual climbing. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The present invention will be further described below in conjunction with the accompanying drawings.

[0028] Figure 1 It is a flow chart of the appearance inspection method of an air defense alarm device based on a drone of the present invention;

[0029] Figure 2 It is a structural block diagram of the appearance inspection of the air defense alarm device of the unmanned aerial vehicle of the present invention. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0031] In the description of the present invention, it should be understood that the terms indicating orientation or positional relationship are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention; in the description of the present invention, the meaning of "multiple" and "several" is at least two, for example two, three, etc., unless otherwise clearly and specifically defined.

[0032] See also Figure 1 As shown, a method for inspecting the appearance of an air defense alarm device based on a drone comprises the following steps:

[0033] S1. The route planning module included in the inspection system unit selects the inspection area of ​​a single target inspection alarm or multiple target alarms through the GIS map, establishes an area map based on the inspection target, and generates a preset inspection path. In this step, the route planning module uses a GIS map, which is a vector map with GPS positioning function, during the inspection target path planning process. The inspection track can be dynamically displayed and replayed, and the detailed information of the inspection target location can be obtained by GIS analysis.

[0034] S2. While the drone unit is navigating along the preset inspection route, it uses its own TOF ranging and binocular vision ranging methods to enable the drone unit to bypass obstacles and continue to complete the predetermined flight route. The built-in TOF ranging and binocular vision ranging methods in this step can enable the drone unit to accurately complete various inspection tasks, with automatic obstacle avoidance and autonomous return functions.

[0035] S3. The drone unit first reaches the target inspection alarm N1 shooting positioning point according to the optimal order of the inspection route, and shoots the N1 image and video through the alarm recognition camera module included in the drone unit. In this step, the drone unit inspection route can be carried out according to the optimal route to inspect the target alarms in the inspection area map in sequence.

[0036] S4. The captured N1 image or video data is acquired through the image acquisition module included in the inspection system unit and input into a pre-trained intelligent analysis module. The image acquisition module acquires the real-time inspection feature data information of the target inspection alarm N1 shooting positioning point. In this step, the intelligent analysis module is used to parse the real-time input image.

[0037] S5. Compare the real-time inspection feature data information of the shooting location point of the target inspection alarm N1 with the preset inspection feature data information stored in the intelligent analysis module to determine whether the target inspection alarm N1 is in a recognizable state. In this step, the real-time inspection feature data information includes the target inspection alarm position, exterior paint, rainproof facilities, lightning protection system, control equipment system, power supply system and line layout information; the preset inspection feature data information includes the target inspection alarm position, exterior paint, rainproof facilities, lightning protection system, control equipment system, power supply system and line layout information stored after training is completed.

[0038] It should be understood that when the preset inspection feature data information stored in the intelligent analysis module is operated, the MobileNetv3-YOLOv7 deep neural network is used to detect and classify the inspection targets in the captured images to obtain the inspection target status information; among them, the measurement information involved in the deep neural network inspection process includes weather, drone hovering position, shooting angle, etc.; the target analysis information involved includes color, shape, position, etc.; the completed inspection target structure includes the exterior paint of the alarm equipment, rain protection facilities, lightning protection system, control equipment system, power supply system, line layout, etc.

[0039] S6. If the target inspection alarm N1 is determined to be in a recognizable state, a machine-audited inspection result of the target inspection alarm N1 is generated based on feature comparison and analysis between the real-time inspection feature data information and the preset inspection feature data information, and step S8 is executed.

[0040] S7. If it is determined that the target inspection alarm N1 is not in a recognizable state, start the network high-definition camera module included in the drone stand-alone unit, and upload the image taken by the network high-definition camera module to the inspection system unit through 5G communication. The intelligent analysis module included in the inspection system unit manually reviews the captured image, generates a manually reviewed inspection result of the target inspection alarm N1, and executes step S8.

[0041] S8. Generate an inspection report of the target inspection alarm N1 through the inspection system unit according to the inspection result of the target inspection alarm N1 reviewed by a machine or manually.

[0042] S9. The drone unit then completes the inspection tasks of the target alarms N2, N3, etc. in the area map in sequence according to the inspection route.

[0043] S10. The result evaluation module included in the inspection system unit generates an inspection result evaluation by combining the inspection reports of the single target alarms.

[0044] S11. Based on the generated inspection result evaluation, the work order dispatching module included in the inspection system unit automatically dispatches the maintenance work order to the responsible party.

[0045] This inspection method is suitable for operating environments where the target air defense alarm devices are numerous, widely distributed, and staggered. The drone unit and the inspection system unit can be used to complete a comprehensive inspection of the target alarm's exterior paint, rain protection facilities, lightning protection system, control equipment system, power supply system, line layout, etc., shortening the inspection and processing time of the air defense alarm device, saving manpower, and avoiding safety accidents caused by manual climbing.

[0046] This inspection method uses drone units, and staff will focus on checking whether the appearance maintenance is in place, whether the lines are aging, whether the power supply system is effective, and whether the working condition is intact. At the same time, they will also focus on checking whether parts with safety hazards such as alarm brackets and antenna connection parts are fixed, and whether the connection parts (bolts) are missing or corroded.

[0047] like Figure 2 As shown, the present invention also provides an appearance inspection system for air defense alarm devices based on drones, comprising a drone unit and an inspection system unit arranged on the drone unit;

[0048] The drone unit includes an alarm recognition camera module and a network high-definition camera module. The alarm recognition camera module is used to capture images and videos of the target inspection alarm. The network high-definition camera module is used to record the target inspection alarm in real time. The alarm recognition camera module and the network high-definition camera module are connected to the inspection system unit through 5G communication.

[0049] The inspection system unit includes a route planning module, an image acquisition module, an intelligent analysis module, a result evaluation module and a work order distribution module. The route planning module is used to generate a preset inspection path within the target area map. The image acquisition module is used to obtain the images input in real time by the alarm recognition camera module and the network high-definition camera module. The intelligent analysis is used to parse the real-time input images and determine whether the target inspection alarm is in a recognizable state. The result evaluation module is used to generate an inspection result evaluation for the target inspection alarm in the area map. The work order distribution module is used to automatically distribute maintenance work orders to the responsible entity.

[0050] This inspection system is suitable for operating environments where the target air defense alarm devices are numerous, widely distributed, and arranged in a staggered manner. The drone unit and the inspection system unit can be used to complete a comprehensive inspection of the target alarm's exterior paint, rain protection facilities, lightning protection system, control equipment system, power supply system, line layout, etc., shortening the inspection and processing time of the air defense alarm device, saving manpower, and avoiding safety accidents caused by manual climbing.

[0051] With the help of drone units, the inspection system staff will focus on checking whether the appearance maintenance is in place, whether the lines are aging, whether the power supply system is effective, and whether the working condition is intact. At the same time, they will also focus on checking whether the alarm bracket, antenna connection components and other components with safety hazards are fixed, and whether the connection components (bolts) are missing or corroded.

[0052] In this specific implementation, the captured images acquired in real time by the image acquisition module are compared with the images stored and trained by the intelligent analysis module for features. When the intelligent analysis module determines whether the target inspection alarm is in a recognizable state, if it is determined that the target inspection alarm is in a recognizable state, a machine-reviewed inspection result of the target inspection alarm is generated. During the recognition and judgment process, when the captured images acquired in real time meet the feature comparison requirements of the stored trained images, it is convenient for the intelligent analysis module machine to quickly generate inspection results.

[0053] In this specific implementation, when the intelligent analysis module determines whether the target inspection alarm is in a recognizable state, if it is determined that the target inspection alarm is not in a recognizable state, the intelligent analysis module manually reviews the captured image and generates an inspection result of the manually reviewed target inspection alarm. During the recognition and judgment process, when the real-time acquisition of the captured image cannot satisfy the feature comparison of the stored trained image, it is convenient to quickly generate the inspection result through manual review.

[0054] In this specific implementation, the drone unit also includes a multi-sensor fusion positioning module, which is used to feed back the location information of the target inspection alarm to the inspection system unit.

[0055] The above is a detailed description of an embodiment of the present invention, but the content is only a preferred embodiment of the present invention and cannot be considered to limit the scope of implementation of the present invention. All equivalent changes and improvements made within the scope of the present invention should still fall within the scope of the patent coverage of the present invention.

Claims

1. A method for inspecting the appearance of an air defense alarm device based on a drone, characterized in that: The following steps are involved: S1. The route planning module included in the inspection system unit selects the inspection area of ​​a single target inspection alarm or multiple target alarms through a GIS map, establishes an area map based on the inspection target, and generates a preset inspection route; S2. While the drone unit is navigating along the preset inspection route, the drone unit bypasses obstacles and continues to complete the preset flight route through its own TOF ranging and binocular vision ranging methods; S3, the drone unit first arrives at the target inspection alarm N1 shooting positioning point according to the optimal order of the inspection route, and shoots N1 image and video through the alarm recognition camera module included in the drone unit; S4, the image or video data of N1 is acquired through the image acquisition module included in the inspection system unit and input into the pre-trained intelligent analysis module, and the image acquisition module acquires the real-time inspection feature data information of the shooting positioning point of the target inspection alarm N1; S5, comparing the real-time inspection feature data information of the target inspection alarm N1 shooting location point with the preset inspection feature data information stored in the intelligent analysis module to determine whether the target inspection alarm N1 is in a recognizable state; S6. If the target inspection alarm N1 is determined to be in a recognizable state, a machine-audited inspection result of the target inspection alarm N1 is generated based on a feature comparison analysis of the real-time inspection feature data information and the preset inspection feature data information, and step S8 is executed; S7. If it is determined that the target inspection alarm N1 is not in a recognizable state, the network high-definition camera module included in the drone is started, and the image captured by the network high-definition camera module is uploaded to the inspection system unit through 5G communication. The intelligent analysis module included in the inspection system unit manually reviews the captured image, generates an inspection result of the manually reviewed target inspection alarm N1, and executes step S8; S8, generating an inspection report of the target inspection alarm N1 through the inspection system unit according to the inspection result of the target inspection alarm N1 audited by a machine or manually; S9, the drone unit then completes the inspection tasks of the target alarms N2, N3, etc. in the area map in sequence according to the inspection route; S10, the inspection system unit includes a result evaluation module that combines inspection reports of a single target alarm and generates an inspection result evaluation; S11. Based on the generated inspection result evaluation, the work order dispatching module included in the inspection system unit automatically dispatches the maintenance work order to the responsible entity.

2. The method for inspecting the appearance of an air defense alarm device based on a drone according to claim 1 is characterized in that: The real-time inspection characteristic data information in step S5 includes the location of the target inspection alarm, exterior coating, rain protection facilities, lightning protection system, control equipment system, power supply system and line layout information.

3. The appearance inspection system and method of an air defense alarm device based on a drone according to claim 1 is characterized in that: The preset inspection feature data information in step S5 includes the target inspection alarm location, exterior coating, rain protection facilities, lightning protection system, control equipment system, power supply system and line layout information stored after training is completed.

4. An air defense alarm device appearance inspection system based on drones, characterized in that: It includes a drone unit and an inspection system unit arranged on the drone unit; The drone unit includes an alarm recognition camera module and a network high-definition camera module. The alarm recognition camera module is used to capture images and videos of the target patrol alarm. The network high-definition camera module is used to record the target patrol alarm in real time. The alarm recognition camera module and the network high-definition camera module are respectively connected to the patrol system unit via 5G communication. The inspection system unit includes a route planning module, an image acquisition module, an intelligent analysis module, a result evaluation module and a work order dispatching module. The route planning module is used to generate a preset inspection path in the target area map. The image acquisition module is used to obtain the images input in real time by the alarm recognition camera module and the network high-definition camera module. The intelligent analysis is used to parse the real-time input images and determine whether the target inspection alarm is in a recognizable state. The result evaluation module is used to generate an inspection result evaluation for the target inspection alarm in the area map. The work order dispatching module is used to automatically dispatch maintenance work orders to the responsible entity.

5. The appearance inspection system of air defense alarm device based on drone according to claim 4 is characterized in that: The captured images acquired in real time by the image acquisition module are compared with the trained images stored in the intelligent analysis module. When the intelligent analysis module determines whether the target inspection alarm is in a recognizable state, if it is determined that the target inspection alarm is in a recognizable state, a machine-audited inspection result of the target inspection alarm is generated.

6. The appearance inspection system of air defense alarm device based on drone according to claim 5 is characterized in that: When the intelligent analysis module determines whether the target inspection alarm is in a recognizable state, if it is determined that the target inspection alarm is not in a recognizable state, the intelligent analysis module manually reviews the captured image and generates an inspection result of the manually reviewed target inspection alarm.

7. The appearance inspection system of air defense alarm device based on drone according to claim 4 is characterized in that: The drone unit also includes a multi-sensor fusion positioning module, which is used to feed back the location information of the target patrol alarm to the patrol system unit.

Images