Bridge cable unmanned aerial vehicle detection path planning method

Through path planning based on field wind environment simulation library and image matching tracking flight technology, the problems of stability and comprehensive detection of drones in complex wind fields in bridge cable detection are solved, and efficient energy use and detection are achieved The reliability of the results has promoted the green and environmental protection of drone detection.

CN118938963APending Publication Date: 2024-11-12SHANGHAI RESEARCH INSTITUTE OF BUILDING SCIENCES CO LTD +1
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411178519.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-27
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

In bridge cable inspection, drones are difficult to achieve stable flight and comprehensive inspection due to complex wind farms and structural complexity, resulting in incomplete inspection results and high energy consumption.

Method used

Using the path planning method based on the field wind environment simulation library, combined with image matching tracking flight technology, determine the safe flight area and detection path of the drone, ensure the safety of the wind environment and traceability of the detection results, and optimize the drone patrol Route to reduce energy consumption.

Benefits of technology

It has achieved the comprehensiveness of the flight stability and detection results of drones in bridge cable detection, reduced energy consumption and labor investment, and promoted the green and environmentally friendly process of drone detection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118938963A_ABST
    Figure CN118938963A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of structure detection and unmanned aerial vehicle application, in particular to a bridge cable unmanned aerial vehicle detection path planning method which comprises the steps that S1, a wind field is simulated, and a simulation library is formed; s2, a detector obtains wind parameters through field measurement, matches the wind parameters with the simulation library, and selects an optimal wind field; s3, determining a flight safety control boundary; s4, determining a starting point, an end point and an intermediate control point, determining the inhaul cable according to the parameters, and manually delimiting the starting point, the intermediate control point and the end point; s5, different starting point and intermediate control point definition modes are adopted for different types of cable structures; s6, fusing the flight safety control boundary determined in the step S3 with path data of a starting point, an intermediate control point and an end point which are artificially delimited to form an actual unmanned aerial vehicle flight control point; s7, determining a multi-view path of inhaul cable detection according to detection requirements; and S8, adjusting the angle of a fixed camera lens of the unmanned aerial vehicle for detection, and adjusting the angle of the camera at the route end point to supplement data acquisition of the anchoring end.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of structural detection and unmanned aerial vehicle (UAV) application technology, and in particular to a method for planning a bridge cable UAV detection path. Background Art

[0002] Bridge cables include cable stays, arch bridge hangers, and suspension bridge main cables and hangers. These components, which are made of steel as the main load-bearing material, play an important role in transmitting force in the overall bridge structure and are one of the core elements for maintaining structural stability and safety. During bridge operation, these core components need to be inspected. Traditional methods include manual visual inspection, telescope visual inspection, and cable-climbing robot inspection. In recent years, with the development of drone technology, some studies have attempted to use drones to conduct cable status inspections.

[0003] In 2019, Southeast University proposed "A non-contact cable force testing system and method based on drone platform" (publication number: CN111044197A), in 2020, Southeast University proposed "A cable force rapid testing system and method under complex background based on drone platform and deep learning" (publication number: CN111259770A), and in 2021, Chongqing Jiaotong University proposed "Cable force measurement method based on image recognition static linear shape" (publication number: CN113720515A), involving the technical innovation of using drone technology to carry out cable force detection through photogrammetry; in 2021, Shanghai Dafeng Technology Co., Ltd. proposed "A bridge cable detection method based on automatic photography by drone" (publication number: CN113375642A), involving the use of drone technology for cable detection. The above patent disclosures do not have claims in technical directions such as drone detection pre-environmental conditions, wind safety disposal, and full-range path planning for cable sections.

[0004] The main problems of using drones for bridge cable inspection are: 1) Cable-structured bridges have large spans, and the cable system is at high altitudes, so the wind field is relatively complex and the wind speed is high. Excessive wind speed can cause rotor-type drones to lose control; 2) The cable system itself has a complex configuration. For example, the cable system of a cable-stayed bridge is in a fan-shaped plane, which is dispersed near the bridge deck below and concentrated near the bridge tower above. This will result in low wind speed below the cable system and high wind speed above. The operating range of drones will vary depending on the cable system; 3) The distance between the multiple cables that make up the cable system is not large. Due to the safety flight distance, it is difficult for drones to pass through the cables in a direction perpendicular to the plane of the cable system for inspection, resulting in the inspection images being mainly concentrated on the two side perspectives perpendicular to the cable platform, while the two side perspectives parallel to the cable plane are less collected, and the inspection results are not comprehensive; 4) When multiple cables are located in the same video screen, it is often impossible to distinguish which cable is which in the entire cable system because there is no obvious distinguishing mark between the cables, which is not convenient for the subsequent sorting of inspection results.

[0005] In response to the above-mentioned problems, this patent proposes a path planning method based on a field wind environment simulation library to ensure the safety of the wind environment when the UAV conducts cable inspection; it proposes an image matching tracking flight method based on a single or multiple cables to ensure the traceability of the UAV inspection results. By designing a path planning method based on a field wind environment simulation library, the energy consumption of UAVs during cable bridge inspection is reduced, and the UAV inspection route is upgraded to the most efficient path, saving resources, reducing excess fuel and excess labor, and further promoting the green and environmentally friendly work process of UAV cable bridge inspection. Summary of the invention

[0006] The purpose of the present invention is to overcome the shortcomings of the prior art and provide a bridge cable drone inspection path planning method to improve the applicability of existing drones in conducting cable inspections, ensuring flight safety and image data analysis. The inoperable area is determined by combining on-site measured point data, and then the tracking flight of single and multiple cables is carried out through image matching methods. The inspection results are continuously identified and summarized through machine vision to identify the surface defects of one or more cables.

[0007] In order to achieve the above-mentioned purpose, a method for UAV inspection path planning of bridge cables is designed, which is characterized in that the method comprises: S1. By establishing a CFD model of a cable structure bridge, simulating the wind field under different wind speed conditions around, recording relevant wind field data and forming a simulation library; S2. Before the operation, the inspection personnel obtain wind parameters through on-site measurement, match them with the simulation library, and select the best wind field; S3. According to the safe control wind speed of the UAV, the flight safety control boundary is determined from the matched data; S4. Determine the starting point, end point and intermediate control point of the single cable or multiple cables to be inspected, and determine the cables covered in the image during the UAV flight inspection according to the selected UAV mounting lens parameters and the distance parameters to the cable system plane during the UAV flight inspection, and manually define the starting point, intermediate control point and end point accordingly; S5. For different types of cable structures, different starting point and intermediate control point definition methods are adopted: a. For inclined cables that cover a single hanger and have an insignificant sag effect from the perspective of the UAV, according to a. For the cable-stayed cables that cover multiple hangers and have insignificant sag effects from the perspective of the drone, the end of the main beam is taken as the starting point, and the center position of multiple hangers at the end of the main beam and the center of the corresponding arch rib, tower or main cable anchor position are taken as intermediate control points; c. For the main cable and the cable-stayed cables with obvious sag effects, the end of the main beam is taken as the starting point, and sufficient feature points on the cable structure curve are selected as intermediate control points of the route process; S6. The flight safety control boundary determined in step S3 is merged with the path data of the manually defined starting point, intermediate control point and end point to form the actual drone flight control point within the safe flight area; S7. According to the detection requirements, determine the multi-view path for cable detection, including multiple flight detections of single, multiple hangers or cable-stayed cables to achieve full coverage; S8. Adjust the fixed camera lens angle of the drone for detection, and adjust the camera angle at the end of the route to supplement the data acquisition of the anchor end.

[0008] Preferably, the bridge cable UAV inspection path planning method provided by the present invention also includes other technical features. In step S7, the multi-view path of the cable inspection also includes: for the inspection of the main cable, the cable is inspected three times at three viewing angles parallel to the cable body cross-section that are 120° to each other, so as to achieve full coverage of the cable body cross-section within the viewing angle range; for the inspection of a single hanger and a cable with a focused viewing angle, the cable can be simplified to be inspected twice at two opposite viewing angles parallel to the cable body cross-section.

[0009] Preferably, the bridge cable drone inspection path planning method provided by the present invention also includes other technical features. The step S7 also includes first performing a quick initial scan to establish the spatial position of the cable, obtain spatial information, and then perform full-surface coverage scans in batches.

[0010] Preferably, the bridge cable UAV inspection path planning method provided by the present invention also includes other technical features. The path in step S7 is optimized as a whole in a manner that minimizes the inspection time. The path optimization strategy is analyzed according to three key parameters: the average moving speed of personnel, the average flight inspection speed of the UAV, and the single transfer time of the UAV. The estimated inspection time of each path obtained in the overall inspection path is determined based on the layout diagram of the bridge cables, and finally the path with the shortest inspection time is selected among multiple paths.

[0011] Preferably, the bridge cable UAV inspection path planning method provided by the present invention also includes other technical features. In the step S7, a gimbal linear change method is adopted between the end point of a single or multiple cable body inspection route and the manually determined end point, so that the sensor carried on the UAV changes the perception interval to the manually determined end point in the form of a smooth transition.

[0012] Compared with the prior art, the present invention has the following advantages: The use of drones in bridge cable inspection ensures the flight stability of drones in the complex wind field of the cable system; the operating range of drones can be dynamically adjusted according to project requirements; the image collection volume of both sides parallel to the cable plane is increased to provide more comprehensive inspection results; the target cables in the cable system are marked and distinguished to facilitate the collation of subsequent inspection results; the path optimization of the drone cable-stayed bridge inspection process is achieved, the excess fuel consumption during drone operation is reduced, and the green and environmentally friendly process of drone cable-stayed bridge inspection is further promoted. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 , is a workflow diagram of a method for determining a safe flight area based on a field wind environment simulation library of the present invention; Figure 2 , is a workflow diagram of the global multi-view flight path planning method based on a safe wind field of the present invention; Figure 3 , is a schematic diagram of the wind environment simulation results of the hanger arch bridge field in the embodiment; Figure 4 , is a schematic diagram of a method for planning a boom drone inspection path for a boom arch bridge in an embodiment; Figure 5 , is a schematic diagram of a method for planning a drone inspection path for a hanger and a main cable of a suspension bridge in an embodiment; In the figure: 1: arch bridge, 2: wind farm, 3: on-site feature points, 4: drone, 5: starting point, 6: drone flight path, 7: manual transfer path, 8: dangerous flight area, 9: first length direction detection, 10: second length direction detection, 11: third length direction detection, 12: retrieved cable, 13: drone mounting first perspective, 14: drone mounting second perspective, 15: drone mounting third perspective. DETAILED DESCRIPTION

[0014] In order to make the purpose, principle and structure of the present invention more clear, it is further described below in conjunction with the drawings and specific embodiments.

[0015] The first part of the present invention proposes a path planning method based on a field wind environment simulation library, specifically including: By establishing an overall computational fluid dynamics model (CFD model) of the cable-structure bridge and combining it with the input of the environmental wind field, the wind field conditions within the operating range of the drone near the cable system under different wind field and wind speed conditions are simulated.

[0016] For each wind field simulation result, record the wind field simulation data within the operating range of the drone at a certain spatial interval. Generally, the spatial interval is no more than 5m. At the same time, record the wind field results of the landmark points in the area that are manually reached during the on-site inspection of the bridge. Generally, select the areas that are relatively open and where the workers pass on the operation route, such as the mid-span position of the bridge deck, the bridge approach deck, the open space under the bridge, the top of the bridge tower, etc. At least one point should be selected, and multiple points can be selected; The wind field simulation results mentioned above include but are not limited to information such as wind speed, wind direction, longitude and latitude coordinates, and elevation at each location; By summarizing the simulation results of multiple wind farm environments, a field wind environment simulation library is formed.

[0017] Before the drone is used for on-site operation, the inspection personnel obtain the environmental wind parameters of key points of the bridge through on-site measurement and other methods, match the measured key point environmental wind parameters with the existing bridge field wind environment simulation library, and select the best matching wind field through the optimal matching method, such as the least squares method; Obtain the best matching wind field data, and according to the safety control wind speed of the selected UAV, obtain the wind field range that is less than the safety control wind speed in the high-dimensional matrix of the best matching wind field data by linear interpolation or other methods, thereby entering the UAV flight safety control boundary into the UAV flight control system; Naturally, the environmental wind field may change during the flight of the UAV, and the UAV’s own perception, flight and obstacle avoidance systems should be used to assist in safe control.

[0018] The second part of the present invention proposes a global multi-view flight path planning method based on a safe wind field. Before the on-site UAV flight inspection, it is necessary to plan the route of the UAV according to the unique form and inspection requirements of the cable and bridge. The implementation of this method is as follows: Determine the starting point, end point and possible intermediate control points of the single or multiple cables to be inspected. According to the selected drone mounting lens parameters and the distance parameters from the drone to the cable system plane during the drone flight inspection, determine the cables covered in the image during the drone flight inspection process, and manually define the starting point and end point accordingly; Among them, for the inclined cables that cover a single hanger and have no obvious sag effect from the perspective of the drone, the end of the main beam is taken as the starting point and the arch rib / bridge tower / main cable anchorage position is taken as the midpoint; for the inclined cables that cover multiple hangers and have no obvious sag effect from the perspective of the drone, the center positions of the multiple hangers at the end of the main beam and the centers of the corresponding arch rib / bridge tower / main cable anchorage positions are taken as the midpoints; for the main cables and inclined cables with obvious sag effect, sufficient characteristic points on the cable structure curve are selected as pass-through points during the route process.

[0019] The safe flight area determined by the field wind environment simulation library is integrated with the manually defined starting point, end point and the path data formed by the process connection, and finally the intersection is taken to form the actual UAV flight control point within the safe flight area; A multi-viewing path for the inspection of a group of cables is further determined. For the inspection of each group of single or multiple hangers or inclined cables, the cables are inspected four times at four mutually perpendicular viewing angles parallel to the cable body section to achieve full coverage of the cable body section within the viewing angle range; for the inspection of the main cable, the cables are inspected three times at three mutually 120° viewing angles parallel to the cable body section to achieve full coverage of the cable body section within the viewing angle range; in particular, for the inspection of a single hanger and inclined cable with a viewing angle focused on, the cables can be simplified to be inspected twice at two mutually opposite viewing angles parallel to the cable body section; For application scenarios with strong visible light, consider the direct sunlight detection on site and plan the adjustment of the above viewing angles in advance to avoid the impact of direct sunlight on the detection data of a certain viewing angle; Alternatively, you can first conduct a quick initial scan to establish the spatial position of the cable, including spatial information such as sag, and then conduct full-surface coverage scans in batches; The overall route planning of the drone in the entire bridge cable inspection is carried out, and the overall path is optimized according to the shortest inspection time. The three key parameters of the average movement speed of personnel, the average flight inspection speed of the drone, and the single transfer time of the drone are analyzed. According to the layout diagram of the bridge cables, the total movement distance of personnel in the overall inspection path, the total mileage of the drone inspection, and the number of drone transfers are determined to calculate the estimated inspection time of each path, and finally the scheme with the shortest inspection time is selected among multiple paths; During the inspection process, the flight inspection method of "fixed process + end change" is adopted. The camera lens angle is fixed during the given route, and the camera angle is adjusted at the end of the route to supplement the anchor end data for inspection, so that the drone can cover the inspection of the end status of the cable; Furthermore, between the end point of a single or multiple cable body detection route and the manually determined end point, a gimbal linear change method is used to enable the sensor carried on the drone to change the perception interval to the artificial end point in the form of a smooth transition.

[0020] <Example 1> The directional terms such as up, down, left, right, front, back, front, back, top, bottom, etc. mentioned or may be mentioned in the specific embodiments are defined relative to the structures shown in the drawings. They are relative concepts and may change accordingly according to their different positions and different usage states. Therefore, these or other directional terms should not be interpreted as restrictive terms. In addition, the terms "first", "second", "third", etc. or similar expressions are only used for description and distinction purposes, and cannot be understood as indicating or implying the relative importance of the corresponding components.

[0021] refer to Figure 3 , schematically shows the wind field 2 simulation results of an arch bridge 1 obtained by means of a computational fluid dynamics model, which contains the data f1 (x, y, z, ...) of four on-site feature points 3. Figure 1 , f1(x,y,z,…) data information can include the three-dimensional coordinate information of the points within a certain range of the space where the bridge is located and the corresponding wind field simulation results, wind speed, wind direction and other information, forming a wind environment field F1(x,y,z,…). The wind environment field F1(x,y,z,…) simulated by multiple simulations i (x, y, z, …) constitute the field wind environment simulation library F(x, y, z, …) corresponding to the bridge.

[0022] refer to Figure 1 and Figure 4 When a drone 4 is used for cable inspection, engineers or other personnel with working conditions first use inspection equipment at the bridge site to sample wind environment information at the site feature points 3 selected in the wind environment simulation of the corresponding bridge site to obtain information such as actual environmental wind speed and wind direction. 1’ (x, y, z, ...). The information collected from the four on-site feature points is matched with the results of the field wind environment simulation library. The matching calculation uses the following formula:

[0023] The wind field simulation result with the smallest d value is taken as the best matching wind field, which is considered to be the actual wind field environment at the detection site; m is the total number of feature points at the site; f i (x) is the data of the i-th point; f j (x) is the data of point j. According to the detection, the wind speed v is safely controlled by the drone. max , it can be determined that the bridge site area exceeds the safe control wind speed v max Dangerous flying areas8.

[0024] refer to Figure 2 and Figure 4 , the detection route planning of the drone 4, according to the characteristics of the bridge retrieval cable 12, first determine the starting point 5 and the end point according to the principle of full coverage, and clarify the drone flight path 6 and the manual transfer path 7. And according to the determined dangerous flight area 8, delete the path segment entering the dangerous flight area in the drone flight path 6, so as to obtain an implementable safe route planning path k1, and the total manual movement distance l under this path can be obtained e1 、Total mileage of drone inspection u1 And the number of drone transfers n. According to the average manual movement speed v estimated by the project e , UAV average flight detection speed v u and the single transfer time of the UAV t u , we can get the estimated total detection time t under this navigation path l :

[0025] For multiple possible detection routes, the estimated total detection time corresponding to each detection route can be obtained according to the above method, and the detection path with the shortest estimated total detection time is selected as the actual implementation path for the final drone detection.

[0026] refer to Figure 5 For the inspected cable 12, in order to fully inspect the appearance around the cable cross section, it can be fully inspected three times along the cable length direction according to the inspection angle range of the drone mount. The first length direction inspection 9, the second length direction inspection 10, and the third length direction inspection 11 are 120° in the cable cross section, corresponding to the first mounting angle range 13, the second mounting angle range 14, and the third mounting angle range 15 on the drone, which respectively cover the situation within the 120° range of the cable circumference, so as to realize a comprehensive inspection of the outer surface of the cross section.

[0027] The above description is only a specific implementation mode of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent substitutions or changes according to the technical solutions and novel concepts of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A bridge cable UAV inspection path planning method, characterized in that The method comprises: S1. By establishing a CFD model of the cable structure bridge, simulate the wind field under different wind speed conditions around it, record the relevant wind field data and form a simulation library; S2. Before the operation, the inspection personnel obtain wind parameters through on-site measurement, match them with the simulation library, and select the best wind field; S3. Determine the flight safety control boundary from the matched data according to the safety control wind speed of the UAV; S4. Determine the starting point, end point and intermediate control point of the single cable or multiple cables to be tested, determine the cables covered in the image during the UAV flight detection process according to the selected UAV mounting lens parameters and the distance parameters to the cable system plane during the UAV flight detection, and manually delineate the starting point, intermediate control point and end point accordingly; S5. Different methods of defining starting points and intermediate control points are used for different types of cable structures: For the cable-stayed cables with single hangers and insignificant sag effects covered from the drone’s perspective, the end of the main beam is taken as the starting point, and the arch rib, bridge tower or main cable anchorage position is taken as the intermediate control point; For the inclined cables with multiple hangers and insignificant sag effect under the drone's perspective, the end of the main beam is taken as the starting point, and the center of the multiple hangers at the end of the main beam and the center of the corresponding arch rib, bridge tower or main cable anchorage position are taken as the intermediate control points; For the main cable and the stay cable with obvious sag effect, take the end of the main beam as the starting point and select enough characteristic points on the cable structure curve as the middle control points of the route process; S6. The flight safety control boundary determined in step S3 is merged with the path data of the manually defined starting point, intermediate control point and end point to form the actual UAV flight control point within the safe flight area; S7. Determine the multi-view path for cable inspection according to the inspection requirements, including multiple flight inspections of single, multiple hangers or inclined cables to achieve full coverage; S8. Adjust the fixed camera lens angle of the drone for detection, and adjust the camera angle at the end of the route to supplement the data acquisition at the anchor end.

2. A bridge cable UAV inspection path planning method as claimed in claim 1, characterized in that: In step S7, the multi-view path of the cable detection also includes, for the detection of the main cable, three flying detections of the cable are performed at three viewing angles parallel to the cable body cross-section and 120° to each other, so as to achieve full coverage of the cable body cross-section within the viewing angle range; for the detection of a single hanger and a cable with a focusing view, the cable can be simplified to be tested twice at two opposing viewing angles parallel to the cable body cross-section.

3. A bridge cable UAV inspection path planning method as claimed in claim 1, characterized in that: The step S7 also includes performing a quick initial scan to establish the spatial position of the cable and obtain spatial information, and then performing full surface coverage scans in batches.

4. A bridge cable UAV inspection path planning method as claimed in claim 1, characterized in that: The path described in step S7 is optimized as a whole in a manner that minimizes the detection time. The path optimization strategy is analyzed based on three key parameters: the average moving speed of personnel, the average flight detection speed of drones, and the single transfer time of drones. The estimated detection time of each path obtained in the overall detection path is determined based on the layout diagram of the bridge cables, and finally the path with the shortest detection time is selected from multiple paths.

5. The method for planning a bridge cable UAV inspection path according to claim 1, characterized in that: In step S7, between the end point of a single or multiple cable body detection route and the manually determined end point, a gimbal linear change method is adopted to enable the sensor carried on the drone to change the sensing interval to the manually determined end point in a smooth transition.

Citation Information

Cited By

  • Method for automatically inspecting bridge cable by unmanned aerial vehicle

    CN120766159A